[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:59:14.958170   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43599
I20260709 12:59:14.959970   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:59:14.961055   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:14.981021   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:14.981365   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:14.986749   431 server_base.cc:1061] running on GCE node
W20260709 12:59:14.984342   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:16.204943   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:16.205274   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:16.205509   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601956205488 us; error 0 us; skew 500 ppm
I20260709 12:59:16.206429   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:16.213580   431 webserver.cc:533] Webserver started at http://127.0.107.254:36315/ using document root <none> and password file <none>
I20260709 12:59:16.214570   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:16.214916   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:16.215440   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:16.221633   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "a7476814734d4cfdba7f477f96889b11"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.230892   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:59:16.236651   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.237869   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:59:16.238312   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "a7476814734d4cfdba7f477f96889b11"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.238719   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:16.314752   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:16.316483   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:59:16.317023   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:16.405941   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43599
I20260709 12:59:16.406073   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43599 every 8 connection(s)
I20260709 12:59:16.425455   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:16.456751   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: Bootstrap starting.
I20260709 12:59:16.464668   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:16.466677   498 log.cc:826] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: Log is configured to *not* fsync() on all Append() calls
I20260709 12:59:16.472101   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: No bootstrap required, opened a new log
I20260709 12:59:16.494517   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER }
I20260709 12:59:16.495288   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:16.495568   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7476814734d4cfdba7f477f96889b11, State: Initialized, Role: FOLLOWER
I20260709 12:59:16.496526   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER }
I20260709 12:59:16.497093   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:16.497413   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:16.497794   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:16.502519   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER }
I20260709 12:59:16.503393   498 leader_election.cc:304] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7476814734d4cfdba7f477f96889b11; no voters: 
I20260709 12:59:16.505172   498 leader_election.cc:290] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:16.505616   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:16.509071   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 1 LEADER]: Becoming Leader. State: Replica: a7476814734d4cfdba7f477f96889b11, State: Running, Role: LEADER
I20260709 12:59:16.509919   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER }
I20260709 12:59:16.510545   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:16.524113   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7476814734d4cfdba7f477f96889b11. Latest consensus state: current_term: 1 leader_uuid: "a7476814734d4cfdba7f477f96889b11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER } }
I20260709 12:59:16.524335   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7476814734d4cfdba7f477f96889b11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7476814734d4cfdba7f477f96889b11" member_type: VOTER } }
I20260709 12:59:16.525466   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:16.525732   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:16.530263   510 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:16.543408   510 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:16.546116   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:16.563446   510 catalog_manager.cc:1383] Generated new cluster ID: ec915da782f544dca33d6334bb1bab94
I20260709 12:59:16.563777   510 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:16.585901   510 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:16.587984   510 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:16.600150   510 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: Generated new TSK 0
I20260709 12:59:16.601254   510 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:16.612860   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:16.623086   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:16.624383   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:16.629081   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:16.629294   431 server_base.cc:1061] running on GCE node
I20260709 12:59:16.630285   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:16.630548   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:16.630800   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601956630780 us; error 0 us; skew 500 ppm
I20260709 12:59:16.631513   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:16.636270   431 webserver.cc:533] Webserver started at http://127.0.107.193:37939/ using document root <none> and password file <none>
I20260709 12:59:16.636890   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:16.637133   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:16.637437   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:16.638994   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "c9bb865b04214284a0b277589c4bcb7a"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.645586   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:59:16.651150   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.652146   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:59:16.652544   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "c9bb865b04214284a0b277589c4bcb7a"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.652889   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:16.670529   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:16.672004   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:16.675359   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:16.680003   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:16.680259   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.680614   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:16.680768   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.800650   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40049
I20260709 12:59:16.800768   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40049 every 8 connection(s)
I20260709 12:59:16.809242   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:16.820248   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:16.823354   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:16.831429   431 server_base.cc:1061] running on GCE node
W20260709 12:59:16.832715   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:16.833756   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:16.833969   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:16.834203   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601956834169 us; error 0 us; skew 500 ppm
I20260709 12:59:16.835072   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:16.838347   431 webserver.cc:533] Webserver started at http://127.0.107.194:44959/ using document root <none> and password file <none>
I20260709 12:59:16.839071   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:16.839329   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:16.839661   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:16.841194   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.842729   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43599
I20260709 12:59:16.843223   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:16.844453   591 heartbeater.cc:507] Master 127.0.107.254:43599 requested a full tablet report, sending...
I20260709 12:59:16.848649   463 ts_manager.cc:194] Registered new tserver with Master: c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049)
I20260709 12:59:16.848763   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.007s
I20260709 12:59:16.851768   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36098
I20260709 12:59:16.854606   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.855743   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:59:16.856081   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
format_stamp: "Formatted at 2026-07-09 12:59:16 on dist-test-slave-n5kz"
I20260709 12:59:16.856467   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:16.878602   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:16.880467   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:16.882602   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:16.885972   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:16.886162   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:16.886490   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:16.886694   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:59:16.994379   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38723
I20260709 12:59:16.995151   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38723 every 8 connection(s)
I20260709 12:59:17.002723   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:17.015980   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:17.020885   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43599
I20260709 12:59:17.021484   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:17.022703   666 heartbeater.cc:507] Master 127.0.107.254:43599 requested a full tablet report, sending...
I20260709 12:59:17.024610   431 server_base.cc:1061] running on GCE node
I20260709 12:59:17.025452   463 ts_manager.cc:194] Registered new tserver with Master: 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
W20260709 12:59:17.026086   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:17.027218   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:17.027393   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36110
I20260709 12:59:17.028350   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:17.028626   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:17.028829   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601957028812 us; error 0 us; skew 500 ppm
I20260709 12:59:17.029563   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:17.032588   431 webserver.cc:533] Webserver started at http://127.0.107.195:41355/ using document root <none> and password file <none>
I20260709 12:59:17.033083   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:17.033278   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:17.033555   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:17.034740   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
format_stamp: "Formatted at 2026-07-09 12:59:17 on dist-test-slave-n5kz"
I20260709 12:59:17.039384   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:59:17.042829   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:17.043723   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:59:17.043989   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
format_stamp: "Formatted at 2026-07-09 12:59:17 on dist-test-slave-n5kz"
I20260709 12:59:17.044263   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:17.056469   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:17.058303   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:17.060190   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:17.063102   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:17.063344   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:17.063583   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:17.063758   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:17.172248   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37199
I20260709 12:59:17.172343   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37199 every 8 connection(s)
I20260709 12:59:17.190807   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43599
I20260709 12:59:17.191243   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:17.192209   740 heartbeater.cc:507] Master 127.0.107.254:43599 requested a full tablet report, sending...
I20260709 12:59:17.194248   463 ts_manager.cc:194] Registered new tserver with Master: 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:17.195225   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01739178s
I20260709 12:59:17.195797   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36112
I20260709 12:59:17.271359   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36122:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:17.275802   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:17.399622   556 tablet_service.cc:1511] Processing CreateTablet for tablet b3c3fc9907754c2e8a7d4d324d299d65 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:17.402094   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c3fc9907754c2e8a7d4d324d299d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.404445   555 tablet_service.cc:1511] Processing CreateTablet for tablet 26b558dcc9a148fa89cc77079b594ce4 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:17.399955   554 tablet_service.cc:1511] Processing CreateTablet for tablet 68081489f4dc49398f42dfb91824089a (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:17.405969   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b558dcc9a148fa89cc77079b594ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.409108   553 tablet_service.cc:1511] Processing CreateTablet for tablet 04c631f24ba1446c9450be51a1054f8d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:17.411373   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68081489f4dc49398f42dfb91824089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.418401   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c631f24ba1446c9450be51a1054f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.427755   630 tablet_service.cc:1511] Processing CreateTablet for tablet 26b558dcc9a148fa89cc77079b594ce4 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:17.431665   631 tablet_service.cc:1511] Processing CreateTablet for tablet b3c3fc9907754c2e8a7d4d324d299d65 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:17.431828   629 tablet_service.cc:1511] Processing CreateTablet for tablet 68081489f4dc49398f42dfb91824089a (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:17.439307   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b558dcc9a148fa89cc77079b594ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.441075   552 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc78523b71949379e4159ca5c30d73c (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:17.439221   628 tablet_service.cc:1511] Processing CreateTablet for tablet 04c631f24ba1446c9450be51a1054f8d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:17.447564   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc78523b71949379e4159ca5c30d73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.449703   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c3fc9907754c2e8a7d4d324d299d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.451433   551 tablet_service.cc:1511] Processing CreateTablet for tablet 050cc628ecd94fb1a961a25b584fa377 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:17.455327   627 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc78523b71949379e4159ca5c30d73c (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:17.462239   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c631f24ba1446c9450be51a1054f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.463289   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68081489f4dc49398f42dfb91824089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.463275   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cc628ecd94fb1a961a25b584fa377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.465744   626 tablet_service.cc:1511] Processing CreateTablet for tablet 050cc628ecd94fb1a961a25b584fa377 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:17.469646   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc78523b71949379e4159ca5c30d73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.474480   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cc628ecd94fb1a961a25b584fa377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.489832   550 tablet_service.cc:1511] Processing CreateTablet for tablet 62dcb1b55ac248bfb885163ef6590dc6 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:17.492654   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dcb1b55ac248bfb885163ef6590dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.510470   625 tablet_service.cc:1511] Processing CreateTablet for tablet 62dcb1b55ac248bfb885163ef6590dc6 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:17.516812   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dcb1b55ac248bfb885163ef6590dc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:17.552193   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:17.587102   705 tablet_service.cc:1511] Processing CreateTablet for tablet b3c3fc9907754c2e8a7d4d324d299d65 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:59:17.588886   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c3fc9907754c2e8a7d4d324d299d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.601264   703 tablet_service.cc:1511] Processing CreateTablet for tablet 68081489f4dc49398f42dfb91824089a (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:59:17.608597   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68081489f4dc49398f42dfb91824089a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.609338   700 tablet_service.cc:1511] Processing CreateTablet for tablet 050cc628ecd94fb1a961a25b584fa377 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:59:17.609436   704 tablet_service.cc:1511] Processing CreateTablet for tablet 26b558dcc9a148fa89cc77079b594ce4 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:59:17.614269   701 tablet_service.cc:1511] Processing CreateTablet for tablet 6dc78523b71949379e4159ca5c30d73c (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:59:17.616189   702 tablet_service.cc:1511] Processing CreateTablet for tablet 04c631f24ba1446c9450be51a1054f8d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:59:17.611971   699 tablet_service.cc:1511] Processing CreateTablet for tablet 62dcb1b55ac248bfb885163ef6590dc6 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:59:17.618885   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cc628ecd94fb1a961a25b584fa377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.620177   759 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:17.622349   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b558dcc9a148fa89cc77079b594ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.625978   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dc78523b71949379e4159ca5c30d73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.630228   698 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb271e9f2134292a261a1c06ee3d72d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:17.632483   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62dcb1b55ac248bfb885163ef6590dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.620353   553 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb271e9f2134292a261a1c06ee3d72d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:17.636353   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb271e9f2134292a261a1c06ee3d72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.644796   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04c631f24ba1446c9450be51a1054f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.639041   630 tablet_service.cc:1511] Processing CreateTablet for tablet 0cb271e9f2134292a261a1c06ee3d72d (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:59:17.653126   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb271e9f2134292a261a1c06ee3d72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.659269   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cb271e9f2134292a261a1c06ee3d72d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.664520   758 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:17.668478   554 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac0ed91bebd44faa0b1a3cdf3124216 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:17.674247   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac0ed91bebd44faa0b1a3cdf3124216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.683933   626 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac0ed91bebd44faa0b1a3cdf3124216 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:17.685647   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac0ed91bebd44faa0b1a3cdf3124216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.733716   760 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:17.745689   760 tablet_bootstrap.cc:654] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.760854   699 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac0ed91bebd44faa0b1a3cdf3124216 (DEFAULT_TABLE table=test-workload [id=554c4467d62c416595412d8d41576ee6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:59:17.762426   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac0ed91bebd44faa0b1a3cdf3124216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:17.777211   759 tablet_bootstrap.cc:654] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.781246   760 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:17.781750   760 ts_tablet_manager.cc:1403] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.005s
I20260709 12:59:17.785202   760 raft_consensus.cc:359] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.785902   760 raft_consensus.cc:385] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.786100   760 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.787719   758 tablet_bootstrap.cc:654] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.787377   760 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.811233   759 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:17.811753   759 ts_tablet_manager.cc:1403] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.004s
I20260709 12:59:17.814148   758 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:17.814656   758 ts_tablet_manager.cc:1403] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.199s	user 0.009s	sys 0.008s
I20260709 12:59:17.815591   759 raft_consensus.cc:359] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.816354   759 raft_consensus.cc:385] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.816659   759 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.817414   759 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.817515   758 raft_consensus.cc:359] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.818356   758 raft_consensus.cc:385] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.818718   758 raft_consensus.cc:740] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.819967   758 consensus_queue.cc:260] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.820902   740 heartbeater.cc:499] Master 127.0.107.254:43599 was elected leader, sending a full tablet report...
I20260709 12:59:17.821530   760 ts_tablet_manager.cc:1434] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.039s	user 0.012s	sys 0.027s
I20260709 12:59:17.822644   760 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:17.836158   760 tablet_bootstrap.cc:654] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.840327   666 heartbeater.cc:499] Master 127.0.107.254:43599 was elected leader, sending a full tablet report...
I20260709 12:59:17.839078   759 ts_tablet_manager.cc:1434] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:59:17.847936   591 heartbeater.cc:499] Master 127.0.107.254:43599 was elected leader, sending a full tablet report...
I20260709 12:59:17.848398   759 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:17.856951   758 ts_tablet_manager.cc:1434] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.023s
I20260709 12:59:17.858075   758 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:17.859313   760 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:17.859795   760 ts_tablet_manager.cc:1403] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 12:59:17.865005   760 raft_consensus.cc:359] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.865852   760 raft_consensus.cc:385] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.866255   759 tablet_bootstrap.cc:654] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.866225   760 raft_consensus.cc:740] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.867152   760 consensus_queue.cc:260] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.869318   760 ts_tablet_manager.cc:1434] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:59:17.870286   760 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:17.877858   760 tablet_bootstrap.cc:654] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.878731   759 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:17.879220   759 ts_tablet_manager.cc:1403] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
I20260709 12:59:17.882006   759 raft_consensus.cc:359] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.882754   759 raft_consensus.cc:385] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.883061   759 raft_consensus.cc:740] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.883785   759 consensus_queue.cc:260] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.886806   759 ts_tablet_manager.cc:1434] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:17.887737   759 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:17.890893   760 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:17.891414   760 ts_tablet_manager.cc:1403] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:59:17.894918   759 tablet_bootstrap.cc:654] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.894791   760 raft_consensus.cc:359] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.895795   760 raft_consensus.cc:385] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.896155   760 raft_consensus.cc:740] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.897984   760 consensus_queue.cc:260] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.900945   760 ts_tablet_manager.cc:1434] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:59:17.906106   760 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:17.903467   758 tablet_bootstrap.cc:654] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.913268   759 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:17.913354   758 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:17.913893   759 ts_tablet_manager.cc:1403] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.013s
I20260709 12:59:17.914016   758 ts_tablet_manager.cc:1403] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.003s
I20260709 12:59:17.916905   759 raft_consensus.cc:359] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.917656   759 raft_consensus.cc:385] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.917873   760 tablet_bootstrap.cc:654] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.918018   759 raft_consensus.cc:740] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.918931   759 consensus_queue.cc:260] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.921406   759 ts_tablet_manager.cc:1434] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:59:17.922835   759 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:17.929329   759 tablet_bootstrap.cc:654] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:17.930804   741 tablet.cc:2406] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:59:17.932786   762 raft_consensus.cc:493] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.933296   762 raft_consensus.cc:515] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.917171   758 raft_consensus.cc:359] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.941944   758 raft_consensus.cc:385] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.942793   758 raft_consensus.cc:740] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.943868   758 consensus_queue.cc:260] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.947314   758 ts_tablet_manager.cc:1434] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.006s
I20260709 12:59:17.948647   758 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:17.950109   762 leader_election.cc:290] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:17.963272   759 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:17.963781   759 ts_tablet_manager.cc:1403] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.015s
I20260709 12:59:17.963673   758 tablet_bootstrap.cc:654] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.965824   760 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:17.967808   759 raft_consensus.cc:359] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.968607   759 raft_consensus.cc:385] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.968930   759 raft_consensus.cc:740] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.969713   759 consensus_queue.cc:260] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.968024   760 ts_tablet_manager.cc:1403] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.001s
I20260709 12:59:17.979566   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:17.980777   759 ts_tablet_manager.cc:1434] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:59:17.981827   759 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
W20260709 12:59:17.985149   680 leader_election.cc:343] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:17.985368   760 raft_consensus.cc:359] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.986114   760 raft_consensus.cc:385] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:17.988741   759 tablet_bootstrap.cc:654] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:17.986460   760 raft_consensus.cc:740] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:17.994457   760 consensus_queue.cc:260] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:17.999905   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.000775   641 raft_consensus.cc:2468] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 0.
I20260709 12:59:18.002238   759 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:18.002750   759 ts_tablet_manager.cc:1403] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 12:59:18.002641   766 raft_consensus.cc:493] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.002976   681 leader_election.cc:304] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.003187   766 raft_consensus.cc:515] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.006181   766 leader_election.cc:290] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.006708   766 raft_consensus.cc:493] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.007179   766 raft_consensus.cc:515] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.009150   766 leader_election.cc:290] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.009361   762 raft_consensus.cc:2804] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.009889   762 raft_consensus.cc:493] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.010358   762 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.013221   759 raft_consensus.cc:359] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.014284   759 raft_consensus.cc:385] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.014583   759 raft_consensus.cc:740] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.015390   759 consensus_queue.cc:260] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.017921   759 ts_tablet_manager.cc:1434] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:59:18.018937   759 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:18.025825   759 tablet_bootstrap.cc:654] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.028081   760 ts_tablet_manager.cc:1434] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 12:59:18.032891   758 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.033519   758 ts_tablet_manager.cc:1403] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.085s	user 0.027s	sys 0.009s
I20260709 12:59:18.038604   760 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:18.021945   762 raft_consensus.cc:515] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.057603   759 tablet_bootstrap.cc:492] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:18.057300   758 raft_consensus.cc:359] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.057528   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:18.058635   758 raft_consensus.cc:385] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.058944   758 raft_consensus.cc:740] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
W20260709 12:59:18.059770   680 leader_election.cc:343] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.059697   758 consensus_queue.cc:260] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.060726   759 ts_tablet_manager.cc:1403] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.022s
I20260709 12:59:18.064328   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.064924   641 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.065786   760 tablet_bootstrap.cc:654] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.067085   758 ts_tablet_manager.cc:1434] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 12:59:18.068922   758 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.065819   762 leader_election.cc:290] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.074234   765 raft_consensus.cc:493] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.075913   765 raft_consensus.cc:515] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.080650   765 leader_election.cc:290] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.090971   758 tablet_bootstrap.cc:654] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.103096   759 raft_consensus.cc:359] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.109925   759 raft_consensus.cc:385] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.111232   759 raft_consensus.cc:740] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.112135   759 consensus_queue.cc:260] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.103217   641 raft_consensus.cc:2468] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 1.
I20260709 12:59:18.127682   759 ts_tablet_manager.cc:1434] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.004s
I20260709 12:59:18.129062   759 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:18.132751   681 leader_election.cc:304] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.133667   762 raft_consensus.cc:2804] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.143977   765 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.144853   765 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.147205   765 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.161684   765 raft_consensus.cc:493] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.162331   765 raft_consensus.cc:515] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.164927   765 leader_election.cc:290] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.177060   760 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:18.177491   762 raft_consensus.cc:697] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:18.180199   762 consensus_queue.cc:237] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.180713   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.182076   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.182708   566 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 0.
I20260709 12:59:18.182873   760 ts_tablet_manager.cc:1403] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.144s	user 0.023s	sys 0.003s
W20260709 12:59:18.185177   606 leader_election.cc:343] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.186102   606 leader_election.cc:304] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.187134   758 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.187634   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.187636   758 ts_tablet_manager.cc:1403] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.016s
I20260709 12:59:18.187785   765 raft_consensus.cc:2804] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.188261   566 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 0.
I20260709 12:59:18.188762   765 raft_consensus.cc:493] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.189596   765 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.189909   606 leader_election.cc:304] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.188323   760 raft_consensus.cc:359] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.193439   760 raft_consensus.cc:385] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.193931   760 raft_consensus.cc:740] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.205650   760 consensus_queue.cc:260] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.212953   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.214735   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.216599   758 raft_consensus.cc:359] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.216879   714 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.217469   758 raft_consensus.cc:385] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.218058   758 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
W20260709 12:59:18.218454   530 leader_election.cc:343] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.219518   758 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.219525   530 leader_election.cc:304] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.222295   759 tablet_bootstrap.cc:654] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.215687   760 ts_tablet_manager.cc:1434] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 12:59:18.226552   791 raft_consensus.cc:2804] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.228118   791 raft_consensus.cc:493] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.228914   792 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.229995   791 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.229939   780 raft_consensus.cc:2804] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.230937   780 raft_consensus.cc:493] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.232115   760 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:18.226457   765 raft_consensus.cc:515] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.230782   792 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.232350   780 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.236382   790 raft_consensus.cc:493] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.240173   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.240899   641 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.237392   790 raft_consensus.cc:515] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.246045   532 leader_election.cc:304] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:18.246675   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.247483   766 raft_consensus.cc:2804] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.247833   766 raft_consensus.cc:493] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.248152   766 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.248098   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:18.243901   762 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.244797   765 leader_election.cc:290] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.248731   566 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.251969   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.252048   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.254441   758 ts_tablet_manager.cc:1434] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.004s
I20260709 12:59:18.255931   758 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.249380   790 leader_election.cc:290] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.255116   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.254205   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
W20260709 12:59:18.256740   681 leader_election.cc:343] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:18.260255   680 leader_election.cc:343] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.251704   762 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.261279   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.263293   713 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 0.
I20260709 12:59:18.268244   792 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.267179   762 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.270139   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.270887   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.272954   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.273711   680 leader_election.cc:304] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669; no voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a
W20260709 12:59:18.274240   681 leader_election.cc:343] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:18.275642   606 leader_election.cc:343] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.275665   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
W20260709 12:59:18.277036   680 leader_election.cc:343] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.275262   762 raft_consensus.cc:2749] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.279403   680 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669; no voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.285945   566 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 1.
I20260709 12:59:18.287350   606 leader_election.cc:304] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.288628   792 raft_consensus.cc:2804] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.288237   762 raft_consensus.cc:2749] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.289212   792 raft_consensus.cc:697] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
W20260709 12:59:18.288568   605 leader_election.cc:343] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.287520   780 raft_consensus.cc:515] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.293368   794 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:18.294405   605 leader_election.cc:343] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.298635   605 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.299407   765 raft_consensus.cc:2749] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:18.300282   605 leader_election.cc:343] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.300971   758 tablet_bootstrap.cc:654] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.291363   792 consensus_queue.cc:237] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.297827   766 raft_consensus.cc:515] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.292985   461 catalog_manager.cc:5697] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:18.305233   759 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:18.308655   766 leader_election.cc:290] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.308948   760 tablet_bootstrap.cc:654] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.303568   791 raft_consensus.cc:515] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.309456   780 leader_election.cc:290] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.297610   794 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.312124   641 raft_consensus.cc:2393] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9bb865b04214284a0b277589c4bcb7a in current term 1: Already voted for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in this term.
I20260709 12:59:18.312099   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.312731   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.312968   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.310935   759 ts_tablet_manager.cc:1403] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.007s
W20260709 12:59:18.314276   530 leader_election.cc:343] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.312359   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.315852   713 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.316125   791 leader_election.cc:290] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.318121   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.319772   640 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.317878   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
W20260709 12:59:18.323432   605 leader_election.cc:343] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.323613   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.323894   605 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.328178   566 raft_consensus.cc:2393] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 342c0c2d7506497e9aa7708c20e1e2c8 in current term 1: Already voted for candidate c9bb865b04214284a0b277589c4bcb7a in this term.
I20260709 12:59:18.327796   792 raft_consensus.cc:2749] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.329576   606 leader_election.cc:304] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.337044   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.337689   792 raft_consensus.cc:2749] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.338433   794 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.344941   640 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.347225   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.352802   641 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.353247   758 tablet_bootstrap.cc:492] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
W20260709 12:59:18.353412   530 leader_election.cc:343] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.353750   758 ts_tablet_manager.cc:1403] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.008s
I20260709 12:59:18.349598   713 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.348738   463 catalog_manager.cc:5697] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.354024   532 leader_election.cc:304] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:18.355063   794 raft_consensus.cc:2804] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.355548   794 raft_consensus.cc:697] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:18.355888   532 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:18.356323   794 consensus_queue.cc:237] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.356978   766 raft_consensus.cc:2804] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.357328   766 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.357659   766 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.357872   758 raft_consensus.cc:359] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.358668   758 raft_consensus.cc:385] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.359015   760 tablet_bootstrap.cc:492] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:18.358978   758 raft_consensus.cc:740] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.358973   530 leader_election.cc:304] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:18.359709   760 ts_tablet_manager.cc:1403] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.015s
I20260709 12:59:18.360109   780 raft_consensus.cc:2804] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.360103   758 consensus_queue.cc:260] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.364336   760 raft_consensus.cc:359] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.365482   760 raft_consensus.cc:385] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.365917   760 raft_consensus.cc:740] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.337076   759 raft_consensus.cc:359] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.366969   759 raft_consensus.cc:385] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.367018   760 consensus_queue.cc:260] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.369872   758 ts_tablet_manager.cc:1434] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:59:18.370008   759 raft_consensus.cc:740] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.371045   758 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.371743   760 ts_tablet_manager.cc:1434] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:59:18.371395   759 consensus_queue.cc:260] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.372758   760 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:18.369068   766 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.375561   766 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.376366   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.376502   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
W20260709 12:59:18.378976   530 leader_election.cc:343] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.379146   762 raft_consensus.cc:493] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.377724   641 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.379644   762 raft_consensus.cc:515] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.381937   758 tablet_bootstrap.cc:654] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.383167   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.383383   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.384059   640 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 0.
I20260709 12:59:18.383252   762 leader_election.cc:290] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.385761   681 leader_election.cc:304] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:18.386749   762 raft_consensus.cc:2804] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.387811   762 raft_consensus.cc:493] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.388235   762 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:18.387204   680 leader_election.cc:343] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.393692   760 tablet_bootstrap.cc:654] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.395452   780 raft_consensus.cc:697] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:18.397225   780 consensus_queue.cc:237] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.400485   759 ts_tablet_manager.cc:1434] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.003s
I20260709 12:59:18.400609   641 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.404870   759 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:18.417831   532 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:18.420506   794 raft_consensus.cc:2804] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.425679   794 raft_consensus.cc:697] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:18.427639   794 consensus_queue.cc:237] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.432974   758 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.433548   758 ts_tablet_manager.cc:1403] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.063s	user 0.009s	sys 0.016s
I20260709 12:59:18.434667   762 raft_consensus.cc:515] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.436746   762 leader_election.cc:290] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.437500   758 raft_consensus.cc:359] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.438334   758 raft_consensus.cc:385] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.438130   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.438827   758 raft_consensus.cc:740] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.439356   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:18.439795   641 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:18.441427   680 leader_election.cc:343] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.446398   758 consensus_queue.cc:260] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.449761   758 ts_tablet_manager.cc:1434] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:59:18.448606   460 catalog_manager.cc:5697] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.455186   760 tablet_bootstrap.cc:492] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:18.455314   758 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.455679   760 ts_tablet_manager.cc:1403] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.002s
I20260709 12:59:18.487758   641 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 1.
I20260709 12:59:18.489678   681 leader_election.cc:304] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.528887   762 raft_consensus.cc:2804] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.529471   762 raft_consensus.cc:697] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:18.530319   762 consensus_queue.cc:237] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.532655   758 tablet_bootstrap.cc:654] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:18.536427   681 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:38723, user_credentials={real_user=slave}} blocked reactor thread for 46848.8us
I20260709 12:59:18.540613   759 tablet_bootstrap.cc:654] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.488989   760 raft_consensus.cc:359] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.547950   760 raft_consensus.cc:385] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.549067   760 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.550859   760 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.551512   758 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.552021   758 ts_tablet_manager.cc:1403] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.008s
I20260709 12:59:18.557139   760 ts_tablet_manager.cc:1434] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.101s	user 0.016s	sys 0.004s
I20260709 12:59:18.558481   760 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:18.558524   759 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:18.559299   759 ts_tablet_manager.cc:1403] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.046s
I20260709 12:59:18.559561   758 raft_consensus.cc:359] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.560545   758 raft_consensus.cc:385] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.560930   758 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.561898   758 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.562577   759 raft_consensus.cc:359] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.563318   759 raft_consensus.cc:385] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.564461   758 ts_tablet_manager.cc:1434] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:59:18.563598   759 raft_consensus.cc:740] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.566849   758 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.566550   759 consensus_queue.cc:260] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
W20260709 12:59:18.567239   511 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:18.588578   759 ts_tablet_manager.cc:1434] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:59:18.589821   759 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: Bootstrap starting.
I20260709 12:59:18.597587   760 tablet_bootstrap.cc:654] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.602770   759 tablet_bootstrap.cc:654] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.605816   758 tablet_bootstrap.cc:654] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.608793   461 catalog_manager.cc:5697] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.611568   461 catalog_manager.cc:5697] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.626322   762 raft_consensus.cc:493] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.626902   762 raft_consensus.cc:515] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.628957   762 leader_election.cc:290] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.630089   794 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.630662   794 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.631819   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.632630   641 raft_consensus.cc:2393] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in current term 1: Already voted for candidate c9bb865b04214284a0b277589c4bcb7a in this term.
I20260709 12:59:18.632869   794 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.630888   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.634500   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.635246   794 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.635262   641 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.635957   680 leader_election.cc:304] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669; no voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.634500   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.636660   759 tablet_bootstrap.cc:492] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: No bootstrap required, opened a new log
I20260709 12:59:18.637224   759 ts_tablet_manager.cc:1403] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.012s
I20260709 12:59:18.635926   794 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.637612   762 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.640720   758 tablet_bootstrap.cc:492] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.641635   758 ts_tablet_manager.cc:1403] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.012s
I20260709 12:59:18.644403   760 tablet_bootstrap.cc:492] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:18.645004   760 ts_tablet_manager.cc:1403] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.019s
I20260709 12:59:18.637598   532 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.638962   460 catalog_manager.cc:5697] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:18.646749   530 leader_election.cc:343] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.647095   780 raft_consensus.cc:2804] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.647473   780 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.647818   780 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.648020   758 raft_consensus.cc:359] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.648751   758 raft_consensus.cc:385] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.649410   758 raft_consensus.cc:740] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.651209   760 raft_consensus.cc:359] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.651906   760 raft_consensus.cc:385] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.652170   760 raft_consensus.cc:740] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.652863   760 consensus_queue.cc:260] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.644413   759 raft_consensus.cc:359] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.654881   759 raft_consensus.cc:385] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.655161   759 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.655771   759 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.657732   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.658322   640 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.658087   790 consensus_queue.cc:1048] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:18.659260   760 ts_tablet_manager.cc:1434] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:59:18.659634   532 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.660163   760 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: Bootstrap starting.
I20260709 12:59:18.660530   801 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:18.660923   801 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.661252   801 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.664889   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.665583   713 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 0.
I20260709 12:59:18.666941   794 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.666875   758 consensus_queue.cc:260] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.668473   780 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.669026   758 ts_tablet_manager.cc:1434] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:59:18.669855   758 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: Bootstrap starting.
I20260709 12:59:18.673002   801 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.658170   759 ts_tablet_manager.cc:1434] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.000s
I20260709 12:59:18.677012   758 tablet_bootstrap.cc:654] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.684204   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.684813   713 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.684732   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.685385   641 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.687503   760 tablet_bootstrap.cc:654] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:18.690725   801 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.692600   713 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.692919   641 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.693254   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:18.693848   530 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.694092   639 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.694718   801 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.695214   801 raft_consensus.cc:697] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:18.696018   801 consensus_queue.cc:237] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.705415   639 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 1.
I20260709 12:59:18.714843   780 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.714097   762 raft_consensus.cc:2749] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.717777   532 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:18.718431   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:18.718714   780 raft_consensus.cc:2804] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:18.719352   780 raft_consensus.cc:697] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
W20260709 12:59:18.719935   530 leader_election.cc:343] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:18.720184   780 consensus_queue.cc:237] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.722139   758 tablet_bootstrap.cc:492] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: No bootstrap required, opened a new log
I20260709 12:59:18.722592   758 ts_tablet_manager.cc:1403] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.022s
I20260709 12:59:18.736558   461 catalog_manager.cc:5697] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.737341   758 raft_consensus.cc:359] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.737988   758 raft_consensus.cc:385] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.738278   758 raft_consensus.cc:740] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.739284   758 consensus_queue.cc:260] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.741636   758 ts_tablet_manager.cc:1434] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:59:18.744412   760 tablet_bootstrap.cc:492] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: No bootstrap required, opened a new log
I20260709 12:59:18.744910   760 ts_tablet_manager.cc:1403] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.004s
I20260709 12:59:18.748063   760 raft_consensus.cc:359] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.748796   760 raft_consensus.cc:385] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:18.749048   760 raft_consensus.cc:740] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Initialized, Role: FOLLOWER
I20260709 12:59:18.749583   760 consensus_queue.cc:260] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.751582   760 ts_tablet_manager.cc:1434] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:18.760063   463 catalog_manager.cc:5697] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:18.763964   566 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.772233   801 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:18.772814   762 consensus_queue.cc:1048] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:18.789933   762 raft_consensus.cc:493] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.790499   762 raft_consensus.cc:515] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.795264   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.796200   565 raft_consensus.cc:2393] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in current term 1: Already voted for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in this term.
I20260709 12:59:18.797925   713 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.798542   762 leader_election.cc:290] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.799817   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.802361   681 leader_election.cc:304] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669; no voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.809836   792 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:18.810318   762 raft_consensus.cc:2749] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:18.835538   780 consensus_queue.cc:1048] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:18.837409   780 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:18.868595   766 consensus_queue.cc:1048] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:18.871452   792 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:18.950426   712 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.960640   766 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:18.971807   762 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.972324   762 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.976051   762 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:18.976485   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.977283   639 raft_consensus.cc:2393] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in current term 1: Already voted for candidate c9bb865b04214284a0b277589c4bcb7a in this term.
I20260709 12:59:18.978189   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:18.978585   780 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:18.979866   680 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669; no voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:18.980424   780 raft_consensus.cc:493] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.981329   780 raft_consensus.cc:515] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:18.984292   762 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.984923   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:18.984181   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" is_pre_election: true
I20260709 12:59:18.986208   640 raft_consensus.cc:2393] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9bb865b04214284a0b277589c4bcb7a in current term 1: Already voted for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in this term.
I20260709 12:59:18.986284   780 leader_election.cc:290] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:18.987314   532 leader_election.cc:304] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9bb865b04214284a0b277589c4bcb7a; no voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:18.990787   780 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:18.997718   780 raft_consensus.cc:2749] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:19.000391   762 raft_consensus.cc:2749] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:19.015573   791 raft_consensus.cc:493] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.016095   791 raft_consensus.cc:515] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.017861   791 leader_election.cc:290] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.018893   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a" is_pre_election: true
I20260709 12:59:19.019461   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" is_pre_election: true
I20260709 12:59:19.019563   566 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 0.
I20260709 12:59:19.020030   712 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 0.
I20260709 12:59:19.020812   606 leader_election.cc:304] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.021605   791 raft_consensus.cc:2804] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:19.021911   791 raft_consensus.cc:493] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.022178   791 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:19.027158   791 raft_consensus.cc:515] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.028765   791 leader_election.cc:290] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.029712   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.029927   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.030239   566 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:19.030567   712 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:19.035435   566 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 1.
I20260709 12:59:19.036659   606 leader_election.cc:304] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.037518   791 raft_consensus.cc:2804] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:19.037582   712 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 1.
I20260709 12:59:19.038095   791 raft_consensus.cc:697] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.038997   791 consensus_queue.cc:237] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.048132   463 catalog_manager.cc:5697] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.083760   762 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.094426   821 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:19.100461   766 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.119168   794 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.295045   794 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.295960   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68081489f4dc49398f42dfb91824089a"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:56492
I20260709 12:59:19.296659   639 raft_consensus.cc:606] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Received request to transfer leadership to TS c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:19.311203   794 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.327136   832 raft_consensus.cc:993] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:19.327651   832 raft_consensus.cc:1081] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Signalling peer c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:19.329834   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68081489f4dc49398f42dfb91824089a"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:34896
I20260709 12:59:19.330478   566 raft_consensus.cc:493] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.330899   566 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.337373   715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34462
I20260709 12:59:19.338001   715 raft_consensus.cc:606] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:19.338824   566 raft_consensus.cc:515] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.351362   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:19.351672   566 leader_election.cc:290] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 2 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.352015   640 raft_consensus.cc:3055] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.352418   640 raft_consensus.cc:740] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.353509   640 consensus_queue.cc:260] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.357538   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.358372   640 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.359246   712 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.365859   712 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 2.
I20260709 12:59:19.365859   640 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 2.
I20260709 12:59:19.367308   530 leader_election.cc:304] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.368471   794 raft_consensus.cc:2804] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.368945   794 raft_consensus.cc:697] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:19.369776   794 consensus_queue.cc:237] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.376367   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34912
I20260709 12:59:19.376899   566 raft_consensus.cc:606] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:19.377976   463 catalog_manager.cc:5697] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 1 to 2, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.383313   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34912
I20260709 12:59:19.385371   566 raft_consensus.cc:606] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:19.390797   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34462
I20260709 12:59:19.391882   712 raft_consensus.cc:606] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:19.398222   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:56492
I20260709 12:59:19.398873   640 raft_consensus.cc:606] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Received request to transfer leadership to TS 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:19.477025   762 raft_consensus.cc:993] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.477489   821 raft_consensus.cc:1081] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.479840   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56476
I20260709 12:59:19.481101   640 raft_consensus.cc:493] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.481482   640 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.486339   640 raft_consensus.cc:515] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.488047   640 leader_election.cc:290] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.489144   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.489078   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.489861   566 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.489848   712 raft_consensus.cc:3055] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.490414   712 raft_consensus.cc:740] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:19.491258   712 consensus_queue.cc:260] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.492477   712 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.497205   566 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.498446   606 leader_election.cc:304] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.499296   791 raft_consensus.cc:2804] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.499485   712 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.499801   791 raft_consensus.cc:697] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.500689   791 consensus_queue.cc:237] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.508298   463 catalog_manager.cc:5697] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.573096   791 consensus_queue.cc:1048] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.588982   792 consensus_queue.cc:1048] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:19.597985   832 raft_consensus.cc:993] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:19.598474   832 raft_consensus.cc:1081] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Signalling peer 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:19.600203   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:34452
I20260709 12:59:19.600826   712 raft_consensus.cc:493] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.601219   712 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.605813   712 raft_consensus.cc:515] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.608150   712 leader_election.cc:290] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:19.608951   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.609532   566 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.611012   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac0ed91bebd44faa0b1a3cdf3124216" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:19.611790   640 raft_consensus.cc:3055] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.612191   640 raft_consensus.cc:740] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.613051   640 consensus_queue.cc:260] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.617187   566 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 2.
I20260709 12:59:19.618419   640 raft_consensus.cc:3060] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.618496   680 leader_election.cc:304] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.619421   821 raft_consensus.cc:2804] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.619951   821 raft_consensus.cc:697] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:19.621259   821 consensus_queue.cc:237] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.628568   640 raft_consensus.cc:2468] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 2.
I20260709 12:59:19.631428   463 catalog_manager.cc:5697] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 1 to 2, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.687037   762 raft_consensus.cc:993] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.687498   821 raft_consensus.cc:1081] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.689366   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56476
I20260709 12:59:19.689849   640 raft_consensus.cc:493] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.690151   640 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.694964   640 raft_consensus.cc:515] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.696736   640 leader_election.cc:290] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.697592   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.698140   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dc78523b71949379e4159ca5c30d73c" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.698354   566 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.698858   712 raft_consensus.cc:3055] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.699201   712 raft_consensus.cc:740] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:19.700070   712 consensus_queue.cc:260] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.701303   712 raft_consensus.cc:3060] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.706012   566 raft_consensus.cc:2468] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.707301   606 leader_election.cc:304] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:19.708069   712 raft_consensus.cc:2468] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.708204   792 raft_consensus.cc:2804] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.708676   792 raft_consensus.cc:697] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.709583   792 consensus_queue.cc:237] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.711885   801 raft_consensus.cc:993] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.712481   794 raft_consensus.cc:1081] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.715278   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56480
I20260709 12:59:19.715983   640 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.716358   640 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.718786   463 catalog_manager.cc:5697] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.722046   640 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.724280   640 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.725152   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.725752   566 raft_consensus.cc:3055] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.726073   566 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:19.726483   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.727124   712 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.726915   566 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.728245   566 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.733639   712 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.734759   605 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:19.735460   792 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.735905   792 raft_consensus.cc:697] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.735776   566 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.736635   792 consensus_queue.cc:237] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.746732   463 catalog_manager.cc:5697] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.770501   801 raft_consensus.cc:993] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.771014   794 raft_consensus.cc:1081] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:19.772482   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56480
I20260709 12:59:19.773015   640 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.773308   640 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.777946   640 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.780058   640 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:19.780978   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:19.781617   566 raft_consensus.cc:3055] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.781950   566 raft_consensus.cc:740] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:19.781087   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:19.782546   712 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.782780   566 consensus_queue.cc:260] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.784037   566 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.789630   712 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.790560   566 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:19.791074   605 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:19.791944   792 raft_consensus.cc:2804] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.792412   792 raft_consensus.cc:697] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:19.793219   792 consensus_queue.cc:237] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:19.801606   463 catalog_manager.cc:5697] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:19.817410   712 raft_consensus.cc:1275] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.818795   801 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.826996   640 raft_consensus.cc:1275] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.828338   794 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.900921   712 raft_consensus.cc:1275] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.902549   792 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.909983   566 raft_consensus.cc:1275] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.911615   791 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.009876   640 raft_consensus.cc:1275] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.011154   821 consensus_queue.cc:1048] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.018859   566 raft_consensus.cc:1275] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.021250   821 consensus_queue.cc:1048] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.088577   566 raft_consensus.cc:1275] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.089809   791 consensus_queue.cc:1048] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.098506   712 raft_consensus.cc:1275] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.100356   792 consensus_queue.cc:1048] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.325106   712 raft_consensus.cc:1275] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.326339   792 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.333729   566 raft_consensus.cc:1275] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.335985   832 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.348361   712 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.349558   832 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:20.365022   566 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:20.370143   832 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:59:21.269966   662 debug-util.cc:398] Leaking SignalData structure 0x7b080012d080 after lost signal to thread 434
W20260709 12:59:21.270790   662 debug-util.cc:398] Leaking SignalData structure 0x7b080012d760 after lost signal to thread 497
W20260709 12:59:21.271543   662 debug-util.cc:398] Leaking SignalData structure 0x7b08001dfc80 after lost signal to thread 590
W20260709 12:59:21.272192   662 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4740 after lost signal to thread 665
W20260709 12:59:21.272863   662 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa160 after lost signal to thread 739
I20260709 12:59:22.543464   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:59:22.544430   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:22.596010   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:41888
I20260709 12:59:22.596650   566 raft_consensus.cc:606] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Received request to transfer leadership to TS 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:22.613020   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:22.613719   640 raft_consensus.cc:606] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Received request to transfer leadership to TS 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:22.619979   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:22.620630   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:22.794962   855 raft_consensus.cc:993] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:22.795446   864 raft_consensus.cc:1081] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Signalling peer 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:22.797410   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:34452
I20260709 12:59:22.798005   712 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.798364   712 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.805244   712 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:22.807260   712 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 3 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:22.808219   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:22.808395   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:22.808838   566 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.808854   640 raft_consensus.cc:3055] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:22.809288   640 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:22.810060   640 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:22.811213   640 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.816357   566 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 3.
I20260709 12:59:22.817971   680 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:22.818120   640 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 3.
I20260709 12:59:22.818815   859 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:22.820102   859 raft_consensus.cc:697] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:22.821027   859 consensus_queue.cc:237] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:22.830039   461 catalog_manager.cc:5697] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 2 to 3, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.176182   871 raft_consensus.cc:993] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:23.176693   860 raft_consensus.cc:1081] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Signalling peer 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:23.178536   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:34444
I20260709 12:59:23.179136   712 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.179488   712 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.184006   712 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.185530   712 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:23.186931   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:23.186887   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.187688   640 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.187857   566 raft_consensus.cc:3055] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.188227   566 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:23.188967   566 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.190182   566 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.192541   640 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 2.
I20260709 12:59:23.193729   681 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:23.194500   859 raft_consensus.cc:2804] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.195024   859 raft_consensus.cc:697] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:23.195902   859 consensus_queue.cc:237] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.197044   566 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 2.
I20260709 12:59:23.210080   461 catalog_manager.cc:5697] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 1 to 2, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.238551   640 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.241930   859 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.253479   566 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:23.255329   859 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.621541   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:23.631366   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34912
I20260709 12:59:23.631806   566 raft_consensus.cc:606] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:23.636739   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34462
I20260709 12:59:23.637331   712 raft_consensus.cc:606] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:23.642081   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68081489f4dc49398f42dfb91824089a"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34912
I20260709 12:59:23.642557   566 raft_consensus.cc:606] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:23.647245   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34912
I20260709 12:59:23.647684   566 raft_consensus.cc:606] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:23.651763   871 raft_consensus.cc:993] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.652197   871 raft_consensus.cc:1081] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.653542   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56480
I20260709 12:59:23.654001   640 raft_consensus.cc:493] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.654368   640 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.657574   712 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
mode: GRACEFUL
new_leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:34462
I20260709 12:59:23.658118   712 raft_consensus.cc:606] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Received request to transfer leadership to TS 342c0c2d7506497e9aa7708c20e1e2c8
I20260709 12:59:23.659523   640 raft_consensus.cc:515] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.661024   640 leader_election.cc:290] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:23.661795   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.661983   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04c631f24ba1446c9450be51a1054f8d" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:23.662397   566 raft_consensus.cc:3055] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.662503   712 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.662833   566 raft_consensus.cc:740] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:23.663580   566 consensus_queue.cc:260] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.664538   566 raft_consensus.cc:3060] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.666918   712 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:23.667865   605 leader_election.cc:304] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:23.668571   864 raft_consensus.cc:2804] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.668941   566 raft_consensus.cc:2468] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:23.669499   864 raft_consensus.cc:697] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:23.670707   864 consensus_queue.cc:237] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.676858   463 catalog_manager.cc:5697] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.733928   566 raft_consensus.cc:1275] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.735131   875 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.747252   640 raft_consensus.cc:1275] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:23.748930   865 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.755329   875 raft_consensus.cc:993] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.755765   865 raft_consensus.cc:1081] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.757177   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56476
I20260709 12:59:23.757634   640 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.758008   640 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.761912   640 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.763402   640 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 3 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:23.764267   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.764421   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:23.764889   566 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.765017   712 raft_consensus.cc:3055] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.765369   712 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:23.766054   712 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.767171   712 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.769956   566 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 3.
I20260709 12:59:23.770888   606 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:23.771450   712 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 3.
I20260709 12:59:23.771543   864 raft_consensus.cc:2804] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.772051   864 raft_consensus.cc:697] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:23.772848   864 consensus_queue.cc:237] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.778264   461 catalog_manager.cc:5697] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 2 to 3, leader changed from 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.806974   875 raft_consensus.cc:993] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.807439   875 raft_consensus.cc:1081] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.808732   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56476
I20260709 12:59:23.809149   640 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.809404   640 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.813185   640 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.814564   640 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 4 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:23.815419   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.816005   566 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.816203   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:23.816813   712 raft_consensus.cc:3055] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:23.817055   712 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:23.817688   712 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.818451   712 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.820173   566 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 4.
I20260709 12:59:23.821139   606 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 342c0c2d7506497e9aa7708c20e1e2c8, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:23.821818   864 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.822192   864 raft_consensus.cc:697] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:23.822789   712 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 4.
I20260709 12:59:23.822919   864 consensus_queue.cc:237] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.828406   461 catalog_manager.cc:5697] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 3 to 4, leader changed from 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.939057   860 raft_consensus.cc:993] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.939698   871 raft_consensus.cc:1081] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.941114   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68081489f4dc49398f42dfb91824089a"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56480
I20260709 12:59:23.941506   640 raft_consensus.cc:493] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.941733   640 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.945575   640 raft_consensus.cc:515] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.947101   640 leader_election.cc:290] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 3 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:23.947944   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.948027   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68081489f4dc49398f42dfb91824089a" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:23.948590   712 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.948565   566 raft_consensus.cc:3055] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.949095   566 raft_consensus.cc:740] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:23.949786   566 consensus_queue.cc:260] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.950834   566 raft_consensus.cc:3060] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.954538   860 raft_consensus.cc:993] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: : Instructing follower 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.954573   712 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 3.
I20260709 12:59:23.955327   860 raft_consensus.cc:1081] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Signalling peer 342c0c2d7506497e9aa7708c20e1e2c8 to start an election
I20260709 12:59:23.955827   605 leader_election.cc:304] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:23.956516   566 raft_consensus.cc:2468] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 3.
I20260709 12:59:23.956683   864 raft_consensus.cc:2804] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.957196   864 raft_consensus.cc:697] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:23.957221   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
 from {username='slave'} at 127.0.0.1:56480
I20260709 12:59:23.957831   640 raft_consensus.cc:493] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.958194   640 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.958146   864 consensus_queue.cc:237] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.964381   640 raft_consensus.cc:515] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.966291   640 leader_election.cc:290] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:23.966935   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:23.967571   566 raft_consensus.cc:3055] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:23.967880   566 raft_consensus.cc:740] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:23.966877   461 catalog_manager.cc:5697] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 2 to 3, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.967973   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:23.968488   712 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.968690   566 consensus_queue.cc:260] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.969762   566 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:23.974480   712 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:23.975625   566 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 342c0c2d7506497e9aa7708c20e1e2c8 in term 2.
I20260709 12:59:23.975577   605 leader_election.cc:304] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, 342c0c2d7506497e9aa7708c20e1e2c8; no voters: 
I20260709 12:59:23.976573   864 raft_consensus.cc:2804] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:23.976984   864 raft_consensus.cc:697] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Leader. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:23.977726   864 consensus_queue.cc:237] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:23.984373   461 catalog_manager.cc:5697] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 reported cstate change: term changed from 1 to 2, leader changed from c9bb865b04214284a0b277589c4bcb7a (127.0.107.193) to 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.138501   566 raft_consensus.cc:1275] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.139819   864 consensus_queue.cc:1048] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.148691   712 raft_consensus.cc:1275] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.150067   879 consensus_queue.cc:1048] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.266996   715 raft_consensus.cc:1275] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.268229   879 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.275693   566 raft_consensus.cc:1275] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.277081   879 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.287465   715 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:24.288726   879 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.297216   566 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:24.298743   864 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:24.392580   715 raft_consensus.cc:1275] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.393886   864 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.403944   566 raft_consensus.cc:1275] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:24.405309   879 consensus_queue.cc:1048] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:24.415459   566 raft_consensus.cc:1275] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.416785   887 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:24.425222   715 raft_consensus.cc:1275] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Refusing update from remote peer 342c0c2d7506497e9aa7708c20e1e2c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:24.426445   864 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:26.666154   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:26.677115   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:26.678115   640 raft_consensus.cc:606] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Received request to transfer leadership to TS 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:26.680886   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:26.681326   640 raft_consensus.cc:606] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Received request to transfer leadership to TS c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:26.683501   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:26.683959   640 raft_consensus.cc:606] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Received request to transfer leadership to TS 0401c3ec889e4c7ba6b4a0e3f358c669
I20260709 12:59:26.686162   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:26.686561   640 raft_consensus.cc:606] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 LEADER]: Received request to transfer leadership to TS c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:26.688946   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65"
dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
mode: GRACEFUL
new_leader_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:57892
I20260709 12:59:26.689491   640 raft_consensus.cc:606] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Received request to transfer leadership to TS c9bb865b04214284a0b277589c4bcb7a
I20260709 12:59:26.690577   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:26.691175   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:26.732039   897 raft_consensus.cc:993] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:26.732564   864 raft_consensus.cc:1081] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Signalling peer c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:26.734097   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:34896
I20260709 12:59:26.734560   565 raft_consensus.cc:493] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.734946   565 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.739981   565 raft_consensus.cc:515] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.742908   565 leader_election.cc:290] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 3 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:26.744757   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:26.744900   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cb271e9f2134292a261a1c06ee3d72d" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:26.746408   640 raft_consensus.cc:3055] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.746440   712 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.747118   640 raft_consensus.cc:740] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:26.748442   640 consensus_queue.cc:260] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.750414   640 raft_consensus.cc:3060] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.756640   712 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 3.
I20260709 12:59:26.759469   530 leader_election.cc:304] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:26.760515   640 raft_consensus.cc:2468] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 3.
I20260709 12:59:26.762401   898 raft_consensus.cc:2804] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.764421   898 raft_consensus.cc:697] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 3 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:26.766239   898 consensus_queue.cc:237] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.778681   463 catalog_manager.cc:5697] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 2 to 3, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.815752   897 raft_consensus.cc:993] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:26.816228   864 raft_consensus.cc:1081] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Signalling peer 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:26.817718   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:34452
I20260709 12:59:26.818161   712 raft_consensus.cc:493] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.818445   712 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.822420   712 raft_consensus.cc:515] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.824045   712 leader_election.cc:290] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 3 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:26.825071   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:26.825197   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cc628ecd94fb1a961a25b584fa377" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:26.825640   565 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.825697   640 raft_consensus.cc:3055] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.826027   640 raft_consensus.cc:740] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:26.826704   640 consensus_queue.cc:260] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.827538   640 raft_consensus.cc:3060] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.830590   565 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 3.
I20260709 12:59:26.831550   640 raft_consensus.cc:2468] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 3.
I20260709 12:59:26.832046   680 leader_election.cc:304] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:26.832985   875 raft_consensus.cc:2804] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.834081   875 raft_consensus.cc:697] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:26.834949   875 consensus_queue.cc:237] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.841979   463 catalog_manager.cc:5697] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 2 to 3, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.844852   897 raft_consensus.cc:993] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:26.845362   864 raft_consensus.cc:1081] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Signalling peer c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:26.846975   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:34896
I20260709 12:59:26.847510   565 raft_consensus.cc:493] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.847880   565 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.853085   565 raft_consensus.cc:515] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.854918   565 leader_election.cc:290] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 3 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:26.855671   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:26.856014   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3c3fc9907754c2e8a7d4d324d299d65" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:26.856258   640 raft_consensus.cc:3055] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:26.856567   712 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.856570   640 raft_consensus.cc:740] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:26.857467   640 consensus_queue.cc:260] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.858425   640 raft_consensus.cc:3060] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.860954   712 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 3.
I20260709 12:59:26.862025   530 leader_election.cc:304] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:26.862288   640 raft_consensus.cc:2468] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 3.
I20260709 12:59:26.862718   898 raft_consensus.cc:2804] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:26.863224   898 raft_consensus.cc:697] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 3 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:26.863996   898 consensus_queue.cc:237] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:26.870841   463 catalog_manager.cc:5697] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 2 to 3, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.186689   897 raft_consensus.cc:993] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:27.187121   864 raft_consensus.cc:1081] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 LEADER]: Signalling peer c9bb865b04214284a0b277589c4bcb7a to start an election
I20260709 12:59:27.188536   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6"
dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
 from {username='slave'} at 127.0.0.1:34896
I20260709 12:59:27.189006   565 raft_consensus.cc:493] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.189309   565 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.193854   565 raft_consensus.cc:515] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.195677   565 leader_election.cc:290] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 5 election: Requested vote from peers 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723), 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195:37199)
I20260709 12:59:27.196727   712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
I20260709 12:59:27.196384   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62dcb1b55ac248bfb885163ef6590dc6" candidate_uuid: "c9bb865b04214284a0b277589c4bcb7a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:27.197172   712 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.197527   640 raft_consensus.cc:3055] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:27.197908   640 raft_consensus.cc:740] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:27.198793   640 consensus_queue.cc:260] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.199641   640 raft_consensus.cc:3060] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.202010   712 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 5.
I20260709 12:59:27.202946   530 leader_election.cc:304] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:27.203627   898 raft_consensus.cc:2804] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:27.204092   898 raft_consensus.cc:697] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 5 LEADER]: Becoming Leader. State: Replica: c9bb865b04214284a0b277589c4bcb7a, State: Running, Role: LEADER
I20260709 12:59:27.204119   640 raft_consensus.cc:2468] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb865b04214284a0b277589c4bcb7a in term 5.
I20260709 12:59:27.205103   898 consensus_queue.cc:237] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.212141   463 catalog_manager.cc:5697] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a reported cstate change: term changed from 4 to 5, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to c9bb865b04214284a0b277589c4bcb7a (127.0.107.193). New cstate: current_term: 5 leader_uuid: "c9bb865b04214284a0b277589c4bcb7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:27.248989   897 raft_consensus.cc:993] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: : Instructing follower 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:27.249426   897 raft_consensus.cc:1081] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Signalling peer 0401c3ec889e4c7ba6b4a0e3f358c669 to start an election
I20260709 12:59:27.250871   712 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4"
dest_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669"
 from {username='slave'} at 127.0.0.1:34452
I20260709 12:59:27.251272   712 raft_consensus.cc:493] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:27.251500   712 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.255412   715 raft_consensus.cc:1275] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.256022   712 raft_consensus.cc:515] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.256711   898 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.257642   712 leader_election.cc:290] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 4 election: Requested vote from peers c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049), 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194:38723)
I20260709 12:59:27.258582   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c9bb865b04214284a0b277589c4bcb7a"
I20260709 12:59:27.258627   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b558dcc9a148fa89cc77079b594ce4" candidate_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "342c0c2d7506497e9aa7708c20e1e2c8"
I20260709 12:59:27.259277   565 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.259338   640 raft_consensus.cc:3055] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:27.259785   640 raft_consensus.cc:740] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 342c0c2d7506497e9aa7708c20e1e2c8, State: Running, Role: LEADER
I20260709 12:59:27.260450   640 consensus_queue.cc:260] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.261549   640 raft_consensus.cc:3060] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.266367   565 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 4.
I20260709 12:59:27.267510   680 leader_election.cc:304] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0401c3ec889e4c7ba6b4a0e3f358c669, c9bb865b04214284a0b277589c4bcb7a; no voters: 
I20260709 12:59:27.268389   875 raft_consensus.cc:2804] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:27.268468   640 raft_consensus.cc:2468] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0401c3ec889e4c7ba6b4a0e3f358c669 in term 4.
I20260709 12:59:27.268956   875 raft_consensus.cc:697] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 LEADER]: Becoming Leader. State: Replica: 0401c3ec889e4c7ba6b4a0e3f358c669, State: Running, Role: LEADER
I20260709 12:59:27.269843   875 consensus_queue.cc:237] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } }
I20260709 12:59:27.270533   639 raft_consensus.cc:1275] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.274219   898 consensus_queue.cc:1048] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.277854   463 catalog_manager.cc:5697] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 reported cstate change: term changed from 3 to 4, leader changed from 342c0c2d7506497e9aa7708c20e1e2c8 (127.0.107.194) to 0401c3ec889e4c7ba6b4a0e3f358c669 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:27.317674   565 raft_consensus.cc:1275] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.318827   875 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb865b04214284a0b277589c4bcb7a" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.323006   640 raft_consensus.cc:1275] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.324482   899 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:27.329903   639 raft_consensus.cc:1275] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.331765   875 consensus_queue.cc:1048] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.332039   712 raft_consensus.cc:1275] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:27.337646   898 consensus_queue.cc:1048] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.606914   640 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 5 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:27.608232   921 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.616650   712 raft_consensus.cc:1275] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 5 FOLLOWER]: Refusing update from remote peer c9bb865b04214284a0b277589c4bcb7a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:27.618067   898 consensus_queue.cc:1048] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0401c3ec889e4c7ba6b4a0e3f358c669" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.692063   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.698170   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:59:27.721740   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:27.722494   431 tablet_replica.cc:333] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.723225   431 raft_consensus.cc:2243] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.723973   431 raft_consensus.cc:2272] T 0cb271e9f2134292a261a1c06ee3d72d P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.727113   431 tablet_replica.cc:333] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.727619   431 raft_consensus.cc:2243] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.728047   431 raft_consensus.cc:2272] T 050cc628ecd94fb1a961a25b584fa377 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.730530   431 tablet_replica.cc:333] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.731132   431 raft_consensus.cc:2243] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.731551   431 raft_consensus.cc:2272] T 68081489f4dc49398f42dfb91824089a P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.733129   431 tablet_replica.cc:333] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.733600   431 raft_consensus.cc:2243] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.734002   431 raft_consensus.cc:2272] T 6dc78523b71949379e4159ca5c30d73c P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.735612   431 tablet_replica.cc:333] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.736078   431 raft_consensus.cc:2243] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.736488   431 raft_consensus.cc:2272] T 26b558dcc9a148fa89cc77079b594ce4 P c9bb865b04214284a0b277589c4bcb7a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.738016   431 tablet_replica.cc:333] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.738515   431 raft_consensus.cc:2243] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.739054   431 raft_consensus.cc:2272] T 3ac0ed91bebd44faa0b1a3cdf3124216 P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.740594   431 tablet_replica.cc:333] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.741048   431 raft_consensus.cc:2243] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.741753   431 raft_consensus.cc:2272] T 62dcb1b55ac248bfb885163ef6590dc6 P c9bb865b04214284a0b277589c4bcb7a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.743726   431 tablet_replica.cc:333] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
W20260709 12:59:27.744136   680 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:59:27.744375   431 raft_consensus.cc:2243] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.745363   431 raft_consensus.cc:2272] T b3c3fc9907754c2e8a7d4d324d299d65 P c9bb865b04214284a0b277589c4bcb7a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.747509   680 consensus_peers.cc:597] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 -> Peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Couldn't send request to peer c9bb865b04214284a0b277589c4bcb7a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.747718   431 tablet_replica.cc:333] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a: stopping tablet replica
I20260709 12:59:27.748205   431 raft_consensus.cc:2243] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.748637   431 raft_consensus.cc:2272] T 04c631f24ba1446c9450be51a1054f8d P c9bb865b04214284a0b277589c4bcb7a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:59:27.761960   530 connection.cc:466] server connection from 127.0.0.1:34896 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34896 (request call id 122) could send its response
I20260709 12:59:27.787081   640 raft_consensus.cc:1275] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Refusing update from remote peer 0401c3ec889e4c7ba6b4a0e3f358c669: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:27.788486   916 consensus_queue.cc:1048] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "342c0c2d7506497e9aa7708c20e1e2c8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:59:27.930116   606 consensus_peers.cc:597] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 -> Peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Couldn't send request to peer c9bb865b04214284a0b277589c4bcb7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:27.935614   680 consensus_peers.cc:597] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 -> Peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Couldn't send request to peer c9bb865b04214284a0b277589c4bcb7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.936134   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:59:27.936502   606 consensus_peers.cc:597] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 -> Peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Couldn't send request to peer c9bb865b04214284a0b277589c4bcb7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.965201   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:27.985744   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:27.986445   431 tablet_replica.cc:333] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:27.987188   431 raft_consensus.cc:2243] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:27.987576   431 raft_consensus.cc:2272] T 0cb271e9f2134292a261a1c06ee3d72d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.989652   431 tablet_replica.cc:333] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:27.990276   431 raft_consensus.cc:2243] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.991583   431 raft_consensus.cc:2272] T 04c631f24ba1446c9450be51a1054f8d P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.993515   431 tablet_replica.cc:333] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:27.994102   431 raft_consensus.cc:2243] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:27.995121   431 raft_consensus.cc:2272] T 68081489f4dc49398f42dfb91824089a P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:27.997365   431 tablet_replica.cc:333] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:27.997948   431 raft_consensus.cc:2243] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:27.997903   680 consensus_peers.cc:597] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 -> Peer c9bb865b04214284a0b277589c4bcb7a (127.0.107.193:40049): Couldn't send request to peer c9bb865b04214284a0b277589c4bcb7a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:27.998579   431 raft_consensus.cc:2272] T 050cc628ecd94fb1a961a25b584fa377 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.000563   431 tablet_replica.cc:333] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:28.001076   431 raft_consensus.cc:2243] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.001518   431 raft_consensus.cc:2272] T 62dcb1b55ac248bfb885163ef6590dc6 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.003620   431 tablet_replica.cc:333] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:28.004122   431 raft_consensus.cc:2243] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.004535   431 raft_consensus.cc:2272] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.006052   431 tablet_replica.cc:333] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:28.006508   431 raft_consensus.cc:2243] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.006944   431 raft_consensus.cc:2272] T b3c3fc9907754c2e8a7d4d324d299d65 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.008795   431 tablet_replica.cc:333] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:28.009256   431 raft_consensus.cc:2243] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:28.009979   431 raft_consensus.cc:2272] T 6dc78523b71949379e4159ca5c30d73c P 342c0c2d7506497e9aa7708c20e1e2c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.011621   431 tablet_replica.cc:333] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8: stopping tablet replica
I20260709 12:59:28.012055   431 raft_consensus.cc:2243] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.012480   431 raft_consensus.cc:2272] T 26b558dcc9a148fa89cc77079b594ce4 P 342c0c2d7506497e9aa7708c20e1e2c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.056464   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:59:28.072731   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:28.097662   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:28.098332   431 tablet_replica.cc:333] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.098960   431 raft_consensus.cc:2243] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:28.099689   431 raft_consensus.cc:2272] T 050cc628ecd94fb1a961a25b584fa377 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.101599   431 tablet_replica.cc:333] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.102130   431 raft_consensus.cc:2243] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.102552   431 raft_consensus.cc:2272] T 68081489f4dc49398f42dfb91824089a P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.104175   431 tablet_replica.cc:333] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.104658   431 raft_consensus.cc:2243] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:28.105350   431 raft_consensus.cc:2272] T 26b558dcc9a148fa89cc77079b594ce4 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.107151   431 tablet_replica.cc:333] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.107640   431 raft_consensus.cc:2243] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.108042   431 raft_consensus.cc:2272] T b3c3fc9907754c2e8a7d4d324d299d65 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.109922   431 tablet_replica.cc:333] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.110395   431 raft_consensus.cc:2243] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.110888   431 raft_consensus.cc:2272] T 62dcb1b55ac248bfb885163ef6590dc6 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.113126   431 tablet_replica.cc:333] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.113579   431 raft_consensus.cc:2243] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:28.114266   431 raft_consensus.cc:2272] T 3ac0ed91bebd44faa0b1a3cdf3124216 P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.115819   431 tablet_replica.cc:333] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.116272   431 raft_consensus.cc:2243] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.116652   431 raft_consensus.cc:2272] T 0cb271e9f2134292a261a1c06ee3d72d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.119082   431 tablet_replica.cc:333] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.119531   431 raft_consensus.cc:2243] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.119905   431 raft_consensus.cc:2272] T 04c631f24ba1446c9450be51a1054f8d P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.121415   431 tablet_replica.cc:333] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669: stopping tablet replica
I20260709 12:59:28.121825   431 raft_consensus.cc:2243] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:28.122191   431 raft_consensus.cc:2272] T 6dc78523b71949379e4159ca5c30d73c P 0401c3ec889e4c7ba6b4a0e3f358c669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.149391   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:28.168998   431 master.cc:562] Master@127.0.107.254:43599 shutting down...
I20260709 12:59:28.279036   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:28.279604   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:28.279963   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P a7476814734d4cfdba7f477f96889b11: stopping tablet replica
I20260709 12:59:28.299427   431 master.cc:584] Master@127.0.107.254:43599 shutdown complete.
0401c3ec889e4c7ba6b4a0e3f358c669  1
342c0c2d7506497e9aa7708c20e1e2c8  4
c9bb865b04214284a0b277589c4bcb7a  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13381 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:59:28.336534   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34529
I20260709 12:59:28.337646   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:28.343592   932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.343593   933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.344372   935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:28.345992   431 server_base.cc:1061] running on GCE node
I20260709 12:59:28.347163   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:28.347347   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:28.347458   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601968347443 us; error 0 us; skew 500 ppm
I20260709 12:59:28.347918   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:28.350507   431 webserver.cc:533] Webserver started at http://127.0.107.254:45749/ using document root <none> and password file <none>
I20260709 12:59:28.351073   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:28.351233   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:28.351449   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:28.352519   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "2a25073f3c1a476a863b1a82a0cca54d"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.356992   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:59:28.360412   940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.361269   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:59:28.361609   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "2a25073f3c1a476a863b1a82a0cca54d"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.361954   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:28.374208   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:28.375571   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:28.412596   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34529
I20260709 12:59:28.412690   991 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34529 every 8 connection(s)
I20260709 12:59:28.416411   992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.425583   992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d: Bootstrap starting.
I20260709 12:59:28.430138   992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:28.434427   992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d: No bootstrap required, opened a new log
I20260709 12:59:28.436764   992 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER }
I20260709 12:59:28.437160   992 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:28.437341   992 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a25073f3c1a476a863b1a82a0cca54d, State: Initialized, Role: FOLLOWER
I20260709 12:59:28.437955   992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER }
I20260709 12:59:28.438392   992 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:28.438580   992 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:28.438916   992 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:28.443074   992 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER }
I20260709 12:59:28.443601   992 leader_election.cc:304] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a25073f3c1a476a863b1a82a0cca54d; no voters: 
I20260709 12:59:28.444625   992 leader_election.cc:290] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:28.445029   995 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:28.446275   995 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 1 LEADER]: Becoming Leader. State: Replica: 2a25073f3c1a476a863b1a82a0cca54d, State: Running, Role: LEADER
I20260709 12:59:28.447024   995 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER }
I20260709 12:59:28.447571   992 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:28.452040   997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a25073f3c1a476a863b1a82a0cca54d. Latest consensus state: current_term: 1 leader_uuid: "2a25073f3c1a476a863b1a82a0cca54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER } }
I20260709 12:59:28.452865   997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:28.453409   996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a25073f3c1a476a863b1a82a0cca54d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a25073f3c1a476a863b1a82a0cca54d" member_type: VOTER } }
I20260709 12:59:28.454078   996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:28.455397  1003 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:28.460292  1003 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:28.462854   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:28.468631  1003 catalog_manager.cc:1383] Generated new cluster ID: b1c4358d11764e7f9d49b458729a29f2
I20260709 12:59:28.468915  1003 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:28.500264  1003 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:28.501462  1003 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:28.521255  1003 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d: Generated new TSK 0
I20260709 12:59:28.521863  1003 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:28.531337   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:28.543378  1013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.544955  1014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.546998  1016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:28.548499   431 server_base.cc:1061] running on GCE node
I20260709 12:59:28.550352   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:28.550984   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:28.551198   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601968551178 us; error 0 us; skew 500 ppm
I20260709 12:59:28.552022   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:28.557912   431 webserver.cc:533] Webserver started at http://127.0.107.193:45283/ using document root <none> and password file <none>
I20260709 12:59:28.559196   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:28.559772   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:28.560403   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:28.562487   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "2ce7853bcb174d30a6d922b58f549fab"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.570439   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:28.574331  1021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.575394   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:59:28.575740   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "2ce7853bcb174d30a6d922b58f549fab"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.576011   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:28.591269   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:28.593026   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:28.595323   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:28.598834   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:28.599139   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.599458   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:28.599684   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.639739   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36567
I20260709 12:59:28.639900  1083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36567 every 8 connection(s)
I20260709 12:59:28.644676   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:28.651885  1088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.653151  1089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.659852  1091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:28.660776   431 server_base.cc:1061] running on GCE node
I20260709 12:59:28.662271   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:28.662545   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:28.662788   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601968662765 us; error 0 us; skew 500 ppm
I20260709 12:59:28.663371  1084 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34529
I20260709 12:59:28.663491   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:28.663816  1084 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:28.664726  1084 heartbeater.cc:507] Master 127.0.107.254:34529 requested a full tablet report, sending...
I20260709 12:59:28.666333   431 webserver.cc:533] Webserver started at http://127.0.107.194:42281/ using document root <none> and password file <none>
I20260709 12:59:28.666925   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:28.667153   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:28.667135   957 ts_manager.cc:194] Registered new tserver with Master: 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567)
I20260709 12:59:28.667629   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:28.668800   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "a982d614769f4d2f9198c6725f4188ad"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.669024   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53582
I20260709 12:59:28.673489   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:59:28.676975  1096 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.677759   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:59:28.678061   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "a982d614769f4d2f9198c6725f4188ad"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.678390   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:28.689741   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:28.690999   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:28.692408   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:28.694527   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:28.694805   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.695066   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:28.695227   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.733079   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35365
I20260709 12:59:28.733177  1158 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35365 every 8 connection(s)
I20260709 12:59:28.737674   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:28.744972  1162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.746904  1163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:28.749902  1165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:28.750002   431 server_base.cc:1061] running on GCE node
I20260709 12:59:28.751348  1159 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34529
I20260709 12:59:28.751425   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:59:28.751962  1159 heartbeater.cc:461] Registering TS with master...
W20260709 12:59:28.752050   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:28.752377   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601968752357 us; error 0 us; skew 500 ppm
I20260709 12:59:28.752888  1159 heartbeater.cc:507] Master 127.0.107.254:34529 requested a full tablet report, sending...
I20260709 12:59:28.752949   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:28.755221   957 ts_manager.cc:194] Registered new tserver with Master: a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:28.755829   431 webserver.cc:533] Webserver started at http://127.0.107.195:42169/ using document root <none> and password file <none>
I20260709 12:59:28.756340   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:28.756572   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:28.756914   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:28.756938   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53584
I20260709 12:59:28.758574   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "b5ad321506d74c3384516a8a7378193d"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.763376   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:28.766784  1170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.767612   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:28.767939   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "b5ad321506d74c3384516a8a7378193d"
format_stamp: "Formatted at 2026-07-09 12:59:28 on dist-test-slave-n5kz"
I20260709 12:59:28.768256   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:28.793061   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:28.794332   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:28.795915   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:28.798190   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:28.798439   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.798732   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:28.798924   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:28.838755   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42613
I20260709 12:59:28.838928  1232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42613 every 8 connection(s)
I20260709 12:59:28.852680  1233 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34529
I20260709 12:59:28.853152  1233 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:28.853928  1233 heartbeater.cc:507] Master 127.0.107.254:34529 requested a full tablet report, sending...
I20260709 12:59:28.855918   957 ts_manager.cc:194] Registered new tserver with Master: b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:28.856518   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014462755s
I20260709 12:59:28.857372   957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53596
I20260709 12:59:28.882575   957 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53600:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:28.885422   957 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:28.952566  1124 tablet_service.cc:1511] Processing CreateTablet for tablet ead19415d37c4aa7a817b34359ad05f4 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:28.954464  1124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead19415d37c4aa7a817b34359ad05f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.955046  1122 tablet_service.cc:1511] Processing CreateTablet for tablet 3c318e0269834f3faa6fa5c7ff980822 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:28.956498  1122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c318e0269834f3faa6fa5c7ff980822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.960156  1123 tablet_service.cc:1511] Processing CreateTablet for tablet aa6fac5a9df149308d0d1a97610ba07e (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:28.961885  1121 tablet_service.cc:1511] Processing CreateTablet for tablet e9796269faff46e1bf010185f90b72fe (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:28.962718  1123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6fac5a9df149308d0d1a97610ba07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.964696  1121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9796269faff46e1bf010185f90b72fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.968364  1120 tablet_service.cc:1511] Processing CreateTablet for tablet b2f78d035ba1451faa202beecc6e4e54 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:28.969915  1120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f78d035ba1451faa202beecc6e4e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.976800  1119 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b84b5e3e43b292853bab1ad13f37 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:28.978243  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b84b5e3e43b292853bab1ad13f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:28.991927  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd64fafeb6467d866f5b3e9c2b94f3 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:28.993341  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd64fafeb6467d866f5b3e9c2b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.000422  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 86248fc4a2554239812ec2a371047998 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:29.002285  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86248fc4a2554239812ec2a371047998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.008915  1116 tablet_service.cc:1511] Processing CreateTablet for tablet c53244d413834486b2ed703dab0ebc26 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:29.011410  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53244d413834486b2ed703dab0ebc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.016358  1115 tablet_service.cc:1511] Processing CreateTablet for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:29.018254  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.028638  1247 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.035856  1247 tablet_bootstrap.cc:654] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.093694  1198 tablet_service.cc:1511] Processing CreateTablet for tablet ead19415d37c4aa7a817b34359ad05f4 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:29.095872  1197 tablet_service.cc:1511] Processing CreateTablet for tablet aa6fac5a9df149308d0d1a97610ba07e (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:29.096231  1193 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b84b5e3e43b292853bab1ad13f37 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:29.097223  1197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6fac5a9df149308d0d1a97610ba07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.099151  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd64fafeb6467d866f5b3e9c2b94f3 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:29.099676  1196 tablet_service.cc:1511] Processing CreateTablet for tablet 3c318e0269834f3faa6fa5c7ff980822 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:29.100473  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd64fafeb6467d866f5b3e9c2b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.101729  1049 tablet_service.cc:1511] Processing CreateTablet for tablet ead19415d37c4aa7a817b34359ad05f4 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:59:29.101871  1195 tablet_service.cc:1511] Processing CreateTablet for tablet e9796269faff46e1bf010185f90b72fe (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:29.103236  1195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9796269faff46e1bf010185f90b72fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.103888  1190 tablet_service.cc:1511] Processing CreateTablet for tablet c53244d413834486b2ed703dab0ebc26 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:29.104636  1048 tablet_service.cc:1511] Processing CreateTablet for tablet aa6fac5a9df149308d0d1a97610ba07e (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:59:29.105212  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53244d413834486b2ed703dab0ebc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.105463  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 11dd64fafeb6467d866f5b3e9c2b94f3 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:59:29.107470  1196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c318e0269834f3faa6fa5c7ff980822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.107107  1047 tablet_service.cc:1511] Processing CreateTablet for tablet 3c318e0269834f3faa6fa5c7ff980822 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:59:29.107816  1189 tablet_service.cc:1511] Processing CreateTablet for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:29.109042  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.108718  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 86248fc4a2554239812ec2a371047998 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:29.109629  1046 tablet_service.cc:1511] Processing CreateTablet for tablet e9796269faff46e1bf010185f90b72fe (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:59:29.107129  1194 tablet_service.cc:1511] Processing CreateTablet for tablet b2f78d035ba1451faa202beecc6e4e54 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:29.111614  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 86248fc4a2554239812ec2a371047998 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:59:29.111986  1194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f78d035ba1451faa202beecc6e4e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.112128  1041 tablet_service.cc:1511] Processing CreateTablet for tablet c53244d413834486b2ed703dab0ebc26 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:59:29.111949  1045 tablet_service.cc:1511] Processing CreateTablet for tablet b2f78d035ba1451faa202beecc6e4e54 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:59:29.103225  1049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead19415d37c4aa7a817b34359ad05f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.115249  1040 tablet_service.cc:1511] Processing CreateTablet for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:59:29.116434  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11dd64fafeb6467d866f5b3e9c2b94f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.113306  1044 tablet_service.cc:1511] Processing CreateTablet for tablet 75e7b84b5e3e43b292853bab1ad13f37 (DEFAULT_TABLE table=test-workload [id=e7075873d8cc4fa592e953270c716e4f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:59:29.112864  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86248fc4a2554239812ec2a371047998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.123615  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b84b5e3e43b292853bab1ad13f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.126986  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c52ec7e70a2344fdb7eaaab7ae0c73ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.127671  1046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9796269faff46e1bf010185f90b72fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.128254  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75e7b84b5e3e43b292853bab1ad13f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.130939  1198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead19415d37c4aa7a817b34359ad05f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.131557  1047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c318e0269834f3faa6fa5c7ff980822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.134984  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53244d413834486b2ed703dab0ebc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.144230  1045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f78d035ba1451faa202beecc6e4e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.146986  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86248fc4a2554239812ec2a371047998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.155166  1048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6fac5a9df149308d0d1a97610ba07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:29.159888  1249 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.168552  1249 tablet_bootstrap.cc:654] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.181329  1250 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.183472  1247 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.183949  1247 ts_tablet_manager.cc:1403] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.031s
I20260709 12:59:29.190215  1250 tablet_bootstrap.cc:654] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.211998  1247 raft_consensus.cc:359] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.213009  1247 raft_consensus.cc:385] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.213389  1247 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.219672  1250 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.220181  1250 ts_tablet_manager.cc:1403] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.013s
I20260709 12:59:29.223001  1250 raft_consensus.cc:359] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.223734  1250 raft_consensus.cc:385] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.224037  1250 raft_consensus.cc:740] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.224979  1250 consensus_queue.cc:260] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.237003  1250 ts_tablet_manager.cc:1434] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.009s
I20260709 12:59:29.242810  1247 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.245255  1233 heartbeater.cc:499] Master 127.0.107.254:34529 was elected leader, sending a full tablet report...
I20260709 12:59:29.252516  1250 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.257844  1250 tablet_bootstrap.cc:654] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.280794  1249 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.281267  1249 ts_tablet_manager.cc:1403] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.122s	user 0.048s	sys 0.037s
I20260709 12:59:29.282011  1159 heartbeater.cc:499] Master 127.0.107.254:34529 was elected leader, sending a full tablet report...
I20260709 12:59:29.282788  1250 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.283304  1250 ts_tablet_manager.cc:1403] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.014s
I20260709 12:59:29.284221  1249 raft_consensus.cc:359] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.283337  1247 ts_tablet_manager.cc:1434] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.099s	user 0.002s	sys 0.008s
I20260709 12:59:29.284976  1249 raft_consensus.cc:385] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.285300  1249 raft_consensus.cc:740] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.285858  1247 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.286104  1249 consensus_queue.cc:260] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.287149  1250 raft_consensus.cc:359] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.287829  1250 raft_consensus.cc:385] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.288127  1250 raft_consensus.cc:740] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.288985  1250 consensus_queue.cc:260] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.291138  1250 ts_tablet_manager.cc:1434] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:59:29.295308  1247 tablet_bootstrap.cc:654] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.295859  1250 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.299299  1084 heartbeater.cc:499] Master 127.0.107.254:34529 was elected leader, sending a full tablet report...
I20260709 12:59:29.299767  1249 ts_tablet_manager.cc:1434] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.018s	user 0.018s	sys 0.001s
I20260709 12:59:29.300707  1249 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.302937  1253 raft_consensus.cc:493] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.303413  1253 raft_consensus.cc:515] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.307399  1249 tablet_bootstrap.cc:654] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.317006  1253 leader_election.cc:290] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.327531  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
W20260709 12:59:29.329989  1174 leader_election.cc:343] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.334589  1250 tablet_bootstrap.cc:654] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.340452  1247 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.341025  1247 ts_tablet_manager.cc:1403] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.022s
I20260709 12:59:29.343307  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.345248  1253 raft_consensus.cc:493] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.344904  1247 raft_consensus.cc:359] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
W20260709 12:59:29.345266  1172 leader_election.cc:343] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.345799  1247 raft_consensus.cc:385] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.346086  1247 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.345924  1172 leader_election.cc:304] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5ad321506d74c3384516a8a7378193d; no voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.345851  1253 raft_consensus.cc:515] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.346823  1247 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.348719  1247 ts_tablet_manager.cc:1434] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:29.349722  1247 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.350153  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
W20260709 12:59:29.352099  1174 leader_election.cc:343] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.348134  1253 leader_election.cc:290] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.353120  1253 raft_consensus.cc:2749] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.354279  1249 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.354913  1249 ts_tablet_manager.cc:1403] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.010s
I20260709 12:59:29.356000  1247 tablet_bootstrap.cc:654] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.358771  1249 raft_consensus.cc:359] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.359771  1249 raft_consensus.cc:385] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.360143  1249 raft_consensus.cc:740] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.361230  1249 consensus_queue.cc:260] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.364012  1249 ts_tablet_manager.cc:1434] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:59:29.364948  1249 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.366253  1250 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.366916  1250 ts_tablet_manager.cc:1403] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.000s
I20260709 12:59:29.371176  1255 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.371860  1255 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.375896  1255 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.377388  1250 raft_consensus.cc:359] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.378561  1247 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.371507  1249 tablet_bootstrap.cc:654] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.379361  1247 ts_tablet_manager.cc:1403] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.008s
I20260709 12:59:29.380897  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.381773  1059 raft_consensus.cc:2468] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.382840  1247 raft_consensus.cc:359] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.378505  1250 raft_consensus.cc:385] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.383919  1247 raft_consensus.cc:385] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.383985  1250 raft_consensus.cc:740] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.384545  1247 raft_consensus.cc:740] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.385169  1250 consensus_queue.cc:260] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.385462  1247 consensus_queue.cc:260] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.386951  1172 leader_election.cc:304] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.388497  1261 raft_consensus.cc:2804] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.388844  1261 raft_consensus.cc:493] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.389153  1261 raft_consensus.cc:3060] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.389731  1247 ts_tablet_manager.cc:1434] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:59:29.390836  1247 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.396399  1261 raft_consensus.cc:515] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.397651  1247 tablet_bootstrap.cc:654] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.398564  1261 leader_election.cc:290] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.399746  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.408022  1250 ts_tablet_manager.cc:1434] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:59:29.399917  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:29.413820  1059 raft_consensus.cc:3060] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:29.414072  1174 leader_election.cc:343] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.410913  1249 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.415421  1249 ts_tablet_manager.cc:1403] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.005s
I20260709 12:59:29.420034  1250 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.426831  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
W20260709 12:59:29.428364  1098 leader_election.cc:343] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.429692  1059 raft_consensus.cc:2468] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.419339  1249 raft_consensus.cc:359] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.430790  1172 leader_election.cc:304] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.431090  1249 raft_consensus.cc:385] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.431084  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.431625  1249 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.432595  1250 tablet_bootstrap.cc:654] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:29.432993  1098 leader_election.cc:343] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.432677  1249 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.433434  1098 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad; no voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d
I20260709 12:59:29.434324  1255 raft_consensus.cc:2749] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.434876  1261 raft_consensus.cc:2804] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.435801  1261 raft_consensus.cc:697] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:29.437211  1261 consensus_queue.cc:237] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.438078  1249 ts_tablet_manager.cc:1434] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:59:29.438203  1247 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.438735  1247 ts_tablet_manager.cc:1403] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.024s
I20260709 12:59:29.439143  1249 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.441572  1247 raft_consensus.cc:359] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.442273  1247 raft_consensus.cc:385] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.442571  1247 raft_consensus.cc:740] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.443547  1247 consensus_queue.cc:260] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.448041  1249 tablet_bootstrap.cc:654] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.448706  1247 ts_tablet_manager.cc:1434] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:59:29.451622  1247 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.450526  1250 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.457712  1250 ts_tablet_manager.cc:1403] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.005s
W20260709 12:59:29.460464  1005 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:29.463197  1250 raft_consensus.cc:359] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.464169  1250 raft_consensus.cc:385] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.464484  1249 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.464790  1247 tablet_bootstrap.cc:654] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.464557  1250 raft_consensus.cc:740] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.465122  1249 ts_tablet_manager.cc:1403] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 12:59:29.464587   956 catalog_manager.cc:5697] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.466055  1250 consensus_queue.cc:260] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.468019  1249 raft_consensus.cc:359] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.468956  1249 raft_consensus.cc:385] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.469321  1249 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.469373  1250 ts_tablet_manager.cc:1434] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:29.471170  1250 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.470597  1249 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.477078  1249 ts_tablet_manager.cc:1434] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 12:59:29.478480  1249 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.482033  1250 tablet_bootstrap.cc:654] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.487061  1249 tablet_bootstrap.cc:654] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.488076  1255 raft_consensus.cc:493] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.488559  1255 raft_consensus.cc:515] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.494973  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.495532  1247 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.496069  1247 ts_tablet_manager.cc:1403] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.025s
I20260709 12:59:29.496241  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.499495  1250 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.499334  1247 raft_consensus.cc:359] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.500147  1250 ts_tablet_manager.cc:1403] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.007s
I20260709 12:59:29.500147  1247 raft_consensus.cc:385] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:29.500443  1098 leader_election.cc:343] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.500723  1247 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
W20260709 12:59:29.501444  1098 leader_election.cc:343] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.501648  1247 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.501995  1098 leader_election.cc:304] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad; no voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d
I20260709 12:59:29.502643  1255 leader_election.cc:290] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613), 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567)
I20260709 12:59:29.504801  1250 raft_consensus.cc:359] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.505959  1250 raft_consensus.cc:385] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.506587  1255 raft_consensus.cc:2749] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.519594  1247 ts_tablet_manager.cc:1434] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.015s
I20260709 12:59:29.510326  1250 raft_consensus.cc:740] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.523550  1250 consensus_queue.cc:260] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.526650  1250 ts_tablet_manager.cc:1434] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:59:29.527549  1247 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.527446  1256 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.527877  1250 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.528040  1256 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.533142  1256 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.536116  1247 tablet_bootstrap.cc:654] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.536590  1250 tablet_bootstrap.cc:654] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.545336  1261 raft_consensus.cc:493] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.546000  1261 raft_consensus.cc:515] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.548663  1256 raft_consensus.cc:493] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.549052  1261 leader_election.cc:290] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.546790  1275 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.549355  1256 raft_consensus.cc:515] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.550609  1275 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.552477  1256 leader_election.cc:290] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.554016  1275 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.554953  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.555583  1134 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.556190  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.556761  1174 leader_election.cc:304] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.557343  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.557649  1261 raft_consensus.cc:2804] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.558079  1261 raft_consensus.cc:493] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.558447  1261 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:29.559796  1098 leader_election.cc:343] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.559958  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
W20260709 12:59:29.560305  1172 leader_election.cc:343] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:29.561230  1098 leader_election.cc:343] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.561748  1098 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad; no voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d
I20260709 12:59:29.562268  1249 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.562745  1249 ts_tablet_manager.cc:1403] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.008s
I20260709 12:59:29.562983  1275 raft_consensus.cc:2749] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.566826  1247 tablet_bootstrap.cc:492] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.566433  1249 raft_consensus.cc:359] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.567296  1247 ts_tablet_manager.cc:1403] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.007s
I20260709 12:59:29.567234  1249 raft_consensus.cc:385] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.567806  1249 raft_consensus.cc:740] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.568143  1261 raft_consensus.cc:515] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.568692  1249 consensus_queue.cc:260] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.571519  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.572096  1134 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.572253  1250 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.572474  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:29.572731  1250 ts_tablet_manager.cc:1403] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.005s
W20260709 12:59:29.573899  1172 leader_election.cc:343] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.575721  1247 raft_consensus.cc:359] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.576449  1247 raft_consensus.cc:385] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.576689  1249 ts_tablet_manager.cc:1434] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:29.576759  1247 raft_consensus.cc:740] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.577896  1249 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.578459  1250 raft_consensus.cc:359] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.579216  1250 raft_consensus.cc:385] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.579973  1247 consensus_queue.cc:260] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.582281  1247 ts_tablet_manager.cc:1434] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:59:29.583309  1247 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.586828  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.587590  1133 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 0.
I20260709 12:59:29.589450  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.589804  1247 tablet_bootstrap.cc:654] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.579521  1250 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.590806  1025 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:29.591596  1249 tablet_bootstrap.cc:654] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.591791  1256 raft_consensus.cc:2804] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.591562  1250 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.592190  1256 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.592594  1256 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.594034  1250 ts_tablet_manager.cc:1434] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:59:29.595942  1134 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.596802  1250 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.598003  1174 leader_election.cc:304] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:29.601243  1253 raft_consensus.cc:2804] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:59:29.603168  1025 leader_election.cc:343] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.603920  1250 tablet_bootstrap.cc:654] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.607585  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.607781  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.596450  1261 leader_election.cc:290] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.608311  1207 raft_consensus.cc:2468] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 0.
W20260709 12:59:29.609826  1023 leader_election.cc:343] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.612650  1023 leader_election.cc:304] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.618163  1261 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.622354  1261 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.626967  1256 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.628880  1283 raft_consensus.cc:2804] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.629808  1283 raft_consensus.cc:493] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.630424  1283 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.632845  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.634016  1134 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.636533  1250 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.637624  1250 ts_tablet_manager.cc:1403] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.012s
I20260709 12:59:29.624604  1286 raft_consensus.cc:493] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.626441  1253 raft_consensus.cc:697] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:29.642377  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.642213  1250 raft_consensus.cc:359] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.643018  1250 raft_consensus.cc:385] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.643330  1250 raft_consensus.cc:740] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
W20260709 12:59:29.643695  1172 leader_election.cc:343] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.643891  1261 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.644002  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.644711  1133 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.644294  1250 consensus_queue.cc:260] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.643333  1253 consensus_queue.cc:237] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.646080  1174 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:29.646046  1286 raft_consensus.cc:515] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.649483  1250 ts_tablet_manager.cc:1434] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.001s
I20260709 12:59:29.649784  1282 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.650776  1250 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.651166  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
W20260709 12:59:29.653220  1025 leader_election.cc:343] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.651903  1282 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.654853  1282 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.655280  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:29.657918  1256 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.658150  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.658692  1286 leader_election.cc:290] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.658795  1207 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 0.
I20260709 12:59:29.659403  1250 tablet_bootstrap.cc:654] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:29.660152  1023 leader_election.cc:343] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.660900  1023 leader_election.cc:304] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.660930  1283 raft_consensus.cc:515] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.662763  1286 raft_consensus.cc:2804] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.664525  1286 raft_consensus.cc:493] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.664964  1286 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.667240  1247 tablet_bootstrap.cc:492] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.667745  1247 ts_tablet_manager.cc:1403] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.008s
I20260709 12:59:29.668713  1283 leader_election.cc:290] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.669131  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.669322  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:29.669888  1207 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:29.670379  1025 leader_election.cc:343] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.671948  1247 raft_consensus.cc:359] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.674839  1247 raft_consensus.cc:385] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.675168  1247 raft_consensus.cc:740] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.677493  1249 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.676751  1247 consensus_queue.cc:260] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.678149  1249 ts_tablet_manager.cc:1403] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.023s
I20260709 12:59:29.667765  1134 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.683724  1025 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: b5ad321506d74c3384516a8a7378193d
I20260709 12:59:29.684914  1283 raft_consensus.cc:2804] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.685400  1283 raft_consensus.cc:697] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:29.686225  1283 consensus_queue.cc:237] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.690011  1207 raft_consensus.cc:2468] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.691771  1023 leader_election.cc:304] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.692310  1282 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.693434  1256 raft_consensus.cc:2804] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.698258  1247 ts_tablet_manager.cc:1434] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:59:29.694797  1249 raft_consensus.cc:359] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.700242  1286 raft_consensus.cc:515] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.702881  1247 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.702884  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
W20260709 12:59:29.706761  1172 leader_election.cc:343] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.707643  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.704363   955 catalog_manager.cc:5697] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.708485  1134 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.708797  1282 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.707993   956 catalog_manager.cc:5697] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.704294  1250 tablet_bootstrap.cc:492] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.711519  1250 ts_tablet_manager.cc:1403] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.022s
I20260709 12:59:29.714217  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:29.715024  1207 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.717013  1286 leader_election.cc:290] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.702167  1249 raft_consensus.cc:385] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.717685  1249 raft_consensus.cc:740] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.720847  1249 consensus_queue.cc:260] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.721956  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.725744  1133 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.724081  1250 raft_consensus.cc:359] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.727228  1250 raft_consensus.cc:385] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.727643  1250 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.728744  1250 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.731698  1250 ts_tablet_manager.cc:1434] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:59:29.732796  1250 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.733572  1133 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.736742  1282 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.737190  1282 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.738818  1174 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:29.735855  1207 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.739271  1282 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.739822  1282 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.740274  1282 raft_consensus.cc:697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:29.741163  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.741101  1282 consensus_queue.cc:237] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.741828  1133 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.742832  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.742959  1174 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.743479  1058 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.743960  1287 raft_consensus.cc:2804] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.742853  1023 leader_election.cc:304] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.745043  1247 tablet_bootstrap.cc:654] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.744364  1287 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.745705  1134 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.746055  1287 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.746300  1250 tablet_bootstrap.cc:654] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.747139  1291 raft_consensus.cc:2804] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.749766  1291 raft_consensus.cc:697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:29.750797  1291 consensus_queue.cc:237] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.749169  1249 ts_tablet_manager.cc:1434] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.002s
I20260709 12:59:29.756764  1249 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.758808  1247 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.759382  1247 ts_tablet_manager.cc:1403] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.000s
I20260709 12:59:29.761147   955 catalog_manager.cc:5697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.762235  1247 raft_consensus.cc:359] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.763091  1249 tablet_bootstrap.cc:654] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.763314  1247 raft_consensus.cc:385] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.763795  1247 raft_consensus.cc:740] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.765332  1275 raft_consensus.cc:493] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.765774  1275 raft_consensus.cc:515] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.768450  1275 leader_election.cc:290] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.768846  1287 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.764671  1247 consensus_queue.cc:260] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.770941  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.771883  1256 raft_consensus.cc:697] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:29.778239  1287 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.778509  1247 ts_tablet_manager.cc:1434] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:59:29.779407  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.780015  1133 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.783443  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:29.784087  1059 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.778589  1256 consensus_queue.cc:237] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.779670  1247 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.775228  1250 tablet_bootstrap.cc:492] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.775992  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c52ec7e70a2344fdb7eaaab7ae0c73ca" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.790000  1250 ts_tablet_manager.cc:1403] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.013s
I20260709 12:59:29.790093  1058 raft_consensus.cc:2393] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a982d614769f4d2f9198c6725f4188ad in current term 1: Already voted for candidate b5ad321506d74c3384516a8a7378193d in this term.
I20260709 12:59:29.791970  1098 leader_election.cc:304] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad; no voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d
I20260709 12:59:29.793097  1275 raft_consensus.cc:3060] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.794413  1059 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.795593  1172 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.796456  1287 raft_consensus.cc:2804] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.796941  1287 raft_consensus.cc:697] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:29.795903  1250 raft_consensus.cc:359] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.797652  1250 raft_consensus.cc:385] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.797767  1287 consensus_queue.cc:237] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.798302  1250 raft_consensus.cc:740] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.799489  1250 consensus_queue.cc:260] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.802536  1250 ts_tablet_manager.cc:1434] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:59:29.800273  1275 raft_consensus.cc:2749] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:29.792934  1133 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.805689  1250 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: Bootstrap starting.
I20260709 12:59:29.806473  1247 tablet_bootstrap.cc:654] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.807868   956 catalog_manager.cc:5697] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.813123  1249 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.813201  1250 tablet_bootstrap.cc:654] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.813717  1249 ts_tablet_manager.cc:1403] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.010s
I20260709 12:59:29.813664   957 catalog_manager.cc:5697] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.816958  1249 raft_consensus.cc:359] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.817682  1249 raft_consensus.cc:385] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.817981  1249 raft_consensus.cc:740] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.818727  1249 consensus_queue.cc:260] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.820863  1249 ts_tablet_manager.cc:1434] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:29.821802  1249 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.826586  1250 tablet_bootstrap.cc:492] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: No bootstrap required, opened a new log
I20260709 12:59:29.827345  1250 ts_tablet_manager.cc:1403] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:59:29.827682  1256 raft_consensus.cc:493] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.828323  1249 tablet_bootstrap.cc:654] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.828176  1256 raft_consensus.cc:515] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.830382  1256 leader_election.cc:290] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.831691  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.832559  1133 raft_consensus.cc:2468] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 0.
I20260709 12:59:29.834545  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:29.835408  1207 raft_consensus.cc:2468] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 0.
I20260709 12:59:29.837219  1025 leader_election.cc:304] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:29.839633  1256 raft_consensus.cc:2804] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.840215  1256 raft_consensus.cc:493] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.840719  1256 raft_consensus.cc:3060] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.853950  1250 raft_consensus.cc:359] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.854707  1250 raft_consensus.cc:385] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.854979  1250 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.855661  1250 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.855991  1247 tablet_bootstrap.cc:492] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
I20260709 12:59:29.856616  1247 ts_tablet_manager.cc:1403] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.026s
I20260709 12:59:29.857501  1250 ts_tablet_manager.cc:1434] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:59:29.850536  1256 raft_consensus.cc:515] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.860563  1247 raft_consensus.cc:359] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.861428  1247 raft_consensus.cc:385] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.861760  1247 raft_consensus.cc:740] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.862668  1256 leader_election.cc:290] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:29.862573  1247 consensus_queue.cc:260] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.865298  1247 ts_tablet_manager.cc:1434] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.006s
I20260709 12:59:29.866183  1247 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: Bootstrap starting.
I20260709 12:59:29.867676  1249 tablet_bootstrap.cc:492] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.868103  1249 ts_tablet_manager.cc:1403] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.023s
I20260709 12:59:29.868862  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:29.869455  1207 raft_consensus.cc:3060] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.870860  1249 raft_consensus.cc:359] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.871555  1247 tablet_bootstrap.cc:654] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.871537  1249 raft_consensus.cc:385] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.871963  1249 raft_consensus.cc:740] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.872786  1249 consensus_queue.cc:260] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.873864  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead19415d37c4aa7a817b34359ad05f4" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.874413  1133 raft_consensus.cc:3060] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.875221  1249 ts_tablet_manager.cc:1434] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:29.876170  1249 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.876507  1207 raft_consensus.cc:2468] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.877712  1023 leader_election.cc:304] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.878548  1256 raft_consensus.cc:2804] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.879223  1256 raft_consensus.cc:697] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:29.866847   956 catalog_manager.cc:5697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.883939  1249 tablet_bootstrap.cc:654] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.880055  1256 consensus_queue.cc:237] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } }
I20260709 12:59:29.889794  1287 raft_consensus.cc:493] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.890336  1287 raft_consensus.cc:515] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.892498  1287 leader_election.cc:290] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.894099  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.894445  1134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.894769  1059 raft_consensus.cc:2468] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 0.
I20260709 12:59:29.895192  1247 tablet_bootstrap.cc:492] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: No bootstrap required, opened a new log
W20260709 12:59:29.895848  1174 leader_election.cc:343] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:29.895833  1247 ts_tablet_manager.cc:1403] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.011s
I20260709 12:59:29.896611  1172 leader_election.cc:304] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.899592  1287 raft_consensus.cc:2804] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:29.899928  1287 raft_consensus.cc:493] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.900220  1287 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.900213  1247 raft_consensus.cc:359] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.901204  1247 raft_consensus.cc:385] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.901546  1247 raft_consensus.cc:740] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.902591  1247 consensus_queue.cc:260] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.906816  1287 raft_consensus.cc:515] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.909443  1247 ts_tablet_manager.cc:1434] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:59:29.909562  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:29.910149  1059 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.911478  1133 raft_consensus.cc:2468] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 1.
I20260709 12:59:29.913311  1287 leader_election.cc:290] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.916420  1249 tablet_bootstrap.cc:492] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.916934  1249 ts_tablet_manager.cc:1403] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.011s
I20260709 12:59:29.919600  1249 raft_consensus.cc:359] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.920276  1249 raft_consensus.cc:385] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.920569  1249 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.919865   955 catalog_manager.cc:5697] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.920617  1059 raft_consensus.cc:2468] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.921308  1249 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.921890  1172 leader_election.cc:304] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:29.922647  1287 raft_consensus.cc:2804] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:29.923046  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:29.923312  1249 ts_tablet_manager.cc:1434] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:59:29.923161  1287 raft_consensus.cc:697] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:29.923653  1133 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.924183  1249 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: Bootstrap starting.
I20260709 12:59:29.924233  1287 consensus_queue.cc:237] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.929972  1249 tablet_bootstrap.cc:654] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:29.930742  1133 raft_consensus.cc:2468] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 1.
I20260709 12:59:29.935743  1249 tablet_bootstrap.cc:492] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: No bootstrap required, opened a new log
I20260709 12:59:29.936198  1249 ts_tablet_manager.cc:1403] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.002s
I20260709 12:59:29.938573  1249 raft_consensus.cc:359] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.939253  1249 raft_consensus.cc:385] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:29.939697  1249 raft_consensus.cc:740] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Initialized, Role: FOLLOWER
I20260709 12:59:29.939215   955 catalog_manager.cc:5697] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 0 to 1, leader changed from <none> to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.940354  1249 consensus_queue.cc:260] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.942323  1249 ts_tablet_manager.cc:1434] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:59:29.953256  1287 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.953693  1287 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:29.955435  1287 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:29.956274  1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:29.956540  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:29.957312  1133 raft_consensus.cc:2393] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5ad321506d74c3384516a8a7378193d in current term 1: Already voted for candidate 2ce7853bcb174d30a6d922b58f549fab in this term.
I20260709 12:59:29.958141  1174 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5ad321506d74c3384516a8a7378193d; no voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:29.958810  1287 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:29.964074  1287 raft_consensus.cc:2749] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.001835  1256 raft_consensus.cc:493] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.002319  1256 raft_consensus.cc:515] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.003546  1287 consensus_queue.cc:1048] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.004299  1256 leader_election.cc:290] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.005024  1133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a982d614769f4d2f9198c6725f4188ad" is_pre_election: true
I20260709 12:59:30.005295  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:30.005803  1133 raft_consensus.cc:2393] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ce7853bcb174d30a6d922b58f549fab in current term 1: Already voted for candidate b5ad321506d74c3384516a8a7378193d in this term.
I20260709 12:59:30.006899  1025 leader_election.cc:304] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab; no voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d
I20260709 12:59:30.007783  1256 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.014695  1256 raft_consensus.cc:2749] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:30.018872  1287 consensus_queue.cc:1048] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.196969  1256 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.207427  1059 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.207597  1286 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.209890  1275 raft_consensus.cc:493] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.210389  1275 raft_consensus.cc:515] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.212471  1275 leader_election.cc:290] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.214396  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab" is_pre_election: true
I20260709 12:59:30.214825  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d" is_pre_election: true
I20260709 12:59:30.215149  1058 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 0.
I20260709 12:59:30.215538  1207 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 0.
I20260709 12:59:30.215766  1133 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.216457  1098 leader_election.cc:304] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.217010  1287 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.217810  1313 raft_consensus.cc:2804] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:30.218220  1313 raft_consensus.cc:493] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:30.218544  1313 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.225741  1313 raft_consensus.cc:515] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.227946  1313 leader_election.cc:290] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.229679  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:30.230314  1058 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.231700  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.232277  1207 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:30.235519  1287 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.237298  1058 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 1.
I20260709 12:59:30.238531  1098 leader_election.cc:304] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.238673  1291 consensus_queue.cc:1048] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.238962  1207 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 1.
I20260709 12:59:30.240072  1313 raft_consensus.cc:2804] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:30.240562  1313 raft_consensus.cc:697] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:30.241649  1313 consensus_queue.cc:237] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.251784  1261 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.257028  1261 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:30.260771  1261 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:30.269273  1291 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.292636  1261 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.301029  1291 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:30.315150  1291 consensus_queue.cc:1048] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.351454  1287 consensus_queue.cc:1048] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.364319  1282 consensus_queue.cc:1048] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.364939   956 catalog_manager.cc:5697] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 0 to 1, leader changed from <none> to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 1 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.383556  1256 consensus_queue.cc:1048] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.398116  1291 consensus_queue.cc:1048] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.468567  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:30.469123  1208 raft_consensus.cc:606] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:30.474668  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:30.475206  1208 raft_consensus.cc:606] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:30.480038  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:30.480564  1208 raft_consensus.cc:606] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:30.485152  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:30.485654  1208 raft_consensus.cc:606] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:30.498101  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:59:30.498672  1058 raft_consensus.cc:606] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Received request to transfer leadership to TS a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:30.503340  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:59:30.503813  1058 raft_consensus.cc:606] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Received request to transfer leadership to TS a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:30.510366  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:59:30.510913  1058 raft_consensus.cc:606] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Received request to transfer leadership to TS a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:30.632578  1291 raft_consensus.cc:993] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.633142  1286 raft_consensus.cc:1081] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Signalling peer a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.635032  1132 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 12:59:30.635565  1132 raft_consensus.cc:493] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.635926  1132 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.641765  1132 raft_consensus.cc:515] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.643635  1132 leader_election.cc:290] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.644423  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:30.644663  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.645066  1058 raft_consensus.cc:3055] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.645141  1208 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.645479  1058 raft_consensus.cc:740] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.646292  1058 consensus_queue.cc:260] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.647583  1058 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.652526  1208 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.653906  1098 leader_election.cc:304] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:30.654086  1058 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.654597  1313 raft_consensus.cc:2804] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.655138  1313 raft_consensus.cc:697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:30.655915  1313 consensus_queue.cc:237] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.663096   955 catalog_manager.cc:5697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 1 to 2, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.696379  1313 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.708631  1275 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:30.769304  1287 raft_consensus.cc:993] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.769827  1287 raft_consensus.cc:1081] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.771325  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:30.771808  1058 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.772102  1058 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.776535  1058 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.778367  1058 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.779141  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:30.779421  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.779747  1132 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.780037  1208 raft_consensus.cc:3055] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.780346  1208 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:30.781173  1208 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.782406  1208 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.786864  1132 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.788244  1025 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.789083  1286 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.789292  1208 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.789609  1286 raft_consensus.cc:697] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.790565  1286 consensus_queue.cc:237] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.797014   956 catalog_manager.cc:5697] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 1 to 2, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.858515  1261 raft_consensus.cc:993] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.859027  1287 raft_consensus.cc:1081] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.860544  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:30.861052  1058 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.861406  1058 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.867808  1058 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.870960  1058 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.873014  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.873014  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:30.874444  1208 raft_consensus.cc:3055] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.874436  1132 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.875183  1208 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:30.876524  1208 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.878603  1208 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.885632  1261 raft_consensus.cc:993] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.886565  1287 raft_consensus.cc:1081] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.889851  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:30.890131  1132 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.891016  1058 raft_consensus.cc:493] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.891674  1058 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.892488  1208 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.892931  1025 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.894485  1286 raft_consensus.cc:2804] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.895442  1286 raft_consensus.cc:697] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.896806  1286 consensus_queue.cc:237] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.903537  1058 raft_consensus.cc:515] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.905917  1286 raft_consensus.cc:993] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.906411  1291 raft_consensus.cc:1081] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Signalling peer a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.908090  1058 leader_election.cc:290] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.908215  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 12:59:30.910248  1131 raft_consensus.cc:493] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.909803  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.910764  1131 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.910969  1208 raft_consensus.cc:3055] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.911361  1208 raft_consensus.cc:740] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:30.911222   956 catalog_manager.cc:5697] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 1 to 2, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.912247  1208 consensus_queue.cc:260] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.913166  1208 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.909713  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:30.915740  1132 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.918134  1131 raft_consensus.cc:515] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.920197  1208 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.921639  1023 leader_election.cc:304] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:30.922744  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:30.923388  1058 raft_consensus.cc:3055] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.923607  1131 leader_election.cc:290] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.923748  1058 raft_consensus.cc:740] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.922760  1286 raft_consensus.cc:2804] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.924786  1286 raft_consensus.cc:697] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.924664  1058 consensus_queue.cc:260] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.925812  1058 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.925701  1286 consensus_queue.cc:237] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.927824  1283 raft_consensus.cc:993] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.928256  1283 raft_consensus.cc:1081] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Signalling peer a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:30.929140  1282 raft_consensus.cc:993] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.929620  1282 raft_consensus.cc:1081] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:30.930773  1132 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.931325  1057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:30.929620  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53244d413834486b2ed703dab0ebc26" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.931937  1057 raft_consensus.cc:493] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.932334  1208 raft_consensus.cc:3060] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.932351  1057 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.935256  1058 raft_consensus.cc:2468] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.936358  1098 leader_election.cc:304] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.937098  1275 raft_consensus.cc:2804] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.937574  1275 raft_consensus.cc:697] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:30.938431  1275 consensus_queue.cc:237] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.941232  1208 raft_consensus.cc:2468] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.943611  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 12:59:30.944641  1131 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:30.945055  1131 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.945914   956 catalog_manager.cc:5697] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 1 to 2, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.942270  1057 raft_consensus.cc:515] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.947958   955 catalog_manager.cc:5697] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 1 to 2, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.949950  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.950588  1208 raft_consensus.cc:3055] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.950938  1208 raft_consensus.cc:740] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:30.951956  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f78d035ba1451faa202beecc6e4e54" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:30.952467  1057 leader_election.cc:290] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.952590  1132 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.953969  1131 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.951732  1208 consensus_queue.cc:260] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.956140  1131 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:30.957187  1057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:30.957563  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:30.957805  1057 raft_consensus.cc:3055] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:30.958184  1207 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.958541  1208 raft_consensus.cc:3060] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.960371  1132 raft_consensus.cc:2468] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.962049  1025 leader_election.cc:304] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:30.958170  1057 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.963059  1286 raft_consensus.cc:2804] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.964136  1057 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.965425  1207 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.965516  1286 raft_consensus.cc:697] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:30.965704  1057 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:30.965453  1208 raft_consensus.cc:2468] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:30.966493  1286 consensus_queue.cc:237] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.968140  1098 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:30.969146  1275 raft_consensus.cc:2804] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:30.969602  1275 raft_consensus.cc:697] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:30.970433  1275 consensus_queue.cc:237] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:30.972829  1057 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 2.
I20260709 12:59:30.980109   955 catalog_manager.cc:5697] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 1 to 2, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:30.980604   956 catalog_manager.cc:5697] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 1 to 2, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 2 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.176878  1208 raft_consensus.cc:1275] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.178463  1275 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.187145  1057 raft_consensus.cc:1275] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.188751  1324 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:31.223593  1208 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.224872  1291 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.232046  1132 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.233862  1286 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.286751  1208 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.290763  1286 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:31.307984  1132 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.309788  1286 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:31.358815  1208 raft_consensus.cc:1275] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.360050  1324 consensus_queue.cc:1048] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.369645  1057 raft_consensus.cc:1275] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.375538  1275 consensus_queue.cc:1048] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.376188  1057 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.377538  1275 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.392316  1208 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.393771  1324 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.396770  1132 raft_consensus.cc:1275] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.398100  1286 consensus_queue.cc:1048] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.408664  1208 raft_consensus.cc:1275] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.410492  1340 consensus_queue.cc:1048] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.441648  1132 raft_consensus.cc:1275] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.442948  1340 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:31.451627  1208 raft_consensus.cc:1275] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:31.453382  1283 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:33.545132   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:59:33.545799   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.563687  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:33.564352  1058 raft_consensus.cc:606] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Received request to transfer leadership to TS b5ad321506d74c3384516a8a7378193d
I20260709 12:59:33.566879  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:33.567354  1058 raft_consensus.cc:606] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Received request to transfer leadership to TS b5ad321506d74c3384516a8a7378193d
I20260709 12:59:33.568323   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:59:33.568778   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:33.834391  1283 raft_consensus.cc:993] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:33.834873  1352 raft_consensus.cc:1081] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Signalling peer b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:33.836222  1207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:50498
I20260709 12:59:33.836635  1207 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.836891  1207 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.841711  1207 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.843335  1207 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:33.844220  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:33.844331  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:33.844883  1058 raft_consensus.cc:3055] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:33.844960  1132 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.845211  1058 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:33.845963  1058 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.846909  1058 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.849906  1132 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:33.851074  1174 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:33.851739  1282 raft_consensus.cc:2804] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:33.851534  1058 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:33.853798  1282 raft_consensus.cc:697] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:33.854681  1282 consensus_queue.cc:237] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.870332   957 catalog_manager.cc:5697] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 2 to 3, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.883769  1283 raft_consensus.cc:993] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:33.884716  1352 raft_consensus.cc:1081] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Signalling peer b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:33.888124  1208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:50498
I20260709 12:59:33.889336  1208 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.890005  1208 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.899621  1208 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.902112  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:33.902595  1208 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:33.902678  1058 raft_consensus.cc:3055] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:33.902827  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:33.903242  1058 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:33.903486  1132 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.904138  1058 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.905272  1058 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:33.909370  1132 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:33.910411  1174 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:33.910935  1058 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:33.911160  1282 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:33.911659  1282 raft_consensus.cc:697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:33.912503  1282 consensus_queue.cc:237] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:33.919498   957 catalog_manager.cc:5697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 2 to 3, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:34.260933  1058 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:34.262219  1282 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.271843  1132 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:34.273545  1282 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.401782  1058 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:34.403103  1282 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.411726  1132 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:34.413370  1353 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:34.569613   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:34.585309  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:34.586184  1208 raft_consensus.cc:606] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:34.596979  1208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:50514
I20260709 12:59:34.598026  1208 raft_consensus.cc:606] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:34.630384  1132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:44406
I20260709 12:59:34.630959  1132 raft_consensus.cc:606] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:34.635852  1132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:44406
I20260709 12:59:34.636308  1132 raft_consensus.cc:606] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:34.640995  1132 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86248fc4a2554239812ec2a371047998"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
mode: GRACEFUL
new_leader_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:44406
I20260709 12:59:34.641513  1132 raft_consensus.cc:606] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 LEADER]: Received request to transfer leadership to TS 2ce7853bcb174d30a6d922b58f549fab
I20260709 12:59:34.674605  1282 raft_consensus.cc:993] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.675092  1353 raft_consensus.cc:1081] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.676626  1057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:34.677150  1057 raft_consensus.cc:493] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.677498  1057 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.678330  1371 raft_consensus.cc:993] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.678774  1360 raft_consensus.cc:1081] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.680420  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51978
I20260709 12:59:34.680881  1058 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.681159  1058 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.683153  1057 raft_consensus.cc:515] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.685281  1057 leader_election.cc:290] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 4 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:34.685433  1058 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.685670  1132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:34.685874  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c318e0269834f3faa6fa5c7ff980822" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:34.686302  1132 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.686468  1208 raft_consensus.cc:3055] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.686906  1208 raft_consensus.cc:740] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:34.687822  1208 consensus_queue.cc:260] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.688194  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:34.688498  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:34.688803  1131 raft_consensus.cc:3055] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:34.689092  1207 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.689133  1131 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:34.689168  1208 raft_consensus.cc:3060] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.690438  1131 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.691588  1131 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.694365  1132 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 4.
I20260709 12:59:34.695356  1058 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 3 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:34.695766  1025 leader_election.cc:304] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:34.696647  1352 raft_consensus.cc:2804] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.696715  1208 raft_consensus.cc:2468] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 4.
I20260709 12:59:34.697237  1207 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 3.
I20260709 12:59:34.699059  1352 raft_consensus.cc:697] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:34.699863  1131 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 3.
I20260709 12:59:34.699299  1023 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:34.700695  1372 raft_consensus.cc:2804] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:34.700095  1352 consensus_queue.cc:237] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.702078  1372 raft_consensus.cc:697] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:34.702963  1372 consensus_queue.cc:237] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.709631   957 catalog_manager.cc:5697] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 3 to 4, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.723300   957 catalog_manager.cc:5697] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 2 to 3, leader changed from a982d614769f4d2f9198c6725f4188ad (127.0.107.194) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.914865  1371 raft_consensus.cc:993] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.915307  1360 raft_consensus.cc:1081] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:34.916708  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51978
I20260709 12:59:34.917172  1058 raft_consensus.cc:493] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:34.917444  1058 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.921538  1058 raft_consensus.cc:515] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.923017  1058 leader_election.cc:290] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 3 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:34.923877  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:34.924073  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11dd64fafeb6467d866f5b3e9c2b94f3" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:34.924386  1131 raft_consensus.cc:3055] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:34.924631  1207 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.924726  1131 raft_consensus.cc:740] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:34.925534  1131 consensus_queue.cc:260] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.926430  1131 raft_consensus.cc:3060] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:34.929512  1207 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 3.
I20260709 12:59:34.930799  1023 leader_election.cc:304] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:34.931443  1131 raft_consensus.cc:2468] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 3.
I20260709 12:59:34.931481  1372 raft_consensus.cc:2804] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:34.932126  1372 raft_consensus.cc:697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:34.932916  1372 consensus_queue.cc:237] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:34.939467   957 catalog_manager.cc:5697] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 2 to 3, leader changed from a982d614769f4d2f9198c6725f4188ad (127.0.107.194) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.012728  1282 raft_consensus.cc:993] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:35.013152  1379 raft_consensus.cc:1081] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:35.014923  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51964
I20260709 12:59:35.015513  1058 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:35.015910  1058 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:35.055486  1058 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.058920  1058 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 4 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:35.060554  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:35.060916  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:35.061542  1131 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:35.061650  1207 raft_consensus.cc:3055] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:35.062027  1207 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:35.063117  1207 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.064916  1207 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:35.068167  1131 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 4.
I20260709 12:59:35.069413  1025 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:35.070664  1372 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:35.071130  1372 raft_consensus.cc:697] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:35.071254  1207 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 4.
I20260709 12:59:35.072371  1372 consensus_queue.cc:237] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.081152   957 catalog_manager.cc:5697] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 3 to 4, leader changed from b5ad321506d74c3384516a8a7378193d (127.0.107.195) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 4 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.098466  1207 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.099650  1372 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:35.109544  1131 raft_consensus.cc:1275] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.111353  1352 consensus_queue.cc:1048] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.167304  1371 raft_consensus.cc:993] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: : Instructing follower 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:35.168835  1360 raft_consensus.cc:1081] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 LEADER]: Signalling peer 2ce7853bcb174d30a6d922b58f549fab to start an election
I20260709 12:59:35.173619  1058 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86248fc4a2554239812ec2a371047998"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
 from {username='slave'} at 127.0.0.1:51978
I20260709 12:59:35.175086  1058 raft_consensus.cc:493] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:35.175523  1058 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:35.175944  1207 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:35.177335  1352 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:35.182003  1058 raft_consensus.cc:515] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.184684  1058 leader_election.cc:290] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Requested vote from peers a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:35.186113  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:35.186841  1131 raft_consensus.cc:3055] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:35.187762  1132 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:35.188661  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "2ce7853bcb174d30a6d922b58f549fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:35.189357  1207 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:35.189818  1372 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:35.187383  1131 raft_consensus.cc:740] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:35.191968  1131 consensus_queue.cc:260] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.193523  1131 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:35.198061  1207 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:35.199574  1023 leader_election.cc:304] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:35.200675  1385 raft_consensus.cc:2804] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:35.201339  1385 raft_consensus.cc:697] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Leader. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:35.202039  1131 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ce7853bcb174d30a6d922b58f549fab in term 2.
I20260709 12:59:35.202392  1385 consensus_queue.cc:237] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:35.213102   956 catalog_manager.cc:5697] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab reported cstate change: term changed from 1 to 2, leader changed from a982d614769f4d2f9198c6725f4188ad (127.0.107.194) to 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2ce7853bcb174d30a6d922b58f549fab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:35.431504  1207 raft_consensus.cc:1275] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:35.432651  1385 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:35.444278  1131 raft_consensus.cc:1275] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:35.445703  1373 consensus_queue.cc:1048] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:35.539997  1131 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.541143  1373 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:35.549773  1207 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.551460  1385 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:35.771962  1131 raft_consensus.cc:1275] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:35.773164  1385 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:35.782110  1207 raft_consensus.cc:1275] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Refusing update from remote peer 2ce7853bcb174d30a6d922b58f549fab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:35.784534  1385 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:37.648867   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.656497  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:37.657027  1058 raft_consensus.cc:606] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Received request to transfer leadership to TS a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:37.659389  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86248fc4a2554239812ec2a371047998"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:37.659811  1058 raft_consensus.cc:606] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Received request to transfer leadership to TS a982d614769f4d2f9198c6725f4188ad
I20260709 12:59:37.661978  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:37.662400  1058 raft_consensus.cc:606] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Received request to transfer leadership to TS b5ad321506d74c3384516a8a7378193d
I20260709 12:59:37.664369  1058 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
mode: GRACEFUL
new_leader_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:38078
I20260709 12:59:37.664846  1058 raft_consensus.cc:606] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Received request to transfer leadership to TS b5ad321506d74c3384516a8a7378193d
I20260709 12:59:37.665766   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:37.666213   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:37.670259  1372 raft_consensus.cc:993] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:37.670704  1394 raft_consensus.cc:1081] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Signalling peer b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:37.672230  1207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:50498
I20260709 12:59:37.672708  1207 raft_consensus.cc:493] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.673017  1207 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.677491  1207 raft_consensus.cc:515] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.679339  1207 leader_election.cc:290] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:37.680194  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:37.680680  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6fac5a9df149308d0d1a97610ba07e" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:37.680771  1058 raft_consensus.cc:3055] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.681277  1058 raft_consensus.cc:740] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:37.681922  1131 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.681951  1058 consensus_queue.cc:260] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.683053  1058 raft_consensus.cc:3060] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.687107  1131 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:37.687297  1058 raft_consensus.cc:2468] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 3.
I20260709 12:59:37.688489  1174 leader_election.cc:304] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:37.689266  1282 raft_consensus.cc:2804] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:37.690045  1282 raft_consensus.cc:697] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:37.690783  1282 consensus_queue.cc:237] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.697089   957 catalog_manager.cc:5697] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 2 to 3, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.822880  1372 raft_consensus.cc:993] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:37.823263  1394 raft_consensus.cc:1081] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Signalling peer b5ad321506d74c3384516a8a7378193d to start an election
I20260709 12:59:37.824549  1207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe"
dest_uuid: "b5ad321506d74c3384516a8a7378193d"
 from {username='slave'} at 127.0.0.1:50498
I20260709 12:59:37.824930  1207 raft_consensus.cc:493] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.825153  1207 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.829281  1207 raft_consensus.cc:515] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.830734  1207 leader_election.cc:290] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 5 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365)
I20260709 12:59:37.831830  1131 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
I20260709 12:59:37.831830  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9796269faff46e1bf010185f90b72fe" candidate_uuid: "b5ad321506d74c3384516a8a7378193d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:37.832556  1131 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.832566  1058 raft_consensus.cc:3055] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:37.833084  1058 raft_consensus.cc:740] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:37.833808  1058 consensus_queue.cc:260] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.834937  1058 raft_consensus.cc:3060] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.839521  1131 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 5.
I20260709 12:59:37.840713  1174 leader_election.cc:304] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:37.841307  1058 raft_consensus.cc:2468] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5ad321506d74c3384516a8a7378193d in term 5.
I20260709 12:59:37.841543  1282 raft_consensus.cc:2804] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.842039  1282 raft_consensus.cc:697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 5 LEADER]: Becoming Leader. State: Replica: b5ad321506d74c3384516a8a7378193d, State: Running, Role: LEADER
I20260709 12:59:37.842811  1282 consensus_queue.cc:237] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:37.848868   957 catalog_manager.cc:5697] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d reported cstate change: term changed from 4 to 5, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to b5ad321506d74c3384516a8a7378193d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "b5ad321506d74c3384516a8a7378193d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.987658  1372 raft_consensus.cc:993] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:37.988155  1394 raft_consensus.cc:1081] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Signalling peer a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:37.989596  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 12:59:37.990024  1131 raft_consensus.cc:493] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.990368  1131 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.040737  1131 raft_consensus.cc:515] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.042411  1131 leader_election.cc:290] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 4 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:38.043627  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:38.043563  1207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75e7b84b5e3e43b292853bab1ad13f37" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:38.044239  1058 raft_consensus.cc:3055] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.044245  1207 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.044687  1058 raft_consensus.cc:740] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:38.045858  1058 consensus_queue.cc:260] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.047032  1058 raft_consensus.cc:3060] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.067044  1207 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 4.
I20260709 12:59:38.067113  1058 raft_consensus.cc:2468] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 4.
I20260709 12:59:38.068507  1098 leader_election.cc:304] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a982d614769f4d2f9198c6725f4188ad, b5ad321506d74c3384516a8a7378193d; no voters: 
I20260709 12:59:38.069255  1360 raft_consensus.cc:2804] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:38.070469  1360 raft_consensus.cc:697] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 4 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:38.071221  1360 consensus_queue.cc:237] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.077924   957 catalog_manager.cc:5697] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 3 to 4, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 4 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.157518  1372 raft_consensus.cc:993] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: : Instructing follower a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:38.158087  1394 raft_consensus.cc:1081] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Signalling peer a982d614769f4d2f9198c6725f4188ad to start an election
I20260709 12:59:38.159837  1131 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86248fc4a2554239812ec2a371047998"
dest_uuid: "a982d614769f4d2f9198c6725f4188ad"
 from {username='slave'} at 127.0.0.1:44614
I20260709 12:59:38.160292  1131 raft_consensus.cc:493] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:38.160663  1131 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.166066  1131 raft_consensus.cc:515] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.167786  1131 leader_election.cc:290] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 3 election: Requested vote from peers 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567), b5ad321506d74c3384516a8a7378193d (127.0.107.195:42613)
I20260709 12:59:38.168910  1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2ce7853bcb174d30a6d922b58f549fab"
I20260709 12:59:38.169358  1058 raft_consensus.cc:3055] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:38.169589  1058 raft_consensus.cc:740] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ce7853bcb174d30a6d922b58f549fab, State: Running, Role: LEADER
I20260709 12:59:38.170275  1058 consensus_queue.cc:260] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.171131  1058 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.171762  1208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86248fc4a2554239812ec2a371047998" candidate_uuid: "a982d614769f4d2f9198c6725f4188ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5ad321506d74c3384516a8a7378193d"
I20260709 12:59:38.172185  1208 raft_consensus.cc:3060] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:38.176663  1058 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 3.
I20260709 12:59:38.176887  1208 raft_consensus.cc:2468] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a982d614769f4d2f9198c6725f4188ad in term 3.
I20260709 12:59:38.177829  1098 leader_election.cc:304] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ce7853bcb174d30a6d922b58f549fab, a982d614769f4d2f9198c6725f4188ad; no voters: 
I20260709 12:59:38.178666  1360 raft_consensus.cc:2804] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:38.179122  1360 raft_consensus.cc:697] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 3 LEADER]: Becoming Leader. State: Replica: a982d614769f4d2f9198c6725f4188ad, State: Running, Role: LEADER
I20260709 12:59:38.179934  1360 consensus_queue.cc:237] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } }
I20260709 12:59:38.186790   957 catalog_manager.cc:5697] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad reported cstate change: term changed from 2 to 3, leader changed from 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193) to a982d614769f4d2f9198c6725f4188ad (127.0.107.194). New cstate: current_term: 3 leader_uuid: "a982d614769f4d2f9198c6725f4188ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.228384  1058 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 5 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:38.229573  1282 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.239307  1131 raft_consensus.cc:1275] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 5 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:59:38.240761  1282 consensus_queue.cc:1048] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:38.281466  1058 raft_consensus.cc:1275] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.282663  1395 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.290656  1131 raft_consensus.cc:1275] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Refusing update from remote peer b5ad321506d74c3384516a8a7378193d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.292232  1395 consensus_queue.cc:1048] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a982d614769f4d2f9198c6725f4188ad" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.550530  1058 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:38.551787  1360 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:38.560700  1208 raft_consensus.cc:1275] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:38.563359  1360 consensus_queue.cc:1048] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:38.591470  1208 raft_consensus.cc:1275] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.592504  1360 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ad321506d74c3384516a8a7378193d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.601588  1058 raft_consensus.cc:1275] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Refusing update from remote peer a982d614769f4d2f9198c6725f4188ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:38.603672  1402 consensus_queue.cc:1048] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ce7853bcb174d30a6d922b58f549fab" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:38.667063   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:38.673000   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:59:38.679855  1172 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:59:38.683763  1172 consensus_peers.cc:597] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d -> Peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Couldn't send request to peer 2ce7853bcb174d30a6d922b58f549fab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.704988   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:38.705745   431 tablet_replica.cc:333] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.706537   431 raft_consensus.cc:2243] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.707010   431 raft_consensus.cc:2272] T e9796269faff46e1bf010185f90b72fe P 2ce7853bcb174d30a6d922b58f549fab [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.709112   431 tablet_replica.cc:333] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.709815   431 raft_consensus.cc:2243] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.710911   431 raft_consensus.cc:2272] T ead19415d37c4aa7a817b34359ad05f4 P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.713388   431 tablet_replica.cc:333] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.714993   431 raft_consensus.cc:2243] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:59:38.715826  1172 consensus_peers.cc:597] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d -> Peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Couldn't send request to peer 2ce7853bcb174d30a6d922b58f549fab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.715910   431 raft_consensus.cc:2272] T 11dd64fafeb6467d866f5b3e9c2b94f3 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.717984   431 tablet_replica.cc:333] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.718470   431 raft_consensus.cc:2243] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.718871   431 raft_consensus.cc:2272] T 86248fc4a2554239812ec2a371047998 P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.720726   431 tablet_replica.cc:333] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.721184   431 raft_consensus.cc:2243] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.721511   431 raft_consensus.cc:2272] T 75e7b84b5e3e43b292853bab1ad13f37 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.723464   431 tablet_replica.cc:333] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.723903   431 raft_consensus.cc:2243] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.724579   431 raft_consensus.cc:2272] T b2f78d035ba1451faa202beecc6e4e54 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.726316   431 tablet_replica.cc:333] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.726872   431 raft_consensus.cc:2243] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.727226   431 raft_consensus.cc:2272] T c53244d413834486b2ed703dab0ebc26 P 2ce7853bcb174d30a6d922b58f549fab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.728892   431 tablet_replica.cc:333] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.729288   431 raft_consensus.cc:2243] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.729617   431 raft_consensus.cc:2272] T c52ec7e70a2344fdb7eaaab7ae0c73ca P 2ce7853bcb174d30a6d922b58f549fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.731240   431 tablet_replica.cc:333] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.731681   431 raft_consensus.cc:2243] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.732008   431 raft_consensus.cc:2272] T aa6fac5a9df149308d0d1a97610ba07e P 2ce7853bcb174d30a6d922b58f549fab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.734057   431 tablet_replica.cc:333] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab: stopping tablet replica
I20260709 12:59:38.734459   431 raft_consensus.cc:2243] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.735235   431 raft_consensus.cc:2272] T 3c318e0269834f3faa6fa5c7ff980822 P 2ce7853bcb174d30a6d922b58f549fab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.764235   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:59:38.783802   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:59:38.806839   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:38.807466   431 tablet_replica.cc:333] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.808049   431 raft_consensus.cc:2243] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.808504   431 raft_consensus.cc:2272] T 11dd64fafeb6467d866f5b3e9c2b94f3 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.810235   431 tablet_replica.cc:333] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.810835   431 raft_consensus.cc:2243] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.811566   431 raft_consensus.cc:2272] T 86248fc4a2554239812ec2a371047998 P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.813462   431 tablet_replica.cc:333] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.813974   431 raft_consensus.cc:2243] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.815026   431 raft_consensus.cc:2272] T 75e7b84b5e3e43b292853bab1ad13f37 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.819140   431 tablet_replica.cc:333] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.820252   431 raft_consensus.cc:2243] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.821156   431 raft_consensus.cc:2272] T b2f78d035ba1451faa202beecc6e4e54 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.825297   431 tablet_replica.cc:333] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.826452   431 raft_consensus.cc:2243] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.828428   431 raft_consensus.cc:2272] T c53244d413834486b2ed703dab0ebc26 P a982d614769f4d2f9198c6725f4188ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.832942   431 tablet_replica.cc:333] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.834101   431 raft_consensus.cc:2243] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:59:38.834805  1172 consensus_peers.cc:597] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d -> Peer 2ce7853bcb174d30a6d922b58f549fab (127.0.107.193:36567): Couldn't send request to peer 2ce7853bcb174d30a6d922b58f549fab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36567: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.835048   431 raft_consensus.cc:2272] T c52ec7e70a2344fdb7eaaab7ae0c73ca P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.839269   431 tablet_replica.cc:333] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.840708   431 raft_consensus.cc:2243] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.841852   431 raft_consensus.cc:2272] T aa6fac5a9df149308d0d1a97610ba07e P a982d614769f4d2f9198c6725f4188ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.847296   431 tablet_replica.cc:333] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.848316   431 raft_consensus.cc:2243] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.849457   431 raft_consensus.cc:2272] T 3c318e0269834f3faa6fa5c7ff980822 P a982d614769f4d2f9198c6725f4188ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.852543   431 tablet_replica.cc:333] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.853510   431 raft_consensus.cc:2243] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.854161   431 raft_consensus.cc:2272] T ead19415d37c4aa7a817b34359ad05f4 P a982d614769f4d2f9198c6725f4188ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.855923   431 tablet_replica.cc:333] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad: stopping tablet replica
I20260709 12:59:38.856420   431 raft_consensus.cc:2243] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.856849   431 raft_consensus.cc:2272] T e9796269faff46e1bf010185f90b72fe P a982d614769f4d2f9198c6725f4188ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.886744   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:59:38.894054  1174 consensus_peers.cc:597] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d -> Peer a982d614769f4d2f9198c6725f4188ad (127.0.107.194:35365): Couldn't send request to peer a982d614769f4d2f9198c6725f4188ad. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:38.905350   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:59:38.926980   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:59:38.927629   431 tablet_replica.cc:333] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.928144   431 raft_consensus.cc:2243] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.928558   431 raft_consensus.cc:2272] T ead19415d37c4aa7a817b34359ad05f4 P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.930334   431 tablet_replica.cc:333] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.931006   431 raft_consensus.cc:2243] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.931701   431 raft_consensus.cc:2272] T e9796269faff46e1bf010185f90b72fe P b5ad321506d74c3384516a8a7378193d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.934232   431 tablet_replica.cc:333] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.934783   431 raft_consensus.cc:2243] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.935205   431 raft_consensus.cc:2272] T b2f78d035ba1451faa202beecc6e4e54 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.936743   431 tablet_replica.cc:333] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.937227   431 raft_consensus.cc:2243] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.937935   431 raft_consensus.cc:2272] T c52ec7e70a2344fdb7eaaab7ae0c73ca P b5ad321506d74c3384516a8a7378193d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.939690   431 tablet_replica.cc:333] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.940136   431 raft_consensus.cc:2243] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.940495   431 raft_consensus.cc:2272] T c53244d413834486b2ed703dab0ebc26 P b5ad321506d74c3384516a8a7378193d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.942009   431 tablet_replica.cc:333] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.942432   431 raft_consensus.cc:2243] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.942898   431 raft_consensus.cc:2272] T 3c318e0269834f3faa6fa5c7ff980822 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.944273   431 tablet_replica.cc:333] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.944715   431 raft_consensus.cc:2243] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:59:38.945338   431 raft_consensus.cc:2272] T aa6fac5a9df149308d0d1a97610ba07e P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.947705   431 tablet_replica.cc:333] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.948181   431 raft_consensus.cc:2243] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.948585   431 raft_consensus.cc:2272] T 11dd64fafeb6467d866f5b3e9c2b94f3 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.950227   431 tablet_replica.cc:333] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.950744   431 raft_consensus.cc:2243] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.951189   431 raft_consensus.cc:2272] T 75e7b84b5e3e43b292853bab1ad13f37 P b5ad321506d74c3384516a8a7378193d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.953143   431 tablet_replica.cc:333] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d: stopping tablet replica
I20260709 12:59:38.953583   431 raft_consensus.cc:2243] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:38.953969   431 raft_consensus.cc:2272] T 86248fc4a2554239812ec2a371047998 P b5ad321506d74c3384516a8a7378193d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:38.974022   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:59:38.991784   431 master.cc:562] Master@127.0.107.254:34529 shutting down...
I20260709 12:59:39.011772   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:59:39.012303   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:39.012626   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2a25073f3c1a476a863b1a82a0cca54d: stopping tablet replica
I20260709 12:59:39.032894   431 master.cc:584] Master@127.0.107.254:34529 shutdown complete.
2ce7853bcb174d30a6d922b58f549fab  5
a982d614769f4d2f9198c6725f4188ad  4
b5ad321506d74c3384516a8a7378193d  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10736 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:59:39.073280   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35005
I20260709 12:59:39.074345   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:39.080022  1420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:39.080157  1421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:39.080973  1423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.082516   431 server_base.cc:1061] running on GCE node
I20260709 12:59:39.083403   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:39.083604   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:39.083760   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601979083746 us; error 0 us; skew 500 ppm
I20260709 12:59:39.084337   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:39.090054   431 webserver.cc:533] Webserver started at http://127.0.107.254:34233/ using document root <none> and password file <none>
I20260709 12:59:39.090582   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:39.090847   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:39.091147   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:39.092290   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "6082291f52654c5a8f0456b9ee951915"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.096665   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:39.099917  1428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.100576   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:59:39.100860   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "6082291f52654c5a8f0456b9ee951915"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.101125   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:39.137648   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:39.139246   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:39.184190   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35005
I20260709 12:59:39.184278  1479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35005 every 8 connection(s)
I20260709 12:59:39.188094  1480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.198560  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Bootstrap starting.
I20260709 12:59:39.203392  1480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:39.207655  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: No bootstrap required, opened a new log
I20260709 12:59:39.209697  1480 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER }
I20260709 12:59:39.210083  1480 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:39.210263  1480 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6082291f52654c5a8f0456b9ee951915, State: Initialized, Role: FOLLOWER
I20260709 12:59:39.210810  1480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER }
I20260709 12:59:39.211236  1480 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:59:39.211436  1480 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:59:39.211640  1480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:39.255466  1480 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER }
I20260709 12:59:39.256119  1480 leader_election.cc:304] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6082291f52654c5a8f0456b9ee951915; no voters: 
I20260709 12:59:39.257354  1480 leader_election.cc:290] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:59:39.257721  1483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:39.259294  1483 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 1 LEADER]: Becoming Leader. State: Replica: 6082291f52654c5a8f0456b9ee951915, State: Running, Role: LEADER
I20260709 12:59:39.259922  1483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER }
I20260709 12:59:39.260475  1480 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:59:39.264567  1485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6082291f52654c5a8f0456b9ee951915. Latest consensus state: current_term: 1 leader_uuid: "6082291f52654c5a8f0456b9ee951915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER } }
I20260709 12:59:39.264561  1484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6082291f52654c5a8f0456b9ee951915" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6082291f52654c5a8f0456b9ee951915" member_type: VOTER } }
I20260709 12:59:39.265596  1485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:39.265745  1484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [sys.catalog]: This master's current role is: LEADER
I20260709 12:59:39.273970  1489 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:59:39.281934  1489 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:59:39.283618   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:59:39.290725  1489 catalog_manager.cc:1383] Generated new cluster ID: e6c31a506be24c0bb6adf8e075b3fbbe
I20260709 12:59:39.291021  1489 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:59:39.304811  1489 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:59:39.306097  1489 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:59:39.316671  1489 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Generated new TSK 0
I20260709 12:59:39.317263  1489 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:59:39.352011   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:39.364763  1502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.366657   431 server_base.cc:1061] running on GCE node
W20260709 12:59:39.367249  1501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:39.367645  1504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.368630   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:39.368865   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:39.369051   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601979369033 us; error 0 us; skew 500 ppm
I20260709 12:59:39.369599   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:39.372161   431 webserver.cc:533] Webserver started at http://127.0.107.193:42007/ using document root <none> and password file <none>
I20260709 12:59:39.372676   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:39.372885   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:39.373163   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:39.374338   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "9fbc4df0bb934bba941cfa20c0afead2"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.379283   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:59:39.382717  1509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.383517   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:59:39.383858   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "9fbc4df0bb934bba941cfa20c0afead2"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.384172   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:39.401682   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:39.403043   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:39.404579   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:39.406888   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:39.407116   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.407374   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:39.407560   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.448724   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34175
I20260709 12:59:39.448827  1571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34175 every 8 connection(s)
I20260709 12:59:39.453750   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:39.460794  1576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.468567  1572 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35005
W20260709 12:59:39.468911  1577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.469296  1572 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:39.470288  1572 heartbeater.cc:507] Master 127.0.107.254:35005 requested a full tablet report, sending...
W20260709 12:59:39.471737  1579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.472612  1445 ts_manager.cc:194] Registered new tserver with Master: 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 12:59:39.472623   431 server_base.cc:1061] running on GCE node
I20260709 12:59:39.473675   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:39.473896   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:39.474097   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601979474081 us; error 0 us; skew 500 ppm
I20260709 12:59:39.474540  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49622
I20260709 12:59:39.474704   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:39.477459   431 webserver.cc:533] Webserver started at http://127.0.107.194:36739/ using document root <none> and password file <none>
I20260709 12:59:39.477950   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:39.478169   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:39.478456   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:39.479673   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.484310   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:59:39.487730  1584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.488586   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:39.488960   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.489253   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:39.503690   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:39.504964   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:39.506491   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:39.508766   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:39.508992   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.509240   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:39.509410   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.552099   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39685
I20260709 12:59:39.552172  1646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39685 every 8 connection(s)
I20260709 12:59:39.556697   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:39.563663  1650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:39.565166  1651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.569357   431 server_base.cc:1061] running on GCE node
W20260709 12:59:39.571388  1653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:39.572191  1647 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35005
I20260709 12:59:39.572309   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:39.572619   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:39.572646  1647 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:39.572854   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601979572835 us; error 0 us; skew 500 ppm
I20260709 12:59:39.573493   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:39.573455  1647 heartbeater.cc:507] Master 127.0.107.254:35005 requested a full tablet report, sending...
I20260709 12:59:39.575906  1445 ts_manager.cc:194] Registered new tserver with Master: c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:39.576260   431 webserver.cc:533] Webserver started at http://127.0.107.195:43917/ using document root <none> and password file <none>
I20260709 12:59:39.576898   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:39.577127   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:39.577432   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:39.577760  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49628
I20260709 12:59:39.578962   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "2080b3bca2e64a1a953c17b506b668d2"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.583539   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:59:39.586856  1658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.587646   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:59:39.587939   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "2080b3bca2e64a1a953c17b506b668d2"
format_stamp: "Formatted at 2026-07-09 12:59:39 on dist-test-slave-n5kz"
I20260709 12:59:39.588182   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:39.610203   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:39.611373   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:39.612628   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:39.614849   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:39.615085   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.615335   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:39.615516   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:39.655902   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45637
I20260709 12:59:39.656023  1720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45637 every 8 connection(s)
I20260709 12:59:39.674479  1721 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35005
I20260709 12:59:39.674981  1721 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:39.675926  1721 heartbeater.cc:507] Master 127.0.107.254:35005 requested a full tablet report, sending...
I20260709 12:59:39.678207  1445 ts_manager.cc:194] Registered new tserver with Master: 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:39.678397   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019350727s
I20260709 12:59:39.679997  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49636
I20260709 12:59:39.704692  1445 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:59:39.710829  1445 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:59:39.910801  1686 tablet_service.cc:1511] Processing CreateTablet for tablet ab05924031f84a848a47260864c78193 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:39.912348  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab05924031f84a848a47260864c78193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.912735  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 5be703fc2dd046c1b14909b95d460cd8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:39.914098  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be703fc2dd046c1b14909b95d460cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.919324  1612 tablet_service.cc:1511] Processing CreateTablet for tablet ab05924031f84a848a47260864c78193 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:39.920768  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab05924031f84a848a47260864c78193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.921810  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 854dc9ecb21b45069ab7661dc5c021c9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:39.922102  1608 tablet_service.cc:1511] Processing CreateTablet for tablet aa0547666b41440ebc195aa8cd34bc9d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:39.920372  1609 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6768c02504c9cb4195745e3f1970e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:39.923112  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854dc9ecb21b45069ab7661dc5c021c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.923910  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6768c02504c9cb4195745e3f1970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.924383  1607 tablet_service.cc:1511] Processing CreateTablet for tablet f5fffa415884468d9ae844797cb87109 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:39.925184  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 5be703fc2dd046c1b14909b95d460cd8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:39.925644  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fffa415884468d9ae844797cb87109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.926484  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be703fc2dd046c1b14909b95d460cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.927780  1606 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd73d471194556a9ba093049d04790 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:39.929073  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd73d471194556a9ba093049d04790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.931897  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:39.933282  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.935050  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0547666b41440ebc195aa8cd34bc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.952665  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 854dc9ecb21b45069ab7661dc5c021c9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:39.954100  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854dc9ecb21b45069ab7661dc5c021c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.955809  1683 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6768c02504c9cb4195745e3f1970e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:39.957162  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6768c02504c9cb4195745e3f1970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.959733  1682 tablet_service.cc:1511] Processing CreateTablet for tablet aa0547666b41440ebc195aa8cd34bc9d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:39.961043  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0547666b41440ebc195aa8cd34bc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.961215  1533 tablet_service.cc:1511] Processing CreateTablet for tablet aa0547666b41440ebc195aa8cd34bc9d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:59:39.963061  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0547666b41440ebc195aa8cd34bc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.963668  1537 tablet_service.cc:1511] Processing CreateTablet for tablet ab05924031f84a848a47260864c78193 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:59:39.964862  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab05924031f84a848a47260864c78193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.972295  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 5be703fc2dd046c1b14909b95d460cd8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:59:39.973670  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be703fc2dd046c1b14909b95d460cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.975661  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 854dc9ecb21b45069ab7661dc5c021c9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:59:39.978055  1534 tablet_service.cc:1511] Processing CreateTablet for tablet d5f6768c02504c9cb4195745e3f1970e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:59:39.981186  1680 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd73d471194556a9ba093049d04790 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:39.988623  1604 tablet_service.cc:1511] Processing CreateTablet for tablet dae379e1020a47aea6053cd31adaf4a0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:39.987807  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd73d471194556a9ba093049d04790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.991345  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae379e1020a47aea6053cd31adaf4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.975545  1603 tablet_service.cc:1511] Processing CreateTablet for tablet e9045b82a0ec40a69c0967a8f8188129 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:39.996667  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9045b82a0ec40a69c0967a8f8188129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.998579  1681 tablet_service.cc:1511] Processing CreateTablet for tablet f5fffa415884468d9ae844797cb87109 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:40.000730  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fffa415884468d9ae844797cb87109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.981716  1532 tablet_service.cc:1511] Processing CreateTablet for tablet f5fffa415884468d9ae844797cb87109 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:59:40.002971  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:40.009203  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:59:40.011114  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854dc9ecb21b45069ab7661dc5c021c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.011530  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.015014  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6768c02504c9cb4195745e3f1970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.019035  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 412cc1b1dcd54096b1fbbc092bcfc7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.987929  1531 tablet_service.cc:1511] Processing CreateTablet for tablet e4bd73d471194556a9ba093049d04790 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:59:40.022986  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fffa415884468d9ae844797cb87109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.025858  1529 tablet_service.cc:1511] Processing CreateTablet for tablet dae379e1020a47aea6053cd31adaf4a0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:40.026988  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd73d471194556a9ba093049d04790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.030958  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae379e1020a47aea6053cd31adaf4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.030563  1678 tablet_service.cc:1511] Processing CreateTablet for tablet dae379e1020a47aea6053cd31adaf4a0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:59:40.031884  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 51ca4c13fdd142269405c90e6382797c (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:40.032444  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae379e1020a47aea6053cd31adaf4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.033183  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ca4c13fdd142269405c90e6382797c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.051534  1736 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:40.077732  1736 tablet_bootstrap.cc:654] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.079241  1607 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee981fb9947eb9c9c17aa40779ecc (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:40.080581  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee981fb9947eb9c9c17aa40779ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.083336  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:40.084614  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.111141  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0c52190de849839b129a0fa6099693 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:40.112521  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0c52190de849839b129a0fa6099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.112072  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 831605a002324a04838f4fe562b13530 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:40.113972  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831605a002324a04838f4fe562b13530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.120347  1529 tablet_service.cc:1511] Processing CreateTablet for tablet e9045b82a0ec40a69c0967a8f8188129 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:40.121721  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9045b82a0ec40a69c0967a8f8188129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.108820  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 06184411faf343c9939d453eeec59cae (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:40.124532  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06184411faf343c9939d453eeec59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.129801  1686 tablet_service.cc:1511] Processing CreateTablet for tablet e9045b82a0ec40a69c0967a8f8188129 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:59:40.131131  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9045b82a0ec40a69c0967a8f8188129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.135897  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 51ca4c13fdd142269405c90e6382797c (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:40.137230  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ca4c13fdd142269405c90e6382797c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.144129  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 51ca4c13fdd142269405c90e6382797c (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:59:40.156791  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0c52190de849839b129a0fa6099693 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:40.174809  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51ca4c13fdd142269405c90e6382797c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.180084  1737 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:40.181886  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0c52190de849839b129a0fa6099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.201996  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 9810b426aedc4eb89adfbd103150f39a (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:40.203477  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810b426aedc4eb89adfbd103150f39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.205559  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:40.206869  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29466a5fdaaa4059bb44d95ca1ec63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.207976  1530 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee981fb9947eb9c9c17aa40779ecc (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:40.210139  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee981fb9947eb9c9c17aa40779ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.214879  1685 tablet_service.cc:1511] Processing CreateTablet for tablet f85ee981fb9947eb9c9c17aa40779ecc (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:59:40.215770  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 06184411faf343c9939d453eeec59cae (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:40.216183  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee981fb9947eb9c9c17aa40779ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.216957  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06184411faf343c9939d453eeec59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.219133  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb37620691446b2b3ac3e61e48ed81d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:40.220402  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb37620691446b2b3ac3e61e48ed81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.195091  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:40.221645  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.228241  1533 tablet_service.cc:1511] Processing CreateTablet for tablet e3c2089bb9c240cc97c2b79e1d4c648f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:40.229151  1604 tablet_service.cc:1511] Processing CreateTablet for tablet e3c2089bb9c240cc97c2b79e1d4c648f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:40.228241  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 06184411faf343c9939d453eeec59cae (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:59:40.230515  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c2089bb9c240cc97c2b79e1d4c648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.230998  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06184411faf343c9939d453eeec59cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.229584  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c2089bb9c240cc97c2b79e1d4c648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.195925  1738 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:40.208014  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:59:40.238965  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.240207  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 459063895bc847b9a15dc71e10b36267 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:40.244412  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 831605a002324a04838f4fe562b13530 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:40.245702  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831605a002324a04838f4fe562b13530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.183444  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 4a0c52190de849839b129a0fa6099693 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:59:40.255901  1736 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:40.255743  1680 tablet_service.cc:1511] Processing CreateTablet for tablet e3c2089bb9c240cc97c2b79e1d4c648f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:59:40.256408  1736 ts_tablet_manager.cc:1403] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.205s	user 0.025s	sys 0.004s
I20260709 12:59:40.257077  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c2089bb9c240cc97c2b79e1d4c648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.259198  1736 raft_consensus.cc:359] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:40.266637  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 9810b426aedc4eb89adfbd103150f39a (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:40.267942  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810b426aedc4eb89adfbd103150f39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.272506  1738 tablet_bootstrap.cc:654] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.272661  1737 tablet_bootstrap.cc:654] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.275101  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4f26e727a741fa8ca38a41fff1dc1d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:59:40.279224  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:40.259941  1736 raft_consensus.cc:385] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.295022  1736 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.295804  1736 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:40.260032  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459063895bc847b9a15dc71e10b36267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.297397  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4f26e727a741fa8ca38a41fff1dc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.299420  1603 tablet_service.cc:1511] Processing CreateTablet for tablet aa0c15f4fa7246faa2d54502e99a81ab (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:40.300781  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0c15f4fa7246faa2d54502e99a81ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.303117  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0c52190de849839b129a0fa6099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.330574  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 831605a002324a04838f4fe562b13530 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:59:40.310391  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:40.351073  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:59:40.352082  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29466a5fdaaa4059bb44d95ca1ec63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.352274  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29466a5fdaaa4059bb44d95ca1ec63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.338634  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4f26e727a741fa8ca38a41fff1dc1d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:40.356947  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4f26e727a741fa8ca38a41fff1dc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.312304  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb37620691446b2b3ac3e61e48ed81d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:40.361837  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb37620691446b2b3ac3e61e48ed81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.320370  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:40.367543  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.339684  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:40.368636  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.338239  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 459063895bc847b9a15dc71e10b36267 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:40.372040  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459063895bc847b9a15dc71e10b36267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.345397  1679 tablet_service.cc:1511] Processing CreateTablet for tablet aa0c15f4fa7246faa2d54502e99a81ab (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:40.308362  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 9810b426aedc4eb89adfbd103150f39a (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:59:40.347676  1721 heartbeater.cc:499] Master 127.0.107.254:35005 was elected leader, sending a full tablet report...
I20260709 12:59:40.376364  1610 tablet_service.cc:1511] Processing CreateTablet for tablet af2df8228f514af5aee2481a5f153280 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:40.377712  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2df8228f514af5aee2481a5f153280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.378151  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9810b426aedc4eb89adfbd103150f39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.381423  1612 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f2e6866214e3e89b342a804e31b9f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:40.350281  1736 ts_tablet_manager.cc:1434] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.005s
I20260709 12:59:40.348249  1742 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.383191  1742 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:40.336546  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 459063895bc847b9a15dc71e10b36267 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:59:40.385064  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459063895bc847b9a15dc71e10b36267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.386237  1737 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:40.386747  1737 ts_tablet_manager.cc:1403] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.011s
I20260709 12:59:40.334216  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 6bb37620691446b2b3ac3e61e48ed81d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:59:40.388018  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb37620691446b2b3ac3e61e48ed81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.336529  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4f26e727a741fa8ca38a41fff1dc1d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:59:40.389031  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4f26e727a741fa8ca38a41fff1dc1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.383596  1736 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:40.392294  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0c15f4fa7246faa2d54502e99a81ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.399849  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 01e623ba813c4c3a8152a1de588cda91 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:40.401328  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831605a002324a04838f4fe562b13530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.396323  1738 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:40.404089  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f2e6866214e3e89b342a804e31b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.389717  1737 raft_consensus.cc:359] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.410315  1742 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:40.418475  1737 raft_consensus.cc:385] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.423324  1738 ts_tablet_manager.cc:1403] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.000s
I20260709 12:59:40.436725  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:59:40.438057  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.440296  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:40.440296  1681 tablet_service.cc:1511] Processing CreateTablet for tablet af2df8228f514af5aee2481a5f153280 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:40.442596  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2df8228f514af5aee2481a5f153280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.444095  1530 tablet_service.cc:1511] Processing CreateTablet for tablet aa0c15f4fa7246faa2d54502e99a81ab (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:59:40.445387  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0c15f4fa7246faa2d54502e99a81ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.430076  1738 raft_consensus.cc:359] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.446781  1738 raft_consensus.cc:385] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.447108  1738 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.447909  1738 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.449126  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:40.449604  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.453397  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 544a0a0b5c034de2956e73d089c51085 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:40.455693  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 01e623ba813c4c3a8152a1de588cda91 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:40.456771  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.350250  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:59:40.474905  1532 tablet_service.cc:1511] Processing CreateTablet for tablet af2df8228f514af5aee2481a5f153280 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:59:40.425625  1737 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.476226  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af2df8228f514af5aee2481a5f153280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.477188  1572 heartbeater.cc:499] Master 127.0.107.254:35005 was elected leader, sending a full tablet report...
I20260709 12:59:40.442091  1685 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f2e6866214e3e89b342a804e31b9f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:40.463701  1607 tablet_service.cc:1511] Processing CreateTablet for tablet a0a119b71a994fd1aeb21c6ba31e339b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:40.456945  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e623ba813c4c3a8152a1de588cda91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.476765  1737 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.486545  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e623ba813c4c3a8152a1de588cda91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.482018  1677 tablet_service.cc:1511] Processing CreateTablet for tablet a0a119b71a994fd1aeb21c6ba31e339b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:40.495674  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f2e6866214e3e89b342a804e31b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.488467  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 544a0a0b5c034de2956e73d089c51085 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:40.498572  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544a0a0b5c034de2956e73d089c51085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.500108  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544a0a0b5c034de2956e73d089c51085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.502100  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a119b71a994fd1aeb21c6ba31e339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.512207  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:40.513933  1537 tablet_service.cc:1511] Processing CreateTablet for tablet ac3f2e6866214e3e89b342a804e31b9f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:59:40.517475  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac3f2e6866214e3e89b342a804e31b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.519954  1682 tablet_service.cc:1511] Processing CreateTablet for tablet be3cc12e24cf42b1b289cee33b288dd9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:40.487923  1736 tablet_bootstrap.cc:654] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.535032  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.535537  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3cc12e24cf42b1b289cee33b288dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.540010  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 10cfcf5f778944b099b75d0b1a19afa0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:40.545624  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cfcf5f778944b099b75d0b1a19afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.549762  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a119b71a994fd1aeb21c6ba31e339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.549960  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:40.555296  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 6548704b45e547b6ab8bc4081d8b3ad7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:40.556104  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 78df79e3d5044daa8ed98fe19b18d0fe (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:40.558729  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 01e623ba813c4c3a8152a1de588cda91 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:59:40.560420  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e623ba813c4c3a8152a1de588cda91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.563304  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 78df79e3d5044daa8ed98fe19b18d0fe (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:40.561221  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 6548704b45e547b6ab8bc4081d8b3ad7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:40.573586  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6548704b45e547b6ab8bc4081d8b3ad7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:40.541745  1661 leader_election.cc:343] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:40.574987  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52180.9us
W20260709 12:59:40.575127  1660 leader_election.cc:343] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.580120  1605 tablet_service.cc:1511] Processing CreateTablet for tablet be3cc12e24cf42b1b289cee33b288dd9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:40.581100  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78df79e3d5044daa8ed98fe19b18d0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.585035  1647 heartbeater.cc:499] Master 127.0.107.254:35005 was elected leader, sending a full tablet report...
I20260709 12:59:40.586474  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3cc12e24cf42b1b289cee33b288dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.602809  1737 ts_tablet_manager.cc:1434] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.216s	user 0.012s	sys 0.028s
I20260709 12:59:40.603927  1737 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:40.603837  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:40.605150  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.606289  1738 ts_tablet_manager.cc:1434] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.181s	user 0.006s	sys 0.024s
I20260709 12:59:40.607018  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:40.608276  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.610384  1737 tablet_bootstrap.cc:654] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.619844  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 10cfcf5f778944b099b75d0b1a19afa0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:40.621209  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cfcf5f778944b099b75d0b1a19afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.612295  1532 tablet_service.cc:1511] Processing CreateTablet for tablet be3cc12e24cf42b1b289cee33b288dd9 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:59:40.622408  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be3cc12e24cf42b1b289cee33b288dd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.618398  1605 tablet_service.cc:1511] Processing CreateTablet for tablet ca134e523abd4f159806116930d9aece (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:40.631541  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca134e523abd4f159806116930d9aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.632227  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 544a0a0b5c034de2956e73d089c51085 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:59:40.633548  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 6548704b45e547b6ab8bc4081d8b3ad7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:59:40.636061  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 78df79e3d5044daa8ed98fe19b18d0fe (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:59:40.548192  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 10cfcf5f778944b099b75d0b1a19afa0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:59:40.638389  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cfcf5f778944b099b75d0b1a19afa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.641194  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:40.642174  1742 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:40.642355  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 86732.4us
I20260709 12:59:40.644964  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6548704b45e547b6ab8bc4081d8b3ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.648247  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78df79e3d5044daa8ed98fe19b18d0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.594316  1531 tablet_service.cc:1511] Processing CreateTablet for tablet a0a119b71a994fd1aeb21c6ba31e339b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:59:40.666448  1738 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:40.668947  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:59:40.670747  1686 tablet_service.cc:1511] Processing CreateTablet for tablet ca134e523abd4f159806116930d9aece (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:40.669204  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544a0a0b5c034de2956e73d089c51085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.704357  1747 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.705010  1747 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.713749  1747 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:40.724856  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a119b71a994fd1aeb21c6ba31e339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.731784  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 20bfd12bbb914d07873fde52411d5fc6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:40.734848  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca134e523abd4f159806116930d9aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.735706  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bfd12bbb914d07873fde52411d5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.740125  1736 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:40.740655  1736 ts_tablet_manager.cc:1403] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.357s	user 0.010s	sys 0.008s
I20260709 12:59:40.734920  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.743633  1736 raft_consensus.cc:359] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.744376  1736 raft_consensus.cc:385] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.744444  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78df79e3d5044daa8ed98fe19b18d0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.744798  1736 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.746502  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6548704b45e547b6ab8bc4081d8b3ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.767417  1746 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.761118  1736 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.767951  1746 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.769589  1736 ts_tablet_manager.cc:1434] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.007s
W20260709 12:59:40.770753  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 73386.8us
I20260709 12:59:40.779909  1746 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:40.784601  1736 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:40.803890  1737 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:40.804452  1737 ts_tablet_manager.cc:1403] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.201s	user 0.019s	sys 0.012s
I20260709 12:59:40.806286  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 20bfd12bbb914d07873fde52411d5fc6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:40.807365  1737 raft_consensus.cc:359] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.811551  1737 raft_consensus.cc:385] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:40.813783  1737 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:40.833408  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 20bfd12bbb914d07873fde52411d5fc6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:59:40.834812  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bfd12bbb914d07873fde52411d5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.829865  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 73951993cbd34d1cbe7ed6fe93812a5f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:40.848989  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bfd12bbb914d07873fde52411d5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.861106  1528 tablet_service.cc:1511] Processing CreateTablet for tablet ca134e523abd4f159806116930d9aece (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:59:40.872504  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 73951993cbd34d1cbe7ed6fe93812a5f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:40.874218  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73951993cbd34d1cbe7ed6fe93812a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.880726  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca134e523abd4f159806116930d9aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.838466  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 73951993cbd34d1cbe7ed6fe93812a5f (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:59:40.900708  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 59f1e89f0b484c16a765a9cbf4b2de05 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:40.854748  1737 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:40.904330  1738 tablet_bootstrap.cc:654] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.904882  1737 ts_tablet_manager.cc:1434] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.100s	user 0.004s	sys 0.004s
I20260709 12:59:40.907049  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8839a7d2844ab8f6a90a60af5556e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:40.909423  1608 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8a969843427fb32b4afb149874ba (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:40.908252  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:40.913533  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 59f1e89f0b484c16a765a9cbf4b2de05 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:40.914726  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:40.915470  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:40.915548  1530 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8a969843427fb32b4afb149874ba (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:59:40.916316  1511 leader_election.cc:343] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.870275  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 12:59:40.923007  1587 leader_election.cc:343] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.925109  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:59:40.926729  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8a969843427fb32b4afb149874ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.921659  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73951993cbd34d1cbe7ed6fe93812a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.931586  1737 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:40.932349  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8839a7d2844ab8f6a90a60af5556e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:40.933665  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8839a7d2844ab8f6a90a60af5556e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.937541  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6d6de7d5b64994853322d5806d6eb0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:40.939288  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73951993cbd34d1cbe7ed6fe93812a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.939639  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.940462  1736 tablet_bootstrap.cc:654] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:40.941438  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8839a7d2844ab8f6a90a60af5556e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.941548  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.947824  1682 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8a969843427fb32b4afb149874ba (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:59:40.950014  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8a969843427fb32b4afb149874ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.960963  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad53e26a3894902b237f56d0f92b47e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:40.962066  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 59f1e89f0b484c16a765a9cbf4b2de05 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:59:40.964381  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f1e89f0b484c16a765a9cbf4b2de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.965317  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f1e89f0b484c16a765a9cbf4b2de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.979614  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2bf53312944dfc854b092b66a8dce2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:40.981433  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:40.981631  1430 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 46195us
W20260709 12:59:40.983352  1512 leader_election.cc:343] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:40.983822  1512 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:40.984982  1746 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:40.990832  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d6de7d5b64994853322d5806d6eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.950495  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8a969843427fb32b4afb149874ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.996939  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad53e26a3894902b237f56d0f92b47e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:40.998425  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.000625  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f1e89f0b484c16a765a9cbf4b2de05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.006949  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad53e26a3894902b237f56d0f92b47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.010944  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2bf53312944dfc854b092b66a8dce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.017391  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad53e26a3894902b237f56d0f92b47e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:41.018846  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55200.5us
I20260709 12:59:41.024442  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.025121  1696 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:41.026492  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.027428  1747 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.027788  1747 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.028123  1747 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:40.973502  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 4ad53e26a3894902b237f56d0f92b47e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:59:41.031909  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad53e26a3894902b237f56d0f92b47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.037725  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 7316b60a2ea04a109142470c7a827717 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:41.039165  1747 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.040989  1737 tablet_bootstrap.cc:654] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.041249  1747 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.042959  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:41.044131  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:41.044656  1696 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:41.051496  1587 leader_election.cc:343] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.053011  1696 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:41.054297  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.057727  1747 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.075124  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 8ba8839a7d2844ab8f6a90a60af5556e (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:59:41.076439  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ba8839a7d2844ab8f6a90a60af5556e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.077435  1736 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.079841  1736 ts_tablet_manager.cc:1403] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.309s	user 0.035s	sys 0.033s
I20260709 12:59:41.084446  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2bf53312944dfc854b092b66a8dce2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:41.086093  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2bf53312944dfc854b092b66a8dce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.046422  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 7c2bf53312944dfc854b092b66a8dce2 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:59:41.094796  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2bf53312944dfc854b092b66a8dce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.110878  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7316b60a2ea04a109142470c7a827717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.136467  1738 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.137012  1738 ts_tablet_manager.cc:1403] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.471s	user 0.024s	sys 0.013s
I20260709 12:59:41.109961  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1e195a7c2407789e8c8a409b95740 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:41.141124  1747 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:41.145712  1747 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.146721  1736 raft_consensus.cc:359] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.151190  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1e195a7c2407789e8c8a409b95740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.155167  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 71f4d9d1d4d740309d74428e0797e9d8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:41.156471  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f4d9d1d4d740309d74428e0797e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.159795  1738 raft_consensus.cc:359] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.160563  1738 raft_consensus.cc:385] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.160857  1738 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.161712  1738 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.168474  1738 ts_tablet_manager.cc:1434] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:59:41.169349  1738 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.174198  1737 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.174727  1737 ts_tablet_manager.cc:1403] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.243s	user 0.009s	sys 0.006s
I20260709 12:59:41.177515  1737 raft_consensus.cc:359] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.178274  1737 raft_consensus.cc:385] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.178592  1737 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.179306  1737 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.172071  1610 tablet_service.cc:1511] Processing CreateTablet for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:41.147449  1736 raft_consensus.cc:385] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.190467  1736 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.181607  1607 tablet_service.cc:1511] Processing CreateTablet for tablet d91481bc55434187a86af0d9c4f9d149 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:41.190680  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.184597  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.185932  1746 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.192103  1746 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.194119  1746 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.195207  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:41.197901  1512 leader_election.cc:343] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.198906  1736 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.199865  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 12:59:41.203425  1511 leader_election.cc:343] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.203856  1511 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.204614  1746 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.205739  1736 ts_tablet_manager.cc:1434] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.126s	user 0.003s	sys 0.016s
I20260709 12:59:41.201751  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a39f263da4577833a605ef819b007 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:41.200148  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91481bc55434187a86af0d9c4f9d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.202217  1737 ts_tablet_manager.cc:1434] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 12:59:41.189854  1738 tablet_bootstrap.cc:654] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:41.138976  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57845us
I20260709 12:59:41.209036  1747 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.216399  1737 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.214799  1747 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.219717  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:41.220491  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a39f263da4577833a605ef819b007. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:41.221239  1587 leader_election.cc:343] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.227540  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 95c7b064bb5640149a09ee01f2a4e2f7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:41.227089  1736 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.230195  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:41.233059  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.233724  1696 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:41.234977  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.235287  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6d6de7d5b64994853322d5806d6eb0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:41.235973  1759 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.236335  1759 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.236600  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d6de7d5b64994853322d5806d6eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.236631  1759 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.228880  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c7b064bb5640149a09ee01f2a4e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.240053  1737 tablet_bootstrap.cc:654] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.239042  1747 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.263451  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 71f4d9d1d4d740309d74428e0797e9d8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:41.263649  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 7316b60a2ea04a109142470c7a827717 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:41.264744  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f4d9d1d4d740309d74428e0797e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.264895  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7316b60a2ea04a109142470c7a827717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.267963  1759 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.268249  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 71f4d9d1d4d740309d74428e0797e9d8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:59:41.268448  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1e195a7c2407789e8c8a409b95740 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:59:41.270092  1759 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.270229  1535 tablet_service.cc:1511] Processing CreateTablet for tablet d91481bc55434187a86af0d9c4f9d149 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:41.270421  1686 tablet_service.cc:1511] Processing CreateTablet for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:41.276325  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91481bc55434187a86af0d9c4f9d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.276232  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:41.279573  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:41.280340  1696 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.283080  1759 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.283582  1759 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.284463  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7d9e12aa94413b57ebc59c8f15757 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:41.286780  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.286792  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:41.288518  1587 leader_election.cc:343] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.235288  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 8e6d6de7d5b64994853322d5806d6eb0 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:59:41.290746  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1e195a7c2407789e8c8a409b95740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.291602  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.286666  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 5ad1e195a7c2407789e8c8a409b95740 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:59:41.293373  1587 leader_election.cc:343] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:41.294075  1587 leader_election.cc:343] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.294464  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.294390  1534 tablet_service.cc:1511] Processing CreateTablet for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:59:41.295398  1747 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.291791  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d6de7d5b64994853322d5806d6eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.296154  1759 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.299657  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.304111  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:41.304085  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 7316b60a2ea04a109142470c7a827717 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:59:41.312487  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:59:41.313858  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a39f263da4577833a605ef819b007 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:41.314054  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 1f9a39f263da4577833a605ef819b007 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:59:41.315594  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 95c7b064bb5640149a09ee01f2a4e2f7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:41.317157  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 95c7b064bb5640149a09ee01f2a4e2f7 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:59:41.334792  1684 tablet_service.cc:1511] Processing CreateTablet for tablet d91481bc55434187a86af0d9c4f9d149 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:59:41.336071  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6369221c274c789a9f8654d6ee9417 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:41.296211  1736 tablet_bootstrap.cc:654] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.327608  1611 tablet_service.cc:1511] Processing CreateTablet for tablet bb5d38534bcc45e19c58dcc3139a4ee6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:41.339440  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7d9e12aa94413b57ebc59c8f15757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.319722  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.340322  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f4d9d1d4d740309d74428e0797e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.328704  1529 tablet_service.cc:1511] Processing CreateTablet for tablet bb5d38534bcc45e19c58dcc3139a4ee6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:41.341490  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c7b064bb5640149a09ee01f2a4e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.322470  1604 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7246dc654e7c82b45abe1250e568 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:41.342458  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5d38534bcc45e19c58dcc3139a4ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.344617  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f43691e2c5a4cc2b9d09a0ebda430e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.345355  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a39f263da4577833a605ef819b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.354926  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5d38534bcc45e19c58dcc3139a4ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.359026  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ad1e195a7c2407789e8c8a409b95740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.360766  1612 tablet_service.cc:1511] Processing CreateTablet for tablet f950ec06ccd64933a117a4c6e6114ed3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:41.361720  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7316b60a2ea04a109142470c7a827717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.362250  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6369221c274c789a9f8654d6ee9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.362633  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c7b064bb5640149a09ee01f2a4e2f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.364969  1696 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:41.367805  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.368669  1759 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.369043  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7246dc654e7c82b45abe1250e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.369156  1759 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:41.370074  1759 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.370872  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91481bc55434187a86af0d9c4f9d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.374830  1607 tablet_service.cc:1511] Processing CreateTablet for tablet f1012ad0f2cf49ff98a60ff466b6246d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:41.376134  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1012ad0f2cf49ff98a60ff466b6246d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.378508  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd5c95713f5c4cfbaf7d6d84b718b4a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.379020  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a39f263da4577833a605ef819b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.386534  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f950ec06ccd64933a117a4c6e6114ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.390524  1738 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.391076  1738 ts_tablet_manager.cc:1403] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.007s
I20260709 12:59:41.394018  1738 raft_consensus.cc:359] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.395517  1682 tablet_service.cc:1511] Processing CreateTablet for tablet bb5d38534bcc45e19c58dcc3139a4ee6 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:59:41.399621  1677 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7246dc654e7c82b45abe1250e568 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:41.400943  1736 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.403873  1738 raft_consensus.cc:385] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.407655  1738 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.408413  1738 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.412443  1737 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.412915  1737 ts_tablet_manager.cc:1403] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.197s	user 0.006s	sys 0.041s
I20260709 12:59:41.414821  1736 ts_tablet_manager.cc:1403] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.003s
I20260709 12:59:41.415958  1737 raft_consensus.cc:359] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.416694  1737 raft_consensus.cc:385] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.417012  1737 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.417773  1737 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.418879  1736 raft_consensus.cc:359] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.419610  1736 raft_consensus.cc:385] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.419893  1736 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.424577  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7d9e12aa94413b57ebc59c8f15757 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:41.425848  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7d9e12aa94413b57ebc59c8f15757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.436044  1737 ts_tablet_manager.cc:1434] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:59:41.437096  1737 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.439241  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5d38534bcc45e19c58dcc3139a4ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.440182  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7246dc654e7c82b45abe1250e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.442924  1736 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.445622  1736 ts_tablet_manager.cc:1434] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:59:41.449051  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 10a7d9e12aa94413b57ebc59c8f15757 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:59:41.450459  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7d9e12aa94413b57ebc59c8f15757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.410538  1738 ts_tablet_manager.cc:1434] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.003s
I20260709 12:59:41.455672  1738 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.459544  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6369221c274c789a9f8654d6ee9417 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:41.460837  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6369221c274c789a9f8654d6ee9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.460749  1683 tablet_service.cc:1511] Processing CreateTablet for tablet f950ec06ccd64933a117a4c6e6114ed3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:41.430083  1535 tablet_service.cc:1511] Processing CreateTablet for tablet c19c7246dc654e7c82b45abe1250e568 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:59:41.461927  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6369221c274c789a9f8654d6ee9417 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:59:41.463151  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7246dc654e7c82b45abe1250e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.473284  1736 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.476974  1738 tablet_bootstrap.cc:654] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.478893  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f950ec06ccd64933a117a4c6e6114ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.479539  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6369221c274c789a9f8654d6ee9417. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:41.485065  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:41.495575  1529 tablet_service.cc:1511] Processing CreateTablet for tablet f1012ad0f2cf49ff98a60ff466b6246d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:41.495695  1532 tablet_service.cc:1511] Processing CreateTablet for tablet f950ec06ccd64933a117a4c6e6114ed3 (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:59:41.496918  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1012ad0f2cf49ff98a60ff466b6246d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.502187  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f950ec06ccd64933a117a4c6e6114ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.517992  1737 tablet_bootstrap.cc:654] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.522647  1444 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.526401  1686 tablet_service.cc:1511] Processing CreateTablet for tablet f1012ad0f2cf49ff98a60ff466b6246d (DEFAULT_TABLE table=test-workload [id=2278984311854ca08e9bf2ced4e25fcd]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:59:41.528700  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1012ad0f2cf49ff98a60ff466b6246d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:41.515904  1736 tablet_bootstrap.cc:654] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.550797  1742 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.551971  1742 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.568622  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:41.570133  1661 leader_election.cc:343] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.584244  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.584177  1742 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.584162  1759 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:41.586583  1747 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.587109  1747 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:41.588195  1660 leader_election.cc:343] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.588655  1660 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.589119  1738 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.589632  1738 ts_tablet_manager.cc:1403] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.016s
I20260709 12:59:41.589495  1747 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.592182  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.592489  1738 raft_consensus.cc:359] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.593312  1738 raft_consensus.cc:385] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.593158  1742 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.592204  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:41.595160  1587 leader_election.cc:343] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.596186  1746 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.596730  1737 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.596618  1746 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.597270  1737 ts_tablet_manager.cc:1403] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.160s	user 0.019s	sys 0.004s
I20260709 12:59:41.598363  1746 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.599547  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.600234  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.600791  1737 raft_consensus.cc:359] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:41.601753  1512 leader_election.cc:343] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.593699  1738 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
W20260709 12:59:41.603142  1511 leader_election.cc:343] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:41.604357  1587 leader_election.cc:343] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.605391  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.606142  1747 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.606539  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.607286  1746 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.608331  1738 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } }
I20260709 12:59:41.618991  1738 ts_tablet_manager.cc:1434] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:59:41.602174  1737 raft_consensus.cc:385] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.619621  1737 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.620375  1737 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.622166  1737 ts_tablet_manager.cc:1434] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:59:41.624560  1737 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.631372  1737 tablet_bootstrap.cc:654] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.634174  1738 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.643193  1737 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.643709  1737 ts_tablet_manager.cc:1403] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:59:41.646662  1737 raft_consensus.cc:359] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.647436  1737 raft_consensus.cc:385] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.647706  1737 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.648326  1737 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.651901  1738 tablet_bootstrap.cc:654] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.655556  1737 ts_tablet_manager.cc:1434] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:59:41.656970  1736 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.658151  1736 ts_tablet_manager.cc:1403] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.212s	user 0.011s	sys 0.004s
I20260709 12:59:41.658561  1737 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.664341  1736 raft_consensus.cc:359] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.665154  1736 raft_consensus.cc:385] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.665536  1736 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.666491  1736 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:41.667327  1587 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:41.668283  1736 ts_tablet_manager.cc:1434] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:59:41.669485  1736 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.670899  1771 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.671676  1771 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.676286  1737 tablet_bootstrap.cc:654] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.680169  1736 tablet_bootstrap.cc:654] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.681111  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:41.683861  1738 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.685322  1738 ts_tablet_manager.cc:1403] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.008s
I20260709 12:59:41.685360  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.686091  1622 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:41.687320  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:41.688271  1742 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.688591  1738 raft_consensus.cc:359] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.689324  1738 raft_consensus.cc:385] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:59:41.689512  1661 leader_election.cc:343] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.689618  1738 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.688629  1742 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.690282  1742 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.690382  1738 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.692746  1738 ts_tablet_manager.cc:1434] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:41.684417  1771 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.694341  1737 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.694964  1737 ts_tablet_manager.cc:1403] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.016s
I20260709 12:59:41.700136  1738 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.700850  1742 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.701758  1736 tablet_bootstrap.cc:492] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.702273  1736 ts_tablet_manager.cc:1403] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
I20260709 12:59:41.703842  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:41.705384  1661 leader_election.cc:343] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.706995  1736 raft_consensus.cc:359] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.707813  1738 tablet_bootstrap.cc:654] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.707769  1736 raft_consensus.cc:385] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.708246  1736 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.709025  1736 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.712076  1736 ts_tablet_manager.cc:1434] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:41.711869  1737 raft_consensus.cc:359] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.712746  1737 raft_consensus.cc:385] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.713086  1737 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.713757  1736 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.718284  1771 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.718709  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:41.719364  1622 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.719003  1771 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.721743  1771 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.718268  1742 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.722911  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:41.723621  1547 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:41.725741  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.726449  1621 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:41.727478  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:41.729072  1742 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.729393  1742 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.729660  1742 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.731101  1736 tablet_bootstrap.cc:654] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.731177  1622 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:41.732319  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:41.732996  1737 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.733711  1771 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.737341  1738 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.738200  1738 ts_tablet_manager.cc:1403] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.040s	user 0.003s	sys 0.023s
I20260709 12:59:41.739497  1742 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.746229  1771 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:41.748912  1737 ts_tablet_manager.cc:1434] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 12:59:41.749790  1771 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.750660  1738 raft_consensus.cc:359] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.751457  1738 raft_consensus.cc:385] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.751796  1738 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.752599  1738 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.754204  1737 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.756614  1742 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.756327  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:41.757550  1736 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.763092  1547 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.757936  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:41.763588  1736 ts_tablet_manager.cc:1403] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.014s
I20260709 12:59:41.763734  1622 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.765188  1442 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.767243  1736 raft_consensus.cc:359] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.768080  1736 raft_consensus.cc:385] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.768460  1736 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.769296  1736 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.770676  1622 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:41.771839  1547 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:41.756099  1738 ts_tablet_manager.cc:1434] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:59:41.773007  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:41.773836  1742 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:41.774500  1736 ts_tablet_manager.cc:1434] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:41.776702  1738 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.774466  1742 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:41.777604  1742 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.779366  1736 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.784245  1738 tablet_bootstrap.cc:654] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.785828  1736 tablet_bootstrap.cc:654] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.791839  1737 tablet_bootstrap.cc:654] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.794066  1738 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.794575  1738 ts_tablet_manager.cc:1403] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:59:41.798180  1738 raft_consensus.cc:359] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.799707  1738 raft_consensus.cc:385] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.799654  1547 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.800228  1759 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:41.802718  1738 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.808003  1738 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.810529  1738 ts_tablet_manager.cc:1434] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:59:41.811640  1738 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.811890  1444 catalog_manager.cc:5697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.819300  1738 tablet_bootstrap.cc:654] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.829413  1736 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.829892  1736 ts_tablet_manager.cc:1403] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.023s
I20260709 12:59:41.829504  1759 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:41.833169  1736 raft_consensus.cc:359] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.837157  1736 raft_consensus.cc:385] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.837424  1736 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.838058  1736 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.839840  1737 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.840070  1736 ts_tablet_manager.cc:1434] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:59:41.840804  1737 ts_tablet_manager.cc:1403] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.087s	user 0.003s	sys 0.016s
I20260709 12:59:41.841629  1736 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.843935  1737 raft_consensus.cc:359] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.845451  1737 raft_consensus.cc:385] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.847301  1738 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.848191  1737 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.848451  1738 ts_tablet_manager.cc:1403] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 12:59:41.848873  1737 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.850823  1737 ts_tablet_manager.cc:1434] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:41.851001  1738 raft_consensus.cc:359] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.851683  1737 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.851631  1738 raft_consensus.cc:385] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.852036  1738 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.852798  1738 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.854943  1738 ts_tablet_manager.cc:1434] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:41.854763  1746 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.856317  1738 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.855893  1746 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.857918  1737 tablet_bootstrap.cc:654] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.847921  1736 tablet_bootstrap.cc:654] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.860072  1771 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.860770  1771 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.866720  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.867931  1622 raft_consensus.cc:2393] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 12:59:41.870337  1738 tablet_bootstrap.cc:654] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.873379  1771 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.874992  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:41.876924  1661 leader_election.cc:343] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.879446  1736 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.880059  1736 ts_tablet_manager.cc:1403] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.009s
I20260709 12:59:41.882025  1746 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.874979  1737 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:41.882809  1737 ts_tablet_manager.cc:1403] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.003s
I20260709 12:59:41.883181  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.883183  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 12:59:41.885388  1660 leader_election.cc:343] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.885500  1512 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.885814  1736 raft_consensus.cc:359] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.885898  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.886531  1736 raft_consensus.cc:385] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.886859  1736 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.887401  1759 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.887523  1736 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.887981  1738 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.888509  1738 ts_tablet_manager.cc:1403] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.033s	user 0.025s	sys 0.000s
I20260709 12:59:41.888682  1742 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.890542  1736 ts_tablet_manager.cc:1434] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:41.891665  1737 raft_consensus.cc:359] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.891811  1738 raft_consensus.cc:359] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.887946  1759 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.893326  1736 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.892220  1746 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.914301  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:41.892356  1737 raft_consensus.cc:385] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.915365  1546 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:41.917228  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:41.918087  1747 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.915355  1737 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.919000  1746 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.918658  1747 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.892412  1738 raft_consensus.cc:385] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.919117  1737 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.919730  1747 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.919759  1738 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.920760  1738 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.921397  1737 ts_tablet_manager.cc:1434] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.038s	user 0.013s	sys 0.002s
I20260709 12:59:41.922288  1737 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:41.922778  1738 ts_tablet_manager.cc:1434] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.034s	user 0.014s	sys 0.012s
I20260709 12:59:41.923593  1738 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.925958  1746 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.926426  1746 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.928140  1737 tablet_bootstrap.cc:654] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.929458  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:41.933070  1736 tablet_bootstrap.cc:654] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.933874  1738 tablet_bootstrap.cc:654] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.934198  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:41.936077  1587 leader_election.cc:343] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.939217  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.941444  1512 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:41.942015  1759 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.946736  1746 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.947813  1746 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:41.951921  1736 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:41.952468  1736 ts_tablet_manager.cc:1403] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.009s
I20260709 12:59:41.955304  1736 raft_consensus.cc:359] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.955947  1736 raft_consensus.cc:385] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.956133  1738 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:41.956233  1736 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.956609  1738 ts_tablet_manager.cc:1403] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:59:41.957518  1759 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.958142  1759 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.959965  1738 raft_consensus.cc:359] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.960752  1738 raft_consensus.cc:385] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:41.961027  1738 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:41.961973  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:41.962298  1738 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.962890  1546 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:41.964555  1738 ts_tablet_manager.cc:1434] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:59:41.964749  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:41.965480  1738 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:41.966180  1790 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:41.966737  1790 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.959977  1736 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.967154  1790 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:41.972906  1738 tablet_bootstrap.cc:654] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:41.973480  1736 ts_tablet_manager.cc:1434] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:59:41.977592  1736 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:41.980132  1771 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.980841  1771 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.984477  1771 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:41.994319  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:41.953832  1747 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:41.998155  1747 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.002194  1738 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.002204  1737 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.004024  1695 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.004848  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.004913  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.004047  1738 ts_tablet_manager.cc:1403] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.020s
I20260709 12:59:42.005736  1737 ts_tablet_manager.cc:1403] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.017s
W20260709 12:59:42.006204  1661 leader_election.cc:343] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:41.985302  1759 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:41.982370  1790 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.004238  1747 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.009770  1790 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.010046  1747 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.012840  1622 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.015509  1736 tablet_bootstrap.cc:654] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.015682  1747 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.016264  1660 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.017822  1771 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.018227  1771 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.018565  1771 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.020929  1737 raft_consensus.cc:359] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.021651  1737 raft_consensus.cc:385] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.021971  1737 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.022127  1738 raft_consensus.cc:359] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.022871  1738 raft_consensus.cc:385] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.023159  1738 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.023355  1737 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.023891  1738 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.025910  1737 ts_tablet_manager.cc:1434] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.005s
I20260709 12:59:42.026165  1738 ts_tablet_manager.cc:1434] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:59:42.026134  1771 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.027026  1737 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.027227  1738 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.029111  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:42.030869  1661 leader_election.cc:343] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.031762  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.032366  1547 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.033946  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.034536  1695 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.035748  1737 tablet_bootstrap.cc:654] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.040710  1771 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.041960  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.042583  1622 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.044799  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.045331  1546 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.046761  1547 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:42.047254  1738 tablet_bootstrap.cc:654] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.047641  1695 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:42.049235  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.049839  1696 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.051704  1736 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.052230  1736 ts_tablet_manager.cc:1403] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.006s
I20260709 12:59:42.053398  1546 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:42.053982  1622 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.055820  1660 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.056820  1736 raft_consensus.cc:359] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.057474  1736 raft_consensus.cc:385] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.057742  1736 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.058416  1771 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.058367  1736 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.059851  1771 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:42.060367  1736 ts_tablet_manager.cc:1434] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:59:42.060696  1771 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.061277  1736 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.062952  1696 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:42.066321  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.068331  1736 tablet_bootstrap.cc:654] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.069805  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.075913  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.077296  1801 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.077937  1801 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:42.079020  1801 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.085067  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.086254  1790 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.086918  1790 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:42.088050  1790 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.090075  1737 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.090744  1737 ts_tablet_manager.cc:1403] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.018s
I20260709 12:59:42.094602  1737 raft_consensus.cc:359] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.095372  1737 raft_consensus.cc:385] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.095686  1737 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.096738  1738 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.096379  1737 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:42.098003  1587 leader_election.cc:343] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.098037  1738 ts_tablet_manager.cc:1403] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.022s
I20260709 12:59:42.099128  1736 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.099555  1736 ts_tablet_manager.cc:1403] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.012s
I20260709 12:59:42.100757  1737 ts_tablet_manager.cc:1434] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:59:42.101711  1737 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.101444  1738 raft_consensus.cc:359] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.102097  1738 raft_consensus.cc:385] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.102455  1736 raft_consensus.cc:359] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.103641  1736 raft_consensus.cc:385] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.103931  1736 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.104662  1736 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.106904  1736 ts_tablet_manager.cc:1434] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:42.107875  1736 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.109308  1587 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.110106  1747 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.109551  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.113973  1736 tablet_bootstrap.cc:654] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.114254  1737 tablet_bootstrap.cc:654] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.126580  1737 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.126814  1736 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.127075  1737 ts_tablet_manager.cc:1403] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.003s
I20260709 12:59:42.127398  1736 ts_tablet_manager.cc:1403] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:59:42.102380  1738 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.130888  1736 raft_consensus.cc:359] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.131762  1736 raft_consensus.cc:385] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.132054  1736 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.133153  1736 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.134232  1738 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.135383  1736 ts_tablet_manager.cc:1434] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:59:42.136307  1738 ts_tablet_manager.cc:1434] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:59:42.136312  1736 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.139546  1790 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.140038  1790 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.141114  1737 raft_consensus.cc:359] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.141803  1737 raft_consensus.cc:385] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.142043  1737 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.142912  1790 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.142688  1737 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.144753  1737 ts_tablet_manager.cc:1434] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:59:42.145642  1737 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.146173  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.146791  1736 tablet_bootstrap.cc:654] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.148797  1738 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.148411  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.152356  1737 tablet_bootstrap.cc:654] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.155997  1444 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.158030  1444 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:42.148518  1587 leader_election.cc:343] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:42.162081  1587 leader_election.cc:343] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.162537  1587 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.163322  1790 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.168080  1738 tablet_bootstrap.cc:654] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.168272  1792 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.168784  1792 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.170483  1792 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.171697  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.172848  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.173357  1737 tablet_bootstrap.cc:492] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.173764  1737 ts_tablet_manager.cc:1403] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.007s
W20260709 12:59:42.176028  1512 leader_election.cc:343] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:42.177152  1511 leader_election.cc:343] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.177582  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.178707  1792 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.180013  1737 raft_consensus.cc:359] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.180681  1737 raft_consensus.cc:385] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.180928  1737 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.181653  1737 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.183400  1736 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.184015  1736 ts_tablet_manager.cc:1403] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.009s
I20260709 12:59:42.185691  1737 ts_tablet_manager.cc:1434] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:59:42.186691  1737 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.186986  1771 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.187897  1771 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.190081  1771 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.192085  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:42.193588  1661 leader_election.cc:343] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.194265  1771 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.194855  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.195451  1622 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.197034  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.198076  1742 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.198506  1742 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.198948  1742 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.199945  1737 tablet_bootstrap.cc:654] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.201483  1771 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.201956  1771 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.197847  1736 raft_consensus.cc:359] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.202881  1736 raft_consensus.cc:385] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.203125  1736 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.203714  1736 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.204905  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.205478  1736 ts_tablet_manager.cc:1434] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.002s
I20260709 12:59:42.206663  1781 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.207755  1771 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.205508  1546 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.208470  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.211557  1622 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.213029  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.214107  1781 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.214849  1781 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.216399  1781 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.237064  1771 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.244263  1547 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.237984  1742 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.250909  1742 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.252404  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.253135  1621 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.254127  1737 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.254585  1737 ts_tablet_manager.cc:1403] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.030s
I20260709 12:59:42.256750  1738 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.257288  1738 ts_tablet_manager.cc:1403] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.010s
I20260709 12:59:42.260793  1736 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.259833  1737 raft_consensus.cc:359] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.261263  1737 raft_consensus.cc:385] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.261530  1737 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.262300  1737 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.264637  1737 ts_tablet_manager.cc:1434] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:59:42.265547  1737 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.267501  1621 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.268822  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.269835  1742 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.270341  1742 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:42.271487  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.272125  1738 raft_consensus.cc:359] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.272796  1738 raft_consensus.cc:385] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.273085  1738 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.273864  1738 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.277971  1738 ts_tablet_manager.cc:1434] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:59:42.279198  1738 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.282593  1737 tablet_bootstrap.cc:654] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.283006  1781 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.285292  1742 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.286964  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.287631  1622 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.288733  1738 tablet_bootstrap.cc:654] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.296267  1792 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.296793  1792 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.299881  1736 tablet_bootstrap.cc:654] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.300570  1792 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.301713  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.302768  1621 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:42.304821  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.305714  1792 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.306154  1792 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.307559  1792 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.319983  1790 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.320561  1790 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.323383  1790 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.303896  1781 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.326382  1737 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.325045  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.327093  1737 ts_tablet_manager.cc:1403] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.008s
W20260709 12:59:42.328336  1587 leader_election.cc:343] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.327992  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.329107  1696 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.333267  1737 raft_consensus.cc:359] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.333775  1737 raft_consensus.cc:385] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.333941  1737 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.334370  1737 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:42.327847  1661 leader_election.cc:343] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.336948  1792 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.341476  1738 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.341885  1738 ts_tablet_manager.cc:1403] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.002s
I20260709 12:59:42.344342  1737 ts_tablet_manager.cc:1434] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:59:42.344749  1792 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.346609  1737 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.343854  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.347662  1622 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.348805  1621 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.345749  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.350837  1790 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.351244  1790 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.351557  1790 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.352399  1823 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:59:42.354487  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.355348  1823 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.355793  1823 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:42.356722  1823 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.358842  1621 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:42.360052  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.361714  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.361949  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.362598  1547 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.365793  1799 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.365959  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.366336  1799 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:42.367203  1799 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:42.372143  1512 leader_election.cc:343] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.378118  1738 raft_consensus.cc:359] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.379230  1738 raft_consensus.cc:385] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.380456  1738 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.380731  1746 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.381243  1746 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.381466  1738 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.377836  1747 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.383307  1747 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.384483  1738 ts_tablet_manager.cc:1434] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 12:59:42.387652  1737 tablet_bootstrap.cc:654] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.387652  1738 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.387995  1746 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:42.380731  1512 leader_election.cc:343] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.386392  1747 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.383595  1790 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.392612  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.393318  1695 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.379271  1771 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.397328  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.398180  1747 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.398554  1747 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.398913  1747 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.396725  1771 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.412612  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.413507  1619 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.410988  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.415124  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.425289  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.425980  1546 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:42.428712  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.429559  1545 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.429800  1826 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.430414  1826 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.430892  1826 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.432981  1792 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.433682  1792 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.436980  1792 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.438508  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.428066  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.439435  1619 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:42.439777  1695 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:42.441030  1511 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.442090  1792 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.442538  1792 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.443001  1792 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.447449  1547 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.455092  1792 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.459712  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.459987  1792 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.459930  1512 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:42.460497  1619 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.460865  1792 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.411917  1771 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.466159  1736 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.466652  1736 ts_tablet_manager.cc:1403] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.237s	user 0.018s	sys 0.017s
I20260709 12:59:42.470448  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.471179  1444 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.473295  1444 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:42.474066  1587 leader_election.cc:343] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.474285  1790 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.476083  1736 raft_consensus.cc:359] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.476828  1736 raft_consensus.cc:385] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.461826  1792 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.477181  1736 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.478660  1792 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.479194  1736 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.480777  1737 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.481290  1737 ts_tablet_manager.cc:1403] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.005s
I20260709 12:59:42.481966  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.483399  1736 ts_tablet_manager.cc:1434] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:59:42.484050  1736 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.484891  1695 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:42.493147  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:42.494037  1792 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.494645  1695 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:42.495440  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.476810  1619 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:42.496840  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.497349  1792 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.498973  1547 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.504421  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.505843  1790 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.506563  1790 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:42.506649  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.507313  1694 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.507051  1801 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.509006  1511 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.507994  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 12:59:42.511262  1512 leader_election.cc:343] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:42.512243  1512 leader_election.cc:343] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.514039  1442 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.517360  1799 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.517200  1826 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.517925  1799 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:42.518786  1799 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.507820  1790 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.522832  1694 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:42.524188  1512 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.525653  1830 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.525681  1771 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.526379  1830 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:42.526393  1771 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.527769  1830 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.528560  1738 tablet_bootstrap.cc:654] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.531525  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.528611  1771 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.500365  1747 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:42.533339  1660 leader_election.cc:343] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.541872  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:42.546545  1661 leader_election.cc:343] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.547420  1661 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.548614  1771 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.552461  1621 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:42.553447  1826 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.555832  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:42.556694  1622 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.557637  1736 tablet_bootstrap.cc:654] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.563602  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.566246  1622 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.567854  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.567905  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.569018  1694 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 1: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 12:59:42.569118  1747 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.570533  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.572522  1826 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.575404  1826 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:42.577750  1826 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.579250  1771 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.572670  1747 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.583781  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:42.584491  1547 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.587975  1737 raft_consensus.cc:359] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.590162  1737 raft_consensus.cc:385] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.590588  1737 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.591044  1801 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.591464  1737 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.593814  1737 ts_tablet_manager.cc:1434] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.112s	user 0.000s	sys 0.004s
I20260709 12:59:42.598439  1819 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:42.608085  1737 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.620337  1801 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.621133  1801 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.625459  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.617651  1443 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:42.628219  1587 leader_election.cc:343] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.600118  1442 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.634356  1747 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.639955  1801 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.616961  1444 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.641829  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.642503  1694 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.644402  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.646417  1747 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.646982  1747 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.647468  1747 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.645012  1801 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.663743  1547 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:42.630268  1442 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.673408  1747 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.679579  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:42.680965  1587 leader_election.cc:343] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.684366  1747 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.686059  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:42.688966  1695 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.687458  1830 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.646421  1737 tablet_bootstrap.cc:654] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.690714  1830 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.693379  1830 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.695755  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.697253  1695 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
W20260709 12:59:42.697381  1511 leader_election.cc:343] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.698376  1737 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.698846  1737 ts_tablet_manager.cc:1403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.091s	user 0.006s	sys 0.009s
I20260709 12:59:42.698676  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.699844  1790 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:42.700100  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.700305  1790 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:42.701335  1736 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
W20260709 12:59:42.702980  1512 leader_election.cc:343] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.703339  1738 tablet_bootstrap.cc:492] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.703480  1736 ts_tablet_manager.cc:1403] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.220s	user 0.021s	sys 0.022s
I20260709 12:59:42.702327  1801 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.703421  1512 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.701664  1790 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.703799  1738 ts_tablet_manager.cc:1403] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.316s	user 0.031s	sys 0.049s
I20260709 12:59:42.704160  1801 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.709543  1830 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.717842  1823 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.725091  1737 raft_consensus.cc:359] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.726078  1737 raft_consensus.cc:385] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.726418  1737 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.736691  1737 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.739765  1738 raft_consensus.cc:359] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.740454  1738 raft_consensus.cc:385] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.740737  1738 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.741400  1738 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.743377  1738 ts_tablet_manager.cc:1434] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.038s	user 0.027s	sys 0.010s
I20260709 12:59:42.744218  1738 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.748315  1737 ts_tablet_manager.cc:1434] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:59:42.750766  1737 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.752921  1736 raft_consensus.cc:359] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.753629  1736 raft_consensus.cc:385] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.754009  1736 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.753443  1801 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.756040  1736 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.759545  1736 ts_tablet_manager.cc:1434] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.003s
I20260709 12:59:42.760679  1736 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
W20260709 12:59:42.766057  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62867.7us
I20260709 12:59:42.768020  1826 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.769733  1830 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:42.770364  1799 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.773761  1799 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.772853  1826 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.777956  1738 tablet_bootstrap.cc:654] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.779942  1826 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:42.780421  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:42.781949  1661 leader_election.cc:343] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.781952  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.782989  1799 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.784469  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:42.784462  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:42.785847  1660 leader_election.cc:343] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.785674  1694 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:42.786325  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.787478  1826 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.788260  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:42.790452  1799 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.790449  1737 tablet_bootstrap.cc:654] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.800181  1799 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.801748  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:42.816579  1661 consensus_peers.cc:597] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.819878  1771 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:42.821710  1587 leader_election.cc:343] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.822080  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:42.829236  1587 leader_election.cc:343] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:42.829869  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:42.831259  1790 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:42.844686  1736 tablet_bootstrap.cc:654] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.846553  1738 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.847353  1738 ts_tablet_manager.cc:1403] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.011s
I20260709 12:59:42.850333  1737 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.850436  1738 raft_consensus.cc:359] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.850821  1737 ts_tablet_manager.cc:1403] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.100s	user 0.029s	sys 0.020s
I20260709 12:59:42.851114  1738 raft_consensus.cc:385] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.851384  1738 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
W20260709 12:59:42.851446  1512 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:42.852166  1738 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.853480  1737 raft_consensus.cc:359] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.860824  1737 raft_consensus.cc:385] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.861081  1737 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.861629  1738 ts_tablet_manager.cc:1434] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:59:42.861729  1737 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.863031  1738 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.863858  1737 ts_tablet_manager.cc:1434] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:59:42.864730  1737 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.869134  1738 tablet_bootstrap.cc:654] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.869135  1820 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:42.870301  1737 tablet_bootstrap.cc:654] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.870428  1442 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.885555  1738 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.885983  1738 ts_tablet_manager.cc:1403] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 12:59:42.886760  1736 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.887187  1736 ts_tablet_manager.cc:1403] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.009s
I20260709 12:59:42.891988  1737 tablet_bootstrap.cc:492] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.892419  1737 ts_tablet_manager.cc:1403] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 12:59:42.892594  1738 raft_consensus.cc:359] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.893260  1738 raft_consensus.cc:385] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.893538  1738 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.894492  1737 raft_consensus.cc:359] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.894862  1738 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.895200  1737 raft_consensus.cc:385] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.895578  1737 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.896276  1737 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.896301  1736 raft_consensus.cc:359] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.897351  1736 raft_consensus.cc:385] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.897303  1738 ts_tablet_manager.cc:1434] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:59:42.897699  1736 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.898515  1738 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.898974  1737 ts_tablet_manager.cc:1434] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:59:42.898491  1736 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.900674  1736 ts_tablet_manager.cc:1434] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:42.902160  1736 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.903668  1737 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.904815  1738 tablet_bootstrap.cc:654] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.912366  1737 tablet_bootstrap.cc:654] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.919664  1738 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.920111  1738 ts_tablet_manager.cc:1403] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:59:42.920814  1737 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.921303  1737 ts_tablet_manager.cc:1403] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:59:42.921573  1736 tablet_bootstrap.cc:654] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.922699  1738 raft_consensus.cc:359] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.923786  1738 raft_consensus.cc:385] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.924049  1738 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.924521  1737 raft_consensus.cc:359] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.924834  1738 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.925235  1737 raft_consensus.cc:385] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.925587  1737 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.926260  1737 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.928987  1737 ts_tablet_manager.cc:1434] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:42.929869  1737 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.933804  1736 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:42.934262  1736 ts_tablet_manager.cc:1403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 12:59:42.934352  1738 ts_tablet_manager.cc:1434] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:59:42.935330  1738 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.936204  1737 tablet_bootstrap.cc:654] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.937242  1736 raft_consensus.cc:359] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.937898  1736 raft_consensus.cc:385] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.938164  1736 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.939061  1736 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.942765  1738 tablet_bootstrap.cc:654] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.947860  1736 ts_tablet_manager.cc:1434] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 12:59:42.948798  1736 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:42.958739  1736 tablet_bootstrap.cc:654] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.961968  1790 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.962524  1790 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.964679  1737 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:42.965134  1737 ts_tablet_manager.cc:1403] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.012s
I20260709 12:59:42.965253  1790 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:42.965617  1738 tablet_bootstrap.cc:492] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:42.966063  1738 ts_tablet_manager.cc:1403] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 12:59:42.968163  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:42.968422  1737 raft_consensus.cc:359] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.969094  1737 raft_consensus.cc:385] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.969004  1546 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.969466  1737 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.969640  1738 raft_consensus.cc:359] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.970244  1738 raft_consensus.cc:385] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:42.970590  1738 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:42.970280  1737 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.971406  1738 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:42.972085  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:42.972452  1737 ts_tablet_manager.cc:1434] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:42.970386  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:42.974081  1694 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:42.973578  1790 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:42.976949  1737 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:42.979656  1790 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.980314  1790 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.978806  1738 ts_tablet_manager.cc:1434] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:59:42.982569  1738 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:42.987169  1737 tablet_bootstrap.cc:654] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:42.993315  1694 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:42.996702  1799 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.997359  1799 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.000191  1799 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.000422  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.001083  1622 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:43.002287  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.002951  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.003121  1799 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.003497  1799 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.003844  1799 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:43.004884  1512 leader_election.cc:343] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.006244  1736 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.006723  1736 ts_tablet_manager.cc:1403] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.020s
I20260709 12:59:43.008564  1830 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.009418  1736 raft_consensus.cc:359] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.010078  1736 raft_consensus.cc:385] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.010350  1736 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.011037  1736 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.012174  1790 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.016425  1790 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.016449  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.017311  1546 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.017608  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.018193  1694 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.020071  1736 ts_tablet_manager.cc:1434] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:59:43.021030  1736 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.025681  1738 tablet_bootstrap.cc:654] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.028298  1736 tablet_bootstrap.cc:654] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.033766  1799 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.038515  1694 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:43.039806  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.040949  1849 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.041560  1849 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:43.042694  1849 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.043382  1830 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.050590  1546 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:43.053650  1799 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.054041  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:43.055119  1622 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.056825  1736 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.057287  1736 ts_tablet_manager.cc:1403] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.005s
I20260709 12:59:43.072703  1736 raft_consensus.cc:359] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.073649  1736 raft_consensus.cc:385] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.074011  1736 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.074617  1792 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:43.074752  1799 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:43.073870  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.077378  1736 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.079082  1694 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.081838  1736 ts_tablet_manager.cc:1434] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:59:43.083251  1736 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.085253  1820 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.085772  1820 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.074894  1622 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:43.094859  1747 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.095328  1820 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.110631  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.111501  1546 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:43.102535  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.107697  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.114078  1443 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.115562  1799 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.114436  1622 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:43.116025  1799 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:43.116865  1799 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.119240  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:43.120442  1736 tablet_bootstrap.cc:654] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.121023  1820 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.121424  1820 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.125361  1820 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.125569  1792 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.125598  1738 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.126048  1792 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:43.145915  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:43.134589  1792 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.162631  1694 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:43.145980  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.167829  1737 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.160090  1738 ts_tablet_manager.cc:1403] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.178s	user 0.015s	sys 0.023s
I20260709 12:59:43.168457  1737 ts_tablet_manager.cc:1403] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.192s	user 0.035s	sys 0.030s
I20260709 12:59:43.167578  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.170342  1849 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.171430  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:43.171109  1849 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.178474  1792 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.181830  1819 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:43.182410  1849 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.183394  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:43.183492  1872 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:59:43.184046  1696 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.185328  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.186365  1737 raft_consensus.cc:359] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.187448  1737 raft_consensus.cc:385] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.187798  1737 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.188640  1737 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.186548  1849 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.194485  1849 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.195003  1849 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.196039  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:43.198666  1587 leader_election.cc:343] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.205317  1737 ts_tablet_manager.cc:1434] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 12:59:43.206602  1737 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.169888  1820 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.227305  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.227898  1546 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.230023  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:43.230564  1622 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.225689  1820 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.231515  1820 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.232666  1738 raft_consensus.cc:359] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.234354  1738 raft_consensus.cc:385] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.234650  1738 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.235775  1738 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.237665  1738 ts_tablet_manager.cc:1434] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.001s
I20260709 12:59:43.238474  1738 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.238716  1445 catalog_manager.cc:5697] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.243000  1849 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.244905  1849 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.245255  1547 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.253439  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.254274  1694 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.260469  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:43.264856  1587 leader_election.cc:343] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.265729  1737 tablet_bootstrap.cc:654] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.298775  1851 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:43.304210  1694 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:43.305780  1622 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:43.308781  1738 tablet_bootstrap.cc:654] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.313807  1830 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.318979  1830 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.325843  1830 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.326659  1849 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.327277  1849 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.327418  1747 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.328573  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.330117  1849 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:43.330439  1512 leader_election.cc:343] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.331542  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.335498  1622 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:43.329366  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.332763  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:43.348034  1747 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.349802  1820 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.350863  1820 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:43.351249  1747 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:43.352347  1820 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.354007  1546 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:43.366782  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.367475  1693 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.388468  1736 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.392813  1736 ts_tablet_manager.cc:1403] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.310s	user 0.019s	sys 0.017s
I20260709 12:59:43.418413  1851 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.366003  1747 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.419189  1851 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.364022  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:43.430702  1830 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.431176  1830 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.431584  1830 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.436918  1851 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:43.443866  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44813.5us
I20260709 12:59:43.446889  1737 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.446528  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.447355  1737 ts_tablet_manager.cc:1403] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.004s
I20260709 12:59:43.448037  1849 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.448444  1849 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.457032  1736 raft_consensus.cc:359] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.460247  1736 raft_consensus.cc:385] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.460618  1736 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.449838  1849 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.462328  1736 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.466487  1737 raft_consensus.cc:359] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.468067  1737 raft_consensus.cc:385] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.468441  1737 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.469396  1737 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.475226  1738 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.475874  1738 ts_tablet_manager.cc:1403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.238s	user 0.026s	sys 0.017s
W20260709 12:59:43.455591  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 93213.2us
I20260709 12:59:43.479322  1736 ts_tablet_manager.cc:1434] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.003s
I20260709 12:59:43.483402  1736 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.488458  1737 ts_tablet_manager.cc:1434] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 12:59:43.492437  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.494031  1738 raft_consensus.cc:359] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.495602  1738 raft_consensus.cc:385] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.495872  1738 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.496492  1738 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.498071  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.498512  1738 ts_tablet_manager.cc:1434] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.004s
I20260709 12:59:43.498955  1546 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.499743  1799 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.500201  1799 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.501451  1737 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.502152  1799 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.478804  1823 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.511829  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.513067  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.516158  1442 catalog_manager.cc:5697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.506246  1738 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.492449  1830 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.524600  1830 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.537075  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.519598  1849 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.538650  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.540398  1849 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:43.540766  1511 leader_election.cc:343] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:43.542129  1512 leader_election.cc:343] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.543840  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:43.544456  1620 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:43.544629  1587 leader_election.cc:343] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.518591  1823 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.551633  1695 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.551911  1512 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:43.553527  1830 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:43.557721  1512 leader_election.cc:343] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.559149  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.563175  1545 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:43.563215  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.563786  1620 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:43.563910  1622 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:43.565054  1661 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:43.565991  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:43.567380  1799 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.567538  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.567981  1799 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:43.568795  1799 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.569579  1849 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.569921  1849 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.570247  1849 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:43.571003  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:43.560801  1736 tablet_bootstrap.cc:654] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.561515  1823 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.573859  1737 tablet_bootstrap.cc:654] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.580174  1887 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.580735  1887 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.581338  1887 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.588937  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.587289  1830 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:43.587685  1443 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.599937  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.600575  1696 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.616034  1830 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.621703  1830 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.624332  1736 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.624895  1736 ts_tablet_manager.cc:1403] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.015s
I20260709 12:59:43.629374  1830 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.632838  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.631122  1888 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.055s
I20260709 12:59:43.634828  1693 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:43.635624  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.637662  1512 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:43.637914  1736 raft_consensus.cc:359] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.638849  1736 raft_consensus.cc:385] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.639108  1736 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.639750  1736 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.642453  1830 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:43.640129  1587 leader_election.cc:343] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.650187  1887 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.652357  1696 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:43.653012  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.653589  1546 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.654839  1738 tablet_bootstrap.cc:654] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.655757  1851 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:43.658021  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:43.659272  1851 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.659761  1736 ts_tablet_manager.cc:1434] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:59:43.659842  1851 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:43.660790  1736 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.660971  1851 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.663865  1546 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:43.669274  1661 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:43.668195  1445 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.670724  1737 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.671118  1737 ts_tablet_manager.cc:1403] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.170s	user 0.022s	sys 0.014s
I20260709 12:59:43.672309  1826 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:43.673244  1826 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:43.674034  1826 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.675622  1799 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:43.678742  1737 raft_consensus.cc:359] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.679440  1737 raft_consensus.cc:385] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.679720  1737 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.680359  1737 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.685093  1737 ts_tablet_manager.cc:1434] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:59:43.686008  1737 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.681607  1887 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.691282  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:43.705163  1738 tablet_bootstrap.cc:492] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.705726  1738 ts_tablet_manager.cc:1403] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.200s	user 0.014s	sys 0.011s
I20260709 12:59:43.706490  1849 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.715075  1443 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:43.719277  1736 tablet_bootstrap.cc:654] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.724655  1830 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.730477  1738 raft_consensus.cc:359] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.731191  1622 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:43.731415  1738 raft_consensus.cc:385] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.731684  1738 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.732519  1738 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.734520  1738 ts_tablet_manager.cc:1434] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 12:59:43.735721  1738 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.735986  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.737067  1546 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 1: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 12:59:43.736538  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.734520  1849 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.742883  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:43.743623  1851 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.750173  1445 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:43.754513  1737 tablet_bootstrap.cc:654] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.760777  1738 tablet_bootstrap.cc:654] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.761050  1736 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.761737  1736 ts_tablet_manager.cc:1403] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.012s
I20260709 12:59:43.765290  1736 raft_consensus.cc:359] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.766189  1736 raft_consensus.cc:385] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.766446  1736 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.769412  1737 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.769927  1737 ts_tablet_manager.cc:1403] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.002s
I20260709 12:59:43.778673  1736 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.783072  1736 ts_tablet_manager.cc:1434] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:59:43.785576  1736 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.791718  1737 raft_consensus.cc:359] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.792284  1736 tablet_bootstrap.cc:654] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.792460  1737 raft_consensus.cc:385] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.792742  1737 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.794147  1737 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.785652  1738 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.799315  1738 ts_tablet_manager.cc:1403] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.009s
I20260709 12:59:43.799109  1737 ts_tablet_manager.cc:1434] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.005s
I20260709 12:59:43.804330  1737 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.805716  1736 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.806176  1736 ts_tablet_manager.cc:1403] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 12:59:43.805902  1738 raft_consensus.cc:359] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.806643  1738 raft_consensus.cc:385] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.806926  1738 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.807725  1738 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.809721  1736 raft_consensus.cc:359] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.810372  1737 tablet_bootstrap.cc:654] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.810374  1736 raft_consensus.cc:385] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.810889  1736 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.811543  1736 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.812752  1738 ts_tablet_manager.cc:1434] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:59:43.813620  1738 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.818174  1736 ts_tablet_manager.cc:1434] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:59:43.819087  1736 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.819850  1738 tablet_bootstrap.cc:654] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.833146  1737 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.833600  1737 ts_tablet_manager.cc:1403] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.004s
I20260709 12:59:43.843232  1737 raft_consensus.cc:359] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.844161  1737 raft_consensus.cc:385] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.844504  1737 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.845348  1737 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.847915  1737 ts_tablet_manager.cc:1434] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:59:43.849609  1737 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.850783  1819 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.853117  1738 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.853639  1738 ts_tablet_manager.cc:1403] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.011s
I20260709 12:59:43.855718  1737 tablet_bootstrap.cc:654] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.856470  1738 raft_consensus.cc:359] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.857267  1738 raft_consensus.cc:385] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.857620  1738 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.858785  1736 tablet_bootstrap.cc:654] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.860646  1738 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.863751  1886 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.864228  1886 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.866106  1738 ts_tablet_manager.cc:1434] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:59:43.867096  1738 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.868746  1737 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.869212  1737 ts_tablet_manager.cc:1403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:59:43.870031  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.872673  1737 raft_consensus.cc:359] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.873363  1737 raft_consensus.cc:385] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.871896  1886 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.873760  1737 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.874642  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.874549  1737 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.875752  1738 tablet_bootstrap.cc:654] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.876688  1737 ts_tablet_manager.cc:1434] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:43.877687  1737 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.876672  1661 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:43.881074  1819 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.885492  1826 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.888705  1736 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.889178  1736 ts_tablet_manager.cc:1403] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 12:59:43.889775  1849 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.890257  1849 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.891125  1737 tablet_bootstrap.cc:654] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.892339  1849 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.893700  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.894132  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.895020  1696 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.894326  1545 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.896522  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.898005  1849 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.898332  1849 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.898674  1849 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.899469  1736 raft_consensus.cc:359] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.900377  1736 raft_consensus.cc:385] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.900713  1736 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.901633  1736 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.904584  1736 ts_tablet_manager.cc:1434] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:59:43.906309  1736 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:43.909933  1851 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.914093  1736 tablet_bootstrap.cc:654] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.910455  1851 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.914686  1696 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.916358  1851 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.917709  1737 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.918304  1737 ts_tablet_manager.cc:1403] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.041s	user 0.003s	sys 0.006s
I20260709 12:59:43.921801  1737 raft_consensus.cc:359] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.922971  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.923391  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.927645  1737 raft_consensus.cc:385] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.928120  1737 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.927933  1545 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:43.929312  1888 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:43.928964  1737 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.930559  1888 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.931015  1888 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.932070  1737 ts_tablet_manager.cc:1434] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:43.933056  1888 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.933287  1737 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.939759  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:43.940761  1738 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:43.940809  1737 tablet_bootstrap.cc:654] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.941360  1738 ts_tablet_manager.cc:1403] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.042s
I20260709 12:59:43.943097  1849 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.953300  1737 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:43.941447  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:43.944161  1738 raft_consensus.cc:359] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.946753  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:43.953860  1738 raft_consensus.cc:385] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.948396  1851 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.954154  1738 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.953471  1736 tablet_bootstrap.cc:492] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:43.954213  1790 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:43.954536  1851 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.970270  1790 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.970175  1738 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.971709  1851 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:43.972378  1738 ts_tablet_manager.cc:1434] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 12:59:43.957820  1737 ts_tablet_manager.cc:1403] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.013s
I20260709 12:59:43.973006  1736 ts_tablet_manager.cc:1403] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.006s
I20260709 12:59:43.973989  1738 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:43.970819  1790 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.975700  1737 raft_consensus.cc:359] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.976330  1737 raft_consensus.cc:385] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.976591  1737 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.977270  1737 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.977579  1736 raft_consensus.cc:359] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.978277  1736 raft_consensus.cc:385] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:43.978542  1736 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:43.979185  1736 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.979712  1737 ts_tablet_manager.cc:1434] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:59:43.960237  1587 leader_election.cc:343] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:43.980370  1587 leader_election.cc:343] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.980587  1737 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:43.969465  1849 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:43.981215  1587 leader_election.cc:343] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.982088  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:43.983219  1851 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.984365  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:43.984930  1545 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:43.985781  1738 tablet_bootstrap.cc:654] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.986852  1819 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.987289  1819 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:43.989708  1819 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:43.990929  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:43.991850  1736 ts_tablet_manager.cc:1434] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:59:43.992542  1737 tablet_bootstrap.cc:654] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:43.992468  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:43.993929  1661 leader_election.cc:343] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.992785  1736 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
W20260709 12:59:43.995178  1660 leader_election.cc:343] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:43.995690  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:43.996733  1819 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:43.997570  1545 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:43.998510  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:43.999142  1695 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.002539  1737 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.003003  1737 ts_tablet_manager.cc:1403] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.011s
I20260709 12:59:44.003329  1736 tablet_bootstrap.cc:654] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.005220  1695 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:44.005170  1790 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.005607  1737 raft_consensus.cc:359] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.006764  1737 raft_consensus.cc:385] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.007045  1737 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.007645  1790 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.007690  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.008329  1738 tablet_bootstrap.cc:492] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.007817  1737 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.008801  1738 ts_tablet_manager.cc:1403] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 12:59:44.010016  1737 ts_tablet_manager.cc:1434] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:44.010910  1737 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.011365  1738 raft_consensus.cc:359] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.011965  1738 raft_consensus.cc:385] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.012228  1738 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.012917  1738 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.016168  1738 ts_tablet_manager.cc:1434] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:59:44.017055  1737 tablet_bootstrap.cc:654] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.018664  1736 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:44.019116  1736 ts_tablet_manager.cc:1403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.001s
I20260709 12:59:44.025826  1799 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.026239  1738 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.026049  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.026387  1799 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.026945  1695 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:44.028661  1737 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.029213  1737 ts_tablet_manager.cc:1403] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 12:59:44.028630  1799 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.029791  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 12:59:44.031262  1511 leader_election.cc:343] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.031878  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.032631  1738 tablet_bootstrap.cc:654] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:44.033102  1512 leader_election.cc:343] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.033349  1790 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.033986  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:44.033916  1790 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.035229  1736 raft_consensus.cc:359] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.035751  1736 raft_consensus.cc:385] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.035964  1736 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.038062  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.038817  1799 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.039455  1790 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.040238  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.040055  1747 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.048267  1799 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.061903  1545 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.062371  1747 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.062662  1799 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.063256  1747 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.065600  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.066218  1622 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:44.061642  1737 raft_consensus.cc:359] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.067723  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.068635  1830 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.068998  1830 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.069155  1545 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:44.069334  1830 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:44.046169  1587 leader_election.cc:343] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.070488  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.070295  1736 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.071195  1849 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.072638  1736 ts_tablet_manager.cc:1434] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.053s	user 0.011s	sys 0.006s
I20260709 12:59:44.072918  1849 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.073403  1849 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.073556  1736 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:44.074234  1849 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.067763  1737 raft_consensus.cc:385] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.075623  1737 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.076355  1737 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.048094  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.078023  1819 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.081393  1737 ts_tablet_manager.cc:1434] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.002s
I20260709 12:59:44.082315  1737 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.083041  1736 tablet_bootstrap.cc:654] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.083609  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:44.085100  1790 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.085548  1790 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.085879  1790 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.087544  1888 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.088028  1888 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.090015  1888 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.090845  1799 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.090015  1830 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:44.094846  1587 leader_election.cc:343] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.097481  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.097539  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:44.098182  1547 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:44.098320  1622 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.104899  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.094364  1830 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.110854  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.115829  1693 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.116999  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:44.118369  1587 leader_election.cc:343] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.120224  1622 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:44.119246  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:44.122251  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.122707  1888 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.123072  1888 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.123411  1888 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.127374  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:44.132871  1587 leader_election.cc:343] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:44.139895  1587 leader_election.cc:343] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.141090  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:44.139119  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.143100  1747 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.146057  1888 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.146602  1830 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.147115  1830 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:44.147922  1830 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.157054  1442 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.159039  1442 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.162345  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.161708  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.155701  1790 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.172240  1801 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.172631  1790 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.172749  1801 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.174863  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.175448  1695 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.170388  1546 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.174914  1738 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.178169  1738 ts_tablet_manager.cc:1403] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.003s
I20260709 12:59:44.181044  1738 raft_consensus.cc:359] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.181747  1738 raft_consensus.cc:385] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.182009  1738 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.178400  1694 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.180008  1801 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.186709  1738 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.187314  1819 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.188170  1819 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.194103  1695 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
W20260709 12:59:44.198175  1587 leader_election.cc:343] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.199290  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.199685  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.190042  1738 ts_tablet_manager.cc:1434] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:44.200539  1696 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:44.202520  1738 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.164463  1888 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.206930  1747 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.218384  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.209548  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.205859  1819 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:44.225013  1736 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:44.225481  1736 ts_tablet_manager.cc:1403] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.012s
I20260709 12:59:44.221550  1801 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.227317  1801 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.227824  1801 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.230710  1747 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.223022  1546 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:44.246042  1747 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.248029  1442 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:44.250946  1660 leader_election.cc:343] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.251552  1737 tablet_bootstrap.cc:654] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.254120  1819 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.254391  1736 raft_consensus.cc:359] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.255088  1736 raft_consensus.cc:385] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.255342  1736 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.255721  1851 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.256102  1736 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.258275  1736 ts_tablet_manager.cc:1434] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:59:44.260360  1736 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:44.239624  1693 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:44.280223  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.288017  1799 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.289669  1792 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.290875  1799 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.293035  1799 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.293267  1442 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.296955  1801 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.298198  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.298959  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.300074  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:44.301159  1512 leader_election.cc:343] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.301632  1801 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.325608  1547 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.334477  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.335210  1694 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.339983  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:44.334362  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.341867  1747 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.345955  1738 tablet_bootstrap.cc:654] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:44.350118  1661 leader_election.cc:343] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.346997  1747 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.350957  1661 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:44.351797  1747 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.352855  1736 tablet_bootstrap.cc:654] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.353438  1887 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.345456  1694 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:44.360003  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.360632  1620 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
W20260709 12:59:44.363252  1587 leader_election.cc:343] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:44.364388  1587 leader_election.cc:343] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.370811  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.371546  1849 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.372046  1849 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.374310  1799 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.375483  1738 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.375770  1849 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.378455  1511 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:44.379521  1799 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.379931  1799 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.380313  1799 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.387638  1738 ts_tablet_manager.cc:1403] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.000s
I20260709 12:59:44.388827  1737 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.391640  1737 ts_tablet_manager.cc:1403] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.309s	user 0.003s	sys 0.012s
I20260709 12:59:44.398213  1443 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:44.403903  1587 leader_election.cc:343] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.405965  1738 raft_consensus.cc:359] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.406709  1738 raft_consensus.cc:385] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.406608  1888 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.407104  1738 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.407749  1738 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.415413  1738 ts_tablet_manager.cc:1434] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:59:44.416298  1738 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.419164  1747 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.424654  1747 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.426815  1747 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.428484  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.429586  1694 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:44.430660  1587 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.431845  1888 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.432235  1888 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.432572  1888 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.433161  1736 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:44.433647  1736 ts_tablet_manager.cc:1403] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.173s	user 0.016s	sys 0.017s
I20260709 12:59:44.434866  1737 raft_consensus.cc:359] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.435396  1737 raft_consensus.cc:385] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.435648  1737 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.436249  1737 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.442504  1736 raft_consensus.cc:359] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.443233  1736 raft_consensus.cc:385] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.443485  1736 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.439443  1799 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.446234  1737 ts_tablet_manager.cc:1434] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 12:59:44.446534  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.447206  1737 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
W20260709 12:59:44.451205  1587 leader_election.cc:343] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.452318  1736 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.453562  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:44.454946  1621 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.454583  1799 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.461326  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.462608  1738 tablet_bootstrap.cc:654] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.465021  1736 ts_tablet_manager.cc:1434] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
W20260709 12:59:44.464977  1512 leader_election.cc:343] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.466109  1736 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:44.473908  1621 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:44.478770  1511 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:44.479895  1799 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.484920  1799 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:44.485745  1799 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.486351  1737 tablet_bootstrap.cc:654] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.486164  1443 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.474565  1888 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.497753  1738 tablet_bootstrap.cc:492] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.498272  1738 ts_tablet_manager.cc:1403] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 12:59:44.504019  1738 raft_consensus.cc:359] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.504689  1738 raft_consensus.cc:385] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.504976  1738 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.504876  1747 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.505753  1738 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.505956  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.506915  1888 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:44.508112  1587 leader_election.cc:343] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.510037  1738 ts_tablet_manager.cc:1434] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:59:44.510567  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.511162  1695 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.511881  1738 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.516019  1736 tablet_bootstrap.cc:654] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.527099  1888 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.529358  1737 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.529814  1737 ts_tablet_manager.cc:1403] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.006s
I20260709 12:59:44.531061  1695 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:44.533073  1587 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:44.534088  1790 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.534524  1790 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:44.535606  1738 tablet_bootstrap.cc:654] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.535305  1790 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.527774  1888 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.536701  1443 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.540807  1888 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.541913  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.542554  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:44.543260  1587 leader_election.cc:343] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:44.544178  1587 leader_election.cc:343] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.544112  1747 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.538269  1736 tablet_bootstrap.cc:492] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:44.545356  1736 ts_tablet_manager.cc:1403] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.006s
I20260709 12:59:44.544605  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:44.549048  1736 raft_consensus.cc:359] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.549698  1736 raft_consensus.cc:385] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.549973  1736 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.550602  1747 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.550822  1736 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.552192  1737 raft_consensus.cc:359] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.552809  1737 raft_consensus.cc:385] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.553072  1737 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.553706  1737 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.556489  1737 ts_tablet_manager.cc:1434] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:59:44.557418  1737 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.557999  1443 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.563653  1737 tablet_bootstrap.cc:654] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.575651  1736 ts_tablet_manager.cc:1434] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:59:44.576674  1736 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:44.580399  1738 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.580904  1738 ts_tablet_manager.cc:1403] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.004s
I20260709 12:59:44.583555  1738 raft_consensus.cc:359] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.584201  1738 raft_consensus.cc:385] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.584482  1738 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.598188  1738 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.602356  1736 tablet_bootstrap.cc:654] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.603133  1738 ts_tablet_manager.cc:1434] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:59:44.610510  1738 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.616492  1737 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.616995  1737 ts_tablet_manager.cc:1403] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.007s
I20260709 12:59:44.619514  1737 raft_consensus.cc:359] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.620189  1737 raft_consensus.cc:385] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.620464  1737 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.621675  1801 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.622785  1737 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.625110  1737 ts_tablet_manager.cc:1434] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:59:44.625967  1737 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.632565  1737 tablet_bootstrap.cc:654] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:44.633054  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:44.636665  1737 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.637061  1737 ts_tablet_manager.cc:1403] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:59:44.639492  1737 raft_consensus.cc:359] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.640136  1737 raft_consensus.cc:385] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.640408  1737 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.641144  1737 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.642256  1887 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.642997  1737 ts_tablet_manager.cc:1434] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:44.642740  1887 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.643724  1737 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.644723  1887 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:44.645449  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.647243  1738 tablet_bootstrap.cc:654] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.650259  1737 tablet_bootstrap.cc:654] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.646169  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.655033  1620 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 12:59:44.655918  1587 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:44.656392  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:44.657510  1546 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.658149  1819 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.650141  1893 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.659611  1893 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.661682  1888 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.668776  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.677934  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.678408  1819 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.679790  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:44.681116  1799 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.683029  1893 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.680436  1737 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.684572  1737 ts_tablet_manager.cc:1403] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.010s
I20260709 12:59:44.687482  1737 raft_consensus.cc:359] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.688138  1737 raft_consensus.cc:385] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.688390  1737 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.689221  1737 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.690687  1737 ts_tablet_manager.cc:1434] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:59:44.691598  1737 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.718052  1545 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.744402  1738 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.744833  1738 ts_tablet_manager.cc:1403] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.012s
I20260709 12:59:44.743685  1893 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:44.750094  1737 tablet_bootstrap.cc:654] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.750135  1738 raft_consensus.cc:359] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.750892  1738 raft_consensus.cc:385] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.751151  1738 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.751773  1738 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.755471  1736 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:44.755932  1736 ts_tablet_manager.cc:1403] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.179s	user 0.017s	sys 0.007s
I20260709 12:59:44.758057  1738 ts_tablet_manager.cc:1434] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:59:44.759024  1738 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:44.763569  1799 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.770711  1888 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.776403  1736 raft_consensus.cc:359] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.777117  1747 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:59:44.778995  1587 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:44.789098  1819 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.790444  1819 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.792637  1819 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:44.794220  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.794963  1620 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:44.798259  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.798769  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.799984  1887 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.800143  1738 tablet_bootstrap.cc:654] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.800377  1887 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.800738  1887 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.777163  1736 raft_consensus.cc:385] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.805066  1736 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
W20260709 12:59:44.808429  1661 leader_election.cc:343] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.806934  1736 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.815448  1736 ts_tablet_manager.cc:1434] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 12:59:44.816843  1736 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:44.826182  1819 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.835237  1887 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.836455  1819 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.836648  1849 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:44.838078  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.838811  1819 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:44.841292  1849 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.841334  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:44.841784  1849 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.842317  1737 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:44.843758  1849 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.843933  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.844269  1737 ts_tablet_manager.cc:1403] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.153s	user 0.033s	sys 0.038s
I20260709 12:59:44.846487  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.850011  1737 raft_consensus.cc:359] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.850553  1737 raft_consensus.cc:385] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.850840  1737 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.851820  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:44.851744  1737 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.854740  1545 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:44.850795  1887 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 12:59:44.847011  1661 leader_election.cc:343] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.861759  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.863109  1737 ts_tablet_manager.cc:1434] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:59:44.864073  1737 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:44.862555  1849 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.863984  1747 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.866611  1747 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.867304  1747 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.867945  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:44.868880  1622 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:44.866499  1587 leader_election.cc:343] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.866375  1849 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:44.900063  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56935.8us
I20260709 12:59:44.900712  1622 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:44.901592  1747 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.903617  1747 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.906339  1661 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:44.906939  1736 tablet_bootstrap.cc:654] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.907240  1887 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:44.903821  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:44.910696  1887 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:44.911209  1887 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:44.912077  1887 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.913605  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:44.913090  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:44.914346  1547 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
W20260709 12:59:44.914916  1587 leader_election.cc:343] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:44.915408  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:44.915956  1545 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.925688  1693 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.926565  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:44.943914  1799 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:44.937779  1747 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:44.946816  1747 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.947176  1747 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:44.958029  1738 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:44.958556  1738 ts_tablet_manager.cc:1403] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.200s	user 0.017s	sys 0.019s
I20260709 12:59:44.964174  1737 tablet_bootstrap.cc:654] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:44.962577  1849 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:44.980860  1738 raft_consensus.cc:359] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.981740  1738 raft_consensus.cc:385] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:44.982016  1738 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:44.982755  1738 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:44.984252  1738 ts_tablet_manager.cc:1434] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:59:44.990001  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:44.993005  1587 leader_election.cc:343] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.004864  1801 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.009449  1801 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.012709  1801 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.003893  1849 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.016537  1849 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.072424  1736 tablet_bootstrap.cc:492] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.072970  1736 ts_tablet_manager.cc:1403] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.256s	user 0.017s	sys 0.018s
I20260709 12:59:45.073522  1738 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:45.074860  1545 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:45.094471  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.095005  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.095621  1691 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:45.091572  1849 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:45.100100  1587 leader_election.cc:343] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.100751  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:45.088966  1799 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.102768  1801 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.113538  1801 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.113942  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:45.114338  1801 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.108958  1830 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:59:45.106134  1799 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.116204  1736 raft_consensus.cc:359] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.107479  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:45.117277  1736 raft_consensus.cc:385] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.117674  1736 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.118431  1736 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.104787  1851 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:59:45.123312  1801 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.125368  1801 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.099332  1747 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.126294  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:45.126893  1696 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.127074  1799 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.125419  1736 ts_tablet_manager.cc:1434] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:59:45.127372  1747 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.128201  1736 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.129156  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 12:59:45.130415  1587 leader_election.cc:343] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.134922  1696 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:45.140671  1736 tablet_bootstrap.cc:654] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.137929  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 12:59:45.179338  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68454.4us
I20260709 12:59:45.183863  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:45.188416  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:45.189715  1544 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.196904  1546 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.212201  1442 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:45.223766  1738 tablet_bootstrap.cc:654] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:45.252799  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 71781.5us
I20260709 12:59:45.267978  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 12:59:45.269972  1587 leader_election.cc:343] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.272370  1747 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.288668  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.289438  1736 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.290254  1736 ts_tablet_manager.cc:1403] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.004s
I20260709 12:59:45.291314  1544 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
W20260709 12:59:45.298362  1587 leader_election.cc:343] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.304960  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:45.282256  1851 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.312810  1747 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:45.314509  1747 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.315522  1736 raft_consensus.cc:359] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.316345  1737 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
W20260709 12:59:45.320894  1587 leader_election.cc:343] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.321856  1981 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.316386  1736 raft_consensus.cc:385] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.324416  1736 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.331403  1736 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.342077  1737 ts_tablet_manager.cc:1403] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.478s	user 0.019s	sys 0.003s
I20260709 12:59:45.340392  1851 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:45.350951  1887 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.353014  1736 ts_tablet_manager.cc:1434] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.004s
I20260709 12:59:45.355296  1849 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:59:45.357277  1738 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:45.357945  1738 ts_tablet_manager.cc:1403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.285s	user 0.026s	sys 0.031s
I20260709 12:59:45.362411  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:45.353479  1887 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.377890  1851 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.387584  1981 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.388491  1981 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:45.389909  1981 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.392390  1736 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.394424  1737 raft_consensus.cc:359] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.396405  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.399927  1737 raft_consensus.cc:385] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.400280  1737 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.400601  1696 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:45.401135  1737 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.374267  1887 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:45.409744  1738 raft_consensus.cc:359] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.410953  1738 raft_consensus.cc:385] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.411309  1738 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.412186  1738 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.423084  1893 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.423663  1893 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.427165  1893 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.430042  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.431238  1621 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 12:59:45.457135  1736 tablet_bootstrap.cc:654] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.460547  1737 ts_tablet_manager.cc:1434] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.117s	user 0.004s	sys 0.004s
I20260709 12:59:45.462245  1737 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:45.472986  1738 ts_tablet_manager.cc:1434] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.003s
W20260709 12:59:45.472821  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75872.4us
I20260709 12:59:45.474750  1738 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:45.500644  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:45.507084  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.513679  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.519882  1976 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.538821  1547 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.554965  1738 tablet_bootstrap.cc:654] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.554263  1823 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.555197  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.561792  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.564239  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.565102  1823 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.576640  1737 tablet_bootstrap.cc:654] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.601603  1694 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.602829  1976 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.604370  1974 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.613945  1985 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.618017  1976 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.618531  1976 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.620723  1976 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.621814  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.622718  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.625062  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.625998  1738 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:45.626434  1738 ts_tablet_manager.cc:1403] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.152s	user 0.010s	sys 0.007s
I20260709 12:59:45.627429  1976 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.628310  1736 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.628762  1736 ts_tablet_manager.cc:1403] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.237s	user 0.011s	sys 0.012s
I20260709 12:59:45.643757  1738 raft_consensus.cc:359] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.646507  1738 raft_consensus.cc:385] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.646809  1738 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.647488  1738 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.649313  1736 raft_consensus.cc:359] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.650005  1736 raft_consensus.cc:385] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.650259  1736 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.650935  1736 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.662475  1738 ts_tablet_manager.cc:1434] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:59:45.667799  1738 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:45.668879  1736 ts_tablet_manager.cc:1434] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.001s
I20260709 12:59:45.675544  1736 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.679675  1976 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.680225  1976 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.679371  1445 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.687132  1445 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.687749  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.689584  1691 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:45.690234  1445 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.693533  1736 tablet_bootstrap.cc:654] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.688119  1976 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.696177  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.700377  1511 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.701081  1976 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.702955  1737 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:45.703442  1737 ts_tablet_manager.cc:1403] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.242s	user 0.019s	sys 0.019s
I20260709 12:59:45.713588  1738 tablet_bootstrap.cc:654] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.723626  1976 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.726897  1737 raft_consensus.cc:359] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.729394  1738 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:45.729421  1736 tablet_bootstrap.cc:492] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.729969  1738 ts_tablet_manager.cc:1403] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.004s
I20260709 12:59:45.730012  1736 ts_tablet_manager.cc:1403] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.006s
I20260709 12:59:45.732740  1737 raft_consensus.cc:385] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.733117  1737 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.733059  1736 raft_consensus.cc:359] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.733783  1736 raft_consensus.cc:385] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.734071  1736 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.734756  1736 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.737036  1736 ts_tablet_manager.cc:1434] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:59:45.738058  1736 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.733906  1737 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.738284  1738 raft_consensus.cc:359] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.738965  1738 raft_consensus.cc:385] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.739200  1738 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.740615  1737 ts_tablet_manager.cc:1434] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 12:59:45.741513  1737 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:45.744390  1736 tablet_bootstrap.cc:654] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.751156  1737 tablet_bootstrap.cc:654] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.750954  1738 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:45.752691  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:45.753818  1738 ts_tablet_manager.cc:1434] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:59:45.755553  1738 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:45.759629  1736 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.760092  1736 ts_tablet_manager.cc:1403] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:59:45.762914  1736 raft_consensus.cc:359] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.763648  1736 raft_consensus.cc:385] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.763935  1736 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.764576  1736 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.766271  1738 tablet_bootstrap.cc:654] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.766651  1736 ts_tablet_manager.cc:1434] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:45.767817  1736 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.770164  1823 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.770639  1823 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.772776  1823 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:45.774020  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:45.775095  1544 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:45.775286  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.776862  1823 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.777383  1691 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.777304  1823 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.779466  1823 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:45.780082  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:45.781704  1661 leader_election.cc:343] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.783564  1851 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:45.784103  1851 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.788067  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:45.789201  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:45.789425  1737 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
W20260709 12:59:45.789291  1587 leader_election.cc:343] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.789934  1823 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.791533  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:45.794714  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:45.795586  1622 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:45.797312  1823 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.790433  1737 ts_tablet_manager.cc:1403] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.006s
I20260709 12:59:45.799944  1737 raft_consensus.cc:359] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.800446  1737 raft_consensus.cc:385] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.800699  1737 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.801332  1737 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:45.802063  1587 leader_election.cc:343] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:45.786487  1851 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:45.802516  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:45.803639  1737 ts_tablet_manager.cc:1434] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:59:45.804406  1851 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:45.803275  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:45.805629  1737 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:45.806110  1790 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.807178  1823 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:45.807583  1823 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.805826  1736 tablet_bootstrap.cc:654] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.807947  1823 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.812661  1738 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:45.813114  1738 ts_tablet_manager.cc:1403] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.009s
I20260709 12:59:45.813882  1737 tablet_bootstrap.cc:654] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.820509  1738 raft_consensus.cc:359] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.821852  1738 raft_consensus.cc:385] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.822204  1738 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.823143  1738 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.825279  1823 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.825758  1738 ts_tablet_manager.cc:1434] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:59:45.827939  1738 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:45.831391  1736 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:45.831859  1736 ts_tablet_manager.cc:1403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.004s
I20260709 12:59:45.836004  1823 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:45.837347  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:45.839062  1736 raft_consensus.cc:359] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.840268  1736 raft_consensus.cc:385] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.841109  1544 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.841419  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:45.841995  1621 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.840637  1736 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.846467  1736 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.855530  1737 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:45.856057  1737 ts_tablet_manager.cc:1403] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.003s
I20260709 12:59:45.844350  1790 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:59:45.867585  1737 raft_consensus.cc:359] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.868592  1737 raft_consensus.cc:385] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:45.868947  1737 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:45.869776  1737 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.881975  1736 ts_tablet_manager.cc:1434] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:59:45.882279  1737 ts_tablet_manager.cc:1434] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:59:45.886356  1737 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:45.894333  1738 tablet_bootstrap.cc:654] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.902788  1736 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:45.907051  1966 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.920933  1736 tablet_bootstrap.cc:654] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:45.927011  1973 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:45.933923  1542 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:45.924646  1621 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:45.939419  1544 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:45.940778  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:45.941780  1823 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:45.942605  1823 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:45.943708  1823 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.978694  1738 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:45.979276  1738 ts_tablet_manager.cc:1403] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.012s
I20260709 12:59:45.966900  1790 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:59:45.987121  1851 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:59:45.997753  1738 raft_consensus.cc:359] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:45.998445  1738 raft_consensus.cc:385] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.008951  1738 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.001626  1737 tablet_bootstrap.cc:654] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.014065  1738 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.018894  1966 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.018795  1442 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.019678  1966 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.038318  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.044920  1981 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.045281  1985 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.045542  1981 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.045758  1985 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.047788  1981 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.049268  1738 ts_tablet_manager.cc:1434] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.070s	user 0.024s	sys 0.003s
I20260709 12:59:46.050052  1966 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.050796  1985 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:46.058290  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:46.059973  1620 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:46.062219  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:46.069114  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.072594  1823 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.073037  1823 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.073369  1823 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.079721  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.080085  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.080515  1543 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
W20260709 12:59:46.078137  1587 leader_election.cc:343] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.082500  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:46.083864  1587 leader_election.cc:343] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.085031  1738 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.083173  1544 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
W20260709 12:59:46.112278  1587 leader_election.cc:343] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.112692  1587 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.113415  1790 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.097206  1823 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.100631  1851 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.120550  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:46.120605  1851 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.121206  1622 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.124063  1737 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.124511  1737 ts_tablet_manager.cc:1403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.240s	user 0.007s	sys 0.009s
I20260709 12:59:46.126504  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:46.124969  1823 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:46.132403  1888 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.132807  1888 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.133139  1888 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.133626  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.134639  1849 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.135107  1849 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.136912  1622 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:46.138144  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:46.130651  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.139060  1982 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.146489  1544 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.155342  1738 tablet_bootstrap.cc:654] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.145776  1851 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.164714  1736 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.165978  1736 ts_tablet_manager.cc:1403] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.263s	user 0.017s	sys 0.000s
I20260709 12:59:46.165979  1737 raft_consensus.cc:359] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.172101  1737 raft_consensus.cc:385] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.172384  1737 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.173213  1737 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.175928  1849 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.163648  1888 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.149911  1982 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:46.176046  1737 ts_tablet_manager.cc:1434] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:59:46.178512  1982 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.183306  1888 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:46.191130  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51609.3us
I20260709 12:59:46.183557  1736 raft_consensus.cc:359] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.186110  1737 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.193377  1736 raft_consensus.cc:385] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.175976  1544 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:46.193869  1736 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.194739  1736 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.197345  1736 ts_tablet_manager.cc:1434] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.004s
I20260709 12:59:46.198361  1736 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.200001  1737 tablet_bootstrap.cc:654] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.209355  1736 tablet_bootstrap.cc:654] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:46.195076  1587 leader_election.cc:343] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.211853  1737 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.211978  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.212401  1737 ts_tablet_manager.cc:1403] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 12:59:46.213079  1738 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:46.213392  1738 ts_tablet_manager.cc:1403] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.000s
I20260709 12:59:46.212742  1443 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.215139  1737 raft_consensus.cc:359] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.215847  1737 raft_consensus.cc:385] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.216132  1737 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.216899  1737 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.220821  1738 raft_consensus.cc:359] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.221930  1738 raft_consensus.cc:385] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.222213  1738 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.222749  1737 ts_tablet_manager.cc:1434] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:59:46.224071  1737 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.224622  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.222882  1738 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.231698  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:46.232885  1587 leader_election.cc:343] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:46.233472  1587 leader_election.cc:343] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.233815  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.235950  2019 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.236443  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 12:59:46.237785  1587 leader_election.cc:343] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.238179  1587 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 12:59:46.239929  1587 leader_election.cc:343] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.241405  1738 ts_tablet_manager.cc:1434] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:59:46.242055  2021 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.251094  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.251780  1544 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.254908  2021 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.255393  2021 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.257365  2021 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.258041  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.260543  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.261153  1691 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
W20260709 12:59:46.263329  1587 leader_election.cc:343] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.264146  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.264879  2021 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.265291  2021 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.265667  2021 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.272976  2021 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.274395  1737 tablet_bootstrap.cc:654] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.275215  1738 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.277751  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:46.293036  1691 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.277969  1544 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:46.277519  1736 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.298482  1736 ts_tablet_manager.cc:1403] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.036s
I20260709 12:59:46.298477  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:46.277156  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.276072  2021 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.313553  1790 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.314476  1790 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 12:59:46.318444  1587 leader_election.cc:343] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.320113  1691 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:46.320914  1738 tablet_bootstrap.cc:654] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.321288  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.322044  1849 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.316365  1790 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.322507  1849 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:46.338603  1736 raft_consensus.cc:359] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.340173  1736 raft_consensus.cc:385] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.340493  1736 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.341156  1736 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.343161  1737 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.342927  1849 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.343928  1737 ts_tablet_manager.cc:1403] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.014s
I20260709 12:59:46.349246  1737 raft_consensus.cc:359] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.350085  1737 raft_consensus.cc:385] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.353001  1737 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.354974  1737 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.357090  1443 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.355576  1736 ts_tablet_manager.cc:1434] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:59:46.358805  1737 ts_tablet_manager.cc:1434] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:59:46.359723  1737 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.363559  1736 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.365922  1737 tablet_bootstrap.cc:654] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.369761  1736 tablet_bootstrap.cc:654] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.361027  1738 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:46.371629  1738 ts_tablet_manager.cc:1403] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.011s
I20260709 12:59:46.374501  1738 raft_consensus.cc:359] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.375247  1738 raft_consensus.cc:385] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.375577  1738 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.376315  1738 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.378595  1738 ts_tablet_manager.cc:1434] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:59:46.379676  1738 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.381788  1736 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.382278  1736 ts_tablet_manager.cc:1403] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 12:59:46.384120  1737 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.384567  1737 ts_tablet_manager.cc:1403] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.000s
I20260709 12:59:46.385773  1738 tablet_bootstrap.cc:654] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.385654  1736 raft_consensus.cc:359] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.386366  1736 raft_consensus.cc:385] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.386660  1736 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.386991  1737 raft_consensus.cc:359] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.387749  1737 raft_consensus.cc:385] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.388017  1737 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.388789  1737 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.391234  1737 ts_tablet_manager.cc:1434] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:59:46.387301  1736 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.392270  1737 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.396951  1736 ts_tablet_manager.cc:1434] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:59:46.401434  1737 tablet_bootstrap.cc:654] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.406968  1736 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.404789  1443 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.417219  1736 tablet_bootstrap.cc:654] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.430716  1738 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:46.431229  1738 ts_tablet_manager.cc:1403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.008s
I20260709 12:59:46.433341  1738 raft_consensus.cc:359] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.433844  1738 raft_consensus.cc:385] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.434091  1738 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.431262  1737 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.435135  1737 ts_tablet_manager.cc:1403] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 12:59:46.435038  1987 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.435920  1987 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.436825  1736 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.437244  1736 ts_tablet_manager.cc:1403] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:59:46.438117  1987 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.438048  1737 raft_consensus.cc:359] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.438827  1737 raft_consensus.cc:385] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.439108  1737 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.439779  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.439723  1737 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.440006  1736 raft_consensus.cc:359] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.440646  1736 raft_consensus.cc:385] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.440937  1736 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.441107  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:46.441670  1622 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:46.441599  1736 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.442055  1738 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.442659  1692 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:46.444185  1736 ts_tablet_manager.cc:1434] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 12:59:46.444226  1738 ts_tablet_manager.cc:1434] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:59:46.444288  1511 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:46.445493  1738 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.445721  1976 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.446149  1976 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.446504  1976 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.447538  1736 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.453567  1985 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.453991  1736 tablet_bootstrap.cc:654] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.441702  1737 ts_tablet_manager.cc:1434] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:59:46.456064  1737 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.457456  1985 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.461658  1972 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.462364  1972 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.468119  1972 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.471613  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 12:59:46.478574  1511 leader_election.cc:343] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.489356  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:46.498929  1512 leader_election.cc:343] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.499351  1737 tablet_bootstrap.cc:654] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.498772  1976 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.503106  1512 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:46.508224  1987 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.517388  1738 tablet_bootstrap.cc:654] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.518512  1976 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.521085  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:46.521793  1692 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.534834  2019 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.535552  2019 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.540722  2019 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.544767  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.543114  1736 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.545424  1691 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:46.545740  1692 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:46.546851  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.547230  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:46.545614  1736 ts_tablet_manager.cc:1403] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.098s	user 0.002s	sys 0.021s
I20260709 12:59:46.547778  1620 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.548715  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:46.550400  1987 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.550890  1987 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:46.551687  1987 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.552196  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:46.552932  2021 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.553290  2021 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.553606  2021 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:46.555887  1587 leader_election.cc:343] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.574362  1736 raft_consensus.cc:359] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.575486  1736 raft_consensus.cc:385] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.575842  1736 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.609809  1736 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.614573  1736 ts_tablet_manager.cc:1434] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:59:46.625099  1620 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:46.621872  1893 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.627068  1893 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.633008  1736 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.634080  1737 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:46.634785  1737 ts_tablet_manager.cc:1403] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.179s	user 0.030s	sys 0.042s
I20260709 12:59:46.637269  1893 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.646243  1738 tablet_bootstrap.cc:492] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:46.646826  1738 ts_tablet_manager.cc:1403] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.018s
I20260709 12:59:46.650380  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:46.659363  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.664551  1738 raft_consensus.cc:359] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.665128  1690 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:46.665221  1738 raft_consensus.cc:385] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.665551  1738 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.666169  1738 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.674305  1737 raft_consensus.cc:359] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.674707  1738 ts_tablet_manager.cc:1434] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:59:46.674690  2021 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.675055  1737 raft_consensus.cc:385] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.667303  1985 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:59:46.675431  1737 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.676153  1737 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.675743  1982 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.679069  1738 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.678018  2021 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.680513  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.680635  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:46.681197  1690 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:46.681895  1587 leader_election.cc:343] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.694999  1737 ts_tablet_manager.cc:1434] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 12:59:46.697494  1737 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.702040  1442 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.717504  1823 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.721791  1738 tablet_bootstrap.cc:654] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.718554  1823 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.726694  1823 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:46.728382  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:46.728993  1690 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:46.729655  1620 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:46.716356  1512 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:46.731142  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:46.733858  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.736646  1972 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.738906  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.747366  1541 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:46.737449  2019 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.749665  2019 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:46.750587  2019 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.757872  1974 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.736028  1823 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.759243  1823 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.760051  1823 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.768543  1823 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.771438  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.772078  1546 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.772367  1972 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.773518  1737 tablet_bootstrap.cc:654] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.781524  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:46.786023  1620 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.784696  1546 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:46.792374  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:46.796870  1985 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.797407  1985 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:46.801221  1620 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:46.798296  1985 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.809015  1736 tablet_bootstrap.cc:654] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:46.780469  1823 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:46.821233  2019 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.822194  2019 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.825737  2019 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.838940  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.839107  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.836429  2021 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.840579  2021 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:46.841331  1587 leader_election.cc:343] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:46.841964  1587 leader_election.cc:343] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.842338  1587 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.850301  1974 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.852185  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.842497  2021 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.857861  1823 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.859122  1823 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.862339  1974 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.862805  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.863525  1546 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:46.863416  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.864401  1690 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:46.867502  1823 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:46.869189  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:46.872725  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 12:59:46.873533  1587 leader_election.cc:343] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.873921  1660 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:46.878741  2021 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:46.879302  2021 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.879678  2021 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.885439  2021 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.887692  2021 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.888309  1849 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.888417  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:46.888628  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:46.888888  1849 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.889245  1690 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:46.893733  1587 leader_election.cc:343] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.895218  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.895418  1443 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.897513  1737 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
W20260709 12:59:46.897429  1587 leader_election.cc:343] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.897981  1737 ts_tablet_manager.cc:1403] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.201s	user 0.008s	sys 0.005s
W20260709 12:59:46.898021  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:59:46.878706  2048 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:46.907481  1736 tablet_bootstrap.cc:492] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:46.908005  1736 ts_tablet_manager.cc:1403] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.280s	user 0.006s	sys 0.021s
I20260709 12:59:46.909102  1849 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.912142  1737 raft_consensus.cc:359] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.912819  1737 raft_consensus.cc:385] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.913103  1737 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.913744  1737 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.917270  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.921104  1974 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.921685  1974 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.924882  1974 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:46.925149  1981 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.928007  1690 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
W20260709 12:59:46.925374  1587 leader_election.cc:343] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.929761  1587 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.926882  1737 ts_tablet_manager.cc:1434] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:59:46.931394  1445 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:46.932834  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.935653  1738 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:46.936139  1738 ts_tablet_manager.cc:1403] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.261s	user 0.007s	sys 0.018s
I20260709 12:59:46.932034  1974 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.936734  2019 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:46.943617  2019 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:46.944723  2019 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.945955  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:46.946486  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:46.949168  2048 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:59:46.950738  1587 leader_election.cc:343] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:46.951819  1587 leader_election.cc:343] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:46.952179  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:46.954165  1738 raft_consensus.cc:359] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.959635  1738 raft_consensus.cc:385] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.960250  1738 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.960956  1737 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:46.963660  1736 raft_consensus.cc:359] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.964587  1736 raft_consensus.cc:385] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:46.964919  1736 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:46.966323  1738 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.963061  1974 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:46.968744  1738 ts_tablet_manager.cc:1434] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260709 12:59:46.969705  1738 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:46.974606  1981 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:46.978101  1893 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:46.976377  1736 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:46.982388  1736 ts_tablet_manager.cc:1434] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.074s	user 0.002s	sys 0.005s
I20260709 12:59:46.983389  1736 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:46.984776  1738 tablet_bootstrap.cc:654] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.002179  1893 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:47.006479  1445 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.030380  1737 tablet_bootstrap.cc:654] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.045264  1736 tablet_bootstrap.cc:654] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.109798  1982 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.110354  1982 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.178246  1982 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.183849  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.203758  1544 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:47.177811  1974 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.210065  1974 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.212770  1974 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.214947  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.219308  1694 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:47.220634  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.221228  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:47.223455  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:47.225682  2021 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.226711  2021 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.227043  2021 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.236868  1738 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.237396  1738 ts_tablet_manager.cc:1403] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.268s	user 0.019s	sys 0.040s
I20260709 12:59:47.238420  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:47.239573  1823 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.239948  1823 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.240293  1823 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.248131  1738 raft_consensus.cc:359] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.248868  1738 raft_consensus.cc:385] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.249136  1738 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
W20260709 12:59:47.249341  1587 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:47.249784  1738 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.265436  1823 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.271915  2021 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.273953  2021 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.268750  1738 ts_tablet_manager.cc:1434] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 12:59:47.278136  1738 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.280893  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:47.281522  1543 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.282372  1823 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.283115  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.283754  1622 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:47.289925  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:47.290750  1694 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 1: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 12:59:47.298285  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.299165  1622 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:47.300671  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:47.306298  1736 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.306933  1736 ts_tablet_manager.cc:1403] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.324s	user 0.024s	sys 0.034s
I20260709 12:59:47.310148  1737 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.310659  1737 ts_tablet_manager.cc:1403] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.373s	user 0.023s	sys 0.042s
I20260709 12:59:47.312842  1543 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:47.311403  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:47.313663  1985 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:47.317102  1736 raft_consensus.cc:359] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.314473  1737 raft_consensus.cc:359] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.318238  1737 raft_consensus.cc:385] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.318579  1737 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.318599  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:47.319334  1737 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.319881  2064 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.320465  2064 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:47.320988  1736 raft_consensus.cc:385] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.321300  1736 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.321130  1985 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:47.322060  1737 ts_tablet_manager.cc:1434] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 12:59:47.321530  2064 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.323241  1737 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.324326  1738 tablet_bootstrap.cc:654] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.329698  1737 tablet_bootstrap.cc:654] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.327142  1736 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.339320  1736 ts_tablet_manager.cc:1434] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260709 12:59:47.339627  1738 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.340096  1738 ts_tablet_manager.cc:1403] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.010s
I20260709 12:59:47.340209  1736 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.343392  1738 raft_consensus.cc:359] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.343930  1738 raft_consensus.cc:385] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.344200  1738 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.344820  1738 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.346812  1738 ts_tablet_manager.cc:1434] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:47.348892  1737 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.349620  1737 ts_tablet_manager.cc:1403] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.014s
I20260709 12:59:47.352165  1738 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.358678  1738 tablet_bootstrap.cc:654] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.358805  1736 tablet_bootstrap.cc:654] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.362406  1982 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:47.368345  2064 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.372866  2064 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.388897  2064 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.392941  1737 raft_consensus.cc:359] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.393038  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.398418  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.399220  1737 raft_consensus.cc:385] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.410990  1737 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.411778  1737 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.413300  1736 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.413772  1736 ts_tablet_manager.cc:1403] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.016s
W20260709 12:59:47.401571  1587 leader_election.cc:343] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.416735  1736 raft_consensus.cc:359] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.417186  1737 ts_tablet_manager.cc:1434] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:59:47.417436  1736 raft_consensus.cc:385] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.417730  1736 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.418284  1737 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.418370  1736 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:47.419430  1587 leader_election.cc:343] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.419924  1736 ts_tablet_manager.cc:1434] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:47.401777  2064 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:59:47.420578  1587 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:47.421887  1736 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.422349  2021 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:47.405501  1738 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.426699  1737 tablet_bootstrap.cc:654] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.427060  1738 ts_tablet_manager.cc:1403] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.001s
I20260709 12:59:47.427150  1972 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.398701  1442 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.427736  1972 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.429847  1972 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.429680  1738 raft_consensus.cc:359] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.430359  1738 raft_consensus.cc:385] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.430670  1738 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.431720  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.431357  1738 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.433460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.434214  1690 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:47.434942  2042 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.435503  1985 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.435401  2042 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.437562  2042 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.438923  1512 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:47.440866  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.441387  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.442296  1622 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:47.442860  2042 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:47.442363  1512 leader_election.cc:343] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.445333  1737 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.445812  1737 ts_tablet_manager.cc:1403] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 12:59:47.446898  1511 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:47.447762  1972 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.448104  1972 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.448444  1972 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.448207  1985 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.453042  1737 raft_consensus.cc:359] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.453733  1737 raft_consensus.cc:385] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.453989  1737 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.452241  2021 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.456522  2021 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.458529  2021 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.462608  1737 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.464018  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.464649  1547 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:47.465112  1738 ts_tablet_manager.cc:1434] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:59:47.465306  1972 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.466120  1738 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.461807  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.468067  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:47.468082  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.470844  1622 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.472100  1985 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.475531  1737 ts_tablet_manager.cc:1434] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:59:47.476517  1737 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.476400  1622 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:47.468483  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 12:59:47.477818  1512 leader_election.cc:343] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.480062  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.480727  1620 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:47.481051  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:47.483544  1587 leader_election.cc:343] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:47.483670  1661 leader_election.cc:343] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.484508  1511 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:47.485988  2064 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.486370  2064 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.470350  1972 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.486739  2064 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.487308  1736 tablet_bootstrap.cc:654] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.485985  2041 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.491376  2041 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:47.492326  2041 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.492923  2042 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:47.502635  1738 tablet_bootstrap.cc:654] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.505777  1660 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:47.507946  2064 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.509976  2064 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.515141  1985 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.515597  1985 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.515924  1985 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.518343  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:47.518976  1542 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.518201  2064 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:59:47.520324  1974 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:47.526232  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:47.527743  1542 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
W20260709 12:59:47.532296  1587 leader_election.cc:343] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.535096  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:47.536038  2064 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.537586  2064 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:47.537812  1737 tablet_bootstrap.cc:654] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.546546  1738 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.547055  1738 ts_tablet_manager.cc:1403] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.001s
I20260709 12:59:47.547873  2064 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.549037  1985 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.554364  1738 raft_consensus.cc:359] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.554692  1985 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.555265  1738 raft_consensus.cc:385] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.555246  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.555855  1738 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.556172  1622 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.556609  1738 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.561179  1738 ts_tablet_manager.cc:1434] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:59:47.555054  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:47.564329  1661 leader_election.cc:343] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.571985  1736 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.572439  1736 ts_tablet_manager.cc:1403] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.006s
I20260709 12:59:47.571408  1622 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:47.575215  1738 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.576270  1660 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:47.579612  1443 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.580271  1985 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.580986  1985 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:47.582036  1985 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.586838  1736 raft_consensus.cc:359] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.587510  1736 raft_consensus.cc:385] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.592893  1736 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.593910  1736 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.597584  1736 ts_tablet_manager.cc:1434] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:59:47.598642  1736 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.607913  1737 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.608440  1737 ts_tablet_manager.cc:1403] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.004s
I20260709 12:59:47.611430  1736 tablet_bootstrap.cc:654] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.611083  1737 raft_consensus.cc:359] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.611893  1737 raft_consensus.cc:385] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.612259  1737 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.613071  1737 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.617295  1737 ts_tablet_manager.cc:1434] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:59:47.617782  1738 tablet_bootstrap.cc:654] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.618309  1737 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.642051  1442 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.642804  1445 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.648644  1736 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.649145  1736 ts_tablet_manager.cc:1403] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.011s
I20260709 12:59:47.652091  1737 tablet_bootstrap.cc:654] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.652294  1738 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.652745  1738 ts_tablet_manager.cc:1403] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.007s
I20260709 12:59:47.655560  1738 raft_consensus.cc:359] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.656607  1738 raft_consensus.cc:385] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.656875  1738 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.657470  1738 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.654986  1736 raft_consensus.cc:359] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.658402  1736 raft_consensus.cc:385] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.658824  1736 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.660192  1738 ts_tablet_manager.cc:1434] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:59:47.661252  1736 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.661586  1738 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.663188  1736 ts_tablet_manager.cc:1434] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:59:47.665051  1736 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.668542  1738 tablet_bootstrap.cc:654] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.673918  1737 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.674274  1738 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.674424  1737 ts_tablet_manager.cc:1403] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.002s
I20260709 12:59:47.674734  1736 tablet_bootstrap.cc:654] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.674737  1738 ts_tablet_manager.cc:1403] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:59:47.677610  1737 raft_consensus.cc:359] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.678352  1737 raft_consensus.cc:385] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.678684  1737 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.679618  1985 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.679452  1737 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.680162  1985 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.682523  1737 ts_tablet_manager.cc:1434] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:59:47.683548  1737 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.683382  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:47.684751  1661 leader_election.cc:343] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.688884  1738 raft_consensus.cc:359] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.689682  1738 raft_consensus.cc:385] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.689922  1738 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.690512  1738 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.699383  1985 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.702912  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.703534  1622 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:47.706183  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:47.707860  1738 ts_tablet_manager.cc:1434] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:59:47.708389  2020 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.708814  2020 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.708927  1738 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.709173  2020 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.710371  1893 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.716928  1893 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.718423  2041 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.718918  2041 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.719473  1893 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.720431  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.720773  2041 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.726323  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.721772  2020 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.728271  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.727639  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.729301  1620 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:47.729904  2020 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.730453  1736 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.730417  1511 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:47.731021  1736 ts_tablet_manager.cc:1403] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.006s
W20260709 12:59:47.731235  1512 leader_election.cc:343] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.732227  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:47.732599  1511 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:47.732892  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.733387  1622 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:47.734160  1661 leader_election.cc:343] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.734661  1893 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.735054  1893 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.735337  1893 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.737287  1736 raft_consensus.cc:359] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.742268  1736 raft_consensus.cc:385] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.742512  1622 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:47.738337  2042 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:47.742686  1736 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.748940  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:47.742411  2041 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.751694  2041 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.750556  1823 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.754505  1823 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:47.755437  1823 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.765878  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:47.767835  1512 leader_election.cc:343] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.761771  2041 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.773193  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.775683  1737 tablet_bootstrap.cc:654] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.771839  1738 tablet_bootstrap.cc:654] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:47.783802  1511 leader_election.cc:343] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.784312  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:47.785071  2041 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:47.784885  1893 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.771828  1736 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.787814  1736 ts_tablet_manager.cc:1434] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.024s
I20260709 12:59:47.790212  2064 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.791299  1736 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.790724  2064 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.793219  2064 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.796571  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:47.798373  1445 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.801360  1736 tablet_bootstrap.cc:654] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.802145  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.803093  1547 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:47.803857  1893 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.804878  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 12:59:47.806628  1512 leader_election.cc:343] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.808588  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.809543  1620 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.808256  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:47.812620  1738 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:47.813087  1738 ts_tablet_manager.cc:1403] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.006s
I20260709 12:59:47.814798  1790 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.815196  1790 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.815490  1790 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.816115  1737 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:47.828290  1737 ts_tablet_manager.cc:1403] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.145s	user 0.005s	sys 0.011s
I20260709 12:59:47.816162  1620 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
W20260709 12:59:47.818475  1587 leader_election.cc:343] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.830575  1790 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.827778  1738 raft_consensus.cc:359] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.833310  1738 raft_consensus.cc:385] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.833602  1738 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.834679  1823 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.834280  1790 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.835168  1823 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.836567  1736 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:47.837014  1736 ts_tablet_manager.cc:1403] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:59:47.837631  1823 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.838528  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:47.839143  1620 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:47.840039  1660 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:47.834262  1738 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.840802  1823 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:47.841161  1823 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:47.841486  1823 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.841639  1736 raft_consensus.cc:359] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.842262  1736 raft_consensus.cc:385] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.842487  1736 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.832263  2064 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:47.843214  1736 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.843719  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:47.842533  1738 ts_tablet_manager.cc:1434] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:59:47.832171  1737 raft_consensus.cc:359] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.846994  1737 raft_consensus.cc:385] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:47.847293  1737 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:47.848877  1738 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:47.854961  1737 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.856772  1736 ts_tablet_manager.cc:1434] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.002s
I20260709 12:59:47.857061  1737 ts_tablet_manager.cc:1434] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260709 12:59:47.857831  1736 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:47.858547  1547 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.868191  1511 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 12:59:47.869508  1661 leader_election.cc:343] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.870245  2042 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:47.870731  2042 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:47.871495  2042 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.872042  2021 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:47.868211  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:47.875286  1543 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.860185  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:47.855340  1823 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.888090  1823 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:47.928853  1738 tablet_bootstrap.cc:654] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:47.927433  1737 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:47.930035  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 12:59:47.933744  1661 leader_election.cc:343] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.939512  2063 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.958791  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:47.959529  1622 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:59:47.963294  1722 tablet.cc:2406] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 12:59:47.968410  1587 leader_election.cc:343] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:47.968896  1693 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:47.962982  2063 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:47.986455  2063 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:47.999086  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:48.001132  2042 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.002831  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:48.003931  1690 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:48.005122  1444 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.006346  1543 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:48.007136  2042 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.015394  2019 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.016649  2019 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.026281  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:48.031625  1622 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
W20260709 12:59:48.036823  1587 leader_election.cc:343] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.038107  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:48.033677  1974 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:48.038792  2061 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:48.038856  1974 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.039283  1974 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:48.039335  2061 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:48.035006  1660 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:48.042804  1823 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:48.043262  1823 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:48.043982  1823 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.048267  2061 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.049762  2019 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:48.050446  1736 tablet_bootstrap.cc:654] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.050657  1738 tablet_bootstrap.cc:492] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:48.051750  1738 ts_tablet_manager.cc:1403] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.203s	user 0.031s	sys 0.018s
I20260709 12:59:48.053249  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:48.053243  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:59:48.059563  1587 leader_election.cc:343] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.063675  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:48.065412  1738 raft_consensus.cc:359] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.066077  1738 raft_consensus.cc:385] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.066339  1738 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.075418  1738 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:48.088654  1587 leader_election.cc:343] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.089246  1587 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:48.092145  2064 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:48.113826  2020 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.095631  1974 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.149839  1982 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.157703  1982 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.161927  1974 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:48.162230  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:48.162971  1621 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:48.168313  2063 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:48.177688  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:48.178757  1823 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:48.179219  1823 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.179087  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:48.179726  1823 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:48.179988  1547 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:48.191555  1982 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:48.193025  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:48.193610  1690 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:48.198354  1823 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.232889  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:48.233462  1547 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:48.253177  1823 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:48.233067  1444 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:48.199304  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:48.258284  1738 ts_tablet_manager.cc:1434] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.206s	user 0.018s	sys 0.007s
I20260709 12:59:48.269066  1547 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:48.270694  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:48.271420  1823 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:59:48.278203  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79064.7us
W20260709 12:59:48.288789  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:48.254588  1972 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.333277  1738 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:48.254321  2048 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:59:48.341539  1823 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:48.342653  1823 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.328140  1972 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.371482  1736 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:48.372058  1736 ts_tablet_manager.cc:1403] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.514s	user 0.024s	sys 0.015s
W20260709 12:59:48.372903  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 108758us
W20260709 12:59:48.384007  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 104265us
W20260709 12:59:48.413306  2099 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:59:48.433696  2100 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:59:48.414065  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:48.439349  1737 tablet_bootstrap.cc:654] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
W20260709 12:59:48.440034  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56190.5us
W20260709 12:59:48.443926  1587 leader_election.cc:343] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.447012  1972 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:48.443940  1619 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:48.493499  2108 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.494246  2108 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.498169  1736 raft_consensus.cc:359] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.499128  1736 raft_consensus.cc:385] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.499408  1736 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.503238  1736 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:48.506769  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62279.3us
I20260709 12:59:48.512081  1736 ts_tablet_manager.cc:1434] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.000s
I20260709 12:59:48.522291  1736 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:48.537153  1690 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:48.540807  2108 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:48.609776  1445 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:48.615795  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:48.623169  1738 tablet_bootstrap.cc:654] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.669834  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:48.673642  1982 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.651005  2063 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:59:48.689100  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:48.691591  1974 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:48.692286  1974 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:48.674307  1982 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.695530  1974 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.704210  1736 tablet_bootstrap.cc:654] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.705147  1619 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:48.711020  1982 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:48.726400  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:48.751163  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62145.1us
I20260709 12:59:48.757460  1737 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:48.757993  1737 ts_tablet_manager.cc:1403] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.872s	user 0.031s	sys 0.069s
I20260709 12:59:48.771852  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:48.783540  1738 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:48.784044  1738 ts_tablet_manager.cc:1403] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.506s	user 0.014s	sys 0.023s
I20260709 12:59:48.847506  1737 raft_consensus.cc:359] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.848696  1737 raft_consensus.cc:385] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.848958  1737 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.854537  1738 raft_consensus.cc:359] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.855319  1738 raft_consensus.cc:385] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.855553  1738 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.858578  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:48.863130  1737 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:48.865872  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:48.866779  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:48.869743  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:48.869493  1738 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:48.870286  1587 leader_election.cc:343] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.887789  1736 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:48.888331  1736 ts_tablet_manager.cc:1403] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.366s	user 0.025s	sys 0.036s
I20260709 12:59:48.888986  2112 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:59:48.887826  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:48.900367  1737 ts_tablet_manager.cc:1434] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.142s	user 0.005s	sys 0.002s
I20260709 12:59:48.901567  1737 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:48.904255  1738 ts_tablet_manager.cc:1434] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.120s	user 0.007s	sys 0.000s
I20260709 12:59:48.905874  1736 raft_consensus.cc:359] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.907058  1736 raft_consensus.cc:385] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.907351  1736 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.908030  1736 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.910337  1736 ts_tablet_manager.cc:1434] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:59:48.911103  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:48.911985  1738 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
W20260709 12:59:48.913477  1512 leader_election.cc:343] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:48.920660  1587 leader_election.cc:343] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.921183  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:48.921885  2019 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:48.923674  1738 tablet_bootstrap.cc:654] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.925112  1737 tablet_bootstrap.cc:654] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.933133  1736 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
W20260709 12:59:48.933601  1512 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:48.934302  2116 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.934894  2116 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.936906  2116 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 12:59:48.937615  1660 leader_election.cc:343] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.940930  1738 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:48.941381  1738 ts_tablet_manager.cc:1403] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
W20260709 12:59:48.941715  1511 leader_election.cc:343] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.942107  1511 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:48.945250  1736 tablet_bootstrap.cc:654] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:48.947630  2042 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:48.948098  2106 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:48.949797  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:48.952278  1737 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:48.952769  1737 ts_tablet_manager.cc:1403] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.011s
I20260709 12:59:48.957984  1737 raft_consensus.cc:359] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.959092  1737 raft_consensus.cc:385] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.961081  1737 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.962010  1737 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.965224  1737 ts_tablet_manager.cc:1434] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:48.967212  1737 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:48.967795  1738 raft_consensus.cc:359] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.968905  1738 raft_consensus.cc:385] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:48.969183  1738 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:48.969837  1738 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:48.971908  1738 ts_tablet_manager.cc:1434] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:59:48.972234  1445 catalog_manager.cc:5697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.976729  2114 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:48.977530  1736 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:48.977995  1736 ts_tablet_manager.cc:1403] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.017s
W20260709 12:59:48.984174  1661 leader_election.cc:343] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:48.985718  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:48.984612  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:48.986918  1985 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:48.994807  1737 tablet_bootstrap.cc:654] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.000231  1736 raft_consensus.cc:359] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.001652  1736 raft_consensus.cc:385] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.002228  1736 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.004618  1738 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.008728  1442 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.018126  1736 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.047142  1736 ts_tablet_manager.cc:1434] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.005s
I20260709 12:59:49.047785  2114 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.048629  1736 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.051333  1511 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:49.055599  1738 tablet_bootstrap.cc:654] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.056504  1982 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:59:49.059119  2111 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.083103  1737 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:49.083609  1737 ts_tablet_manager.cc:1403] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.003s
I20260709 12:59:49.048282  2114 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.089766  2108 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.090262  2108 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.092173  2108 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.107631  1736 tablet_bootstrap.cc:654] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.123623  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.124301  1547 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:49.125674  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.126462  1737 raft_consensus.cc:359] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.127355  1737 raft_consensus.cc:385] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.127684  1737 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.130321  1974 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.130738  1974 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.131054  1974 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.137454  2114 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.138134  1974 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.140184  1974 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.140069  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:49.143010  1587 leader_election.cc:343] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.145689  1737 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.177515  1737 ts_tablet_manager.cc:1434] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 12:59:49.180037  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.199203  1737 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
I20260709 12:59:49.189891  1541 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:49.201735  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.203198  1738 tablet_bootstrap.cc:492] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.204721  1738 ts_tablet_manager.cc:1403] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.201s	user 0.026s	sys 0.022s
I20260709 12:59:49.213626  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:49.204586  1615 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:49.217351  1982 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.221243  1737 tablet_bootstrap.cc:654] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.227941  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:49.230878  1982 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.234292  1982 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.239543  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:49.240998  1540 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.241230  1545 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.270925  1982 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.272943  1982 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 12:59:49.344619  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45627.7us
W20260709 12:59:49.353794  1493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:59:49.359577  1587 leader_election.cc:343] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.353137  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:49.363991  1737 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:49.364645  1737 ts_tablet_manager.cc:1403] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.167s	user 0.023s	sys 0.018s
I20260709 12:59:49.366817  1736 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.367274  1736 ts_tablet_manager.cc:1403] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.319s	user 0.023s	sys 0.008s
I20260709 12:59:49.370307  1736 raft_consensus.cc:359] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.373416  1736 raft_consensus.cc:385] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.373733  1736 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.376030  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:49.376605  1617 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.376003  1736 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.368101  1541 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.389971  1736 ts_tablet_manager.cc:1434] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:59:49.391014  1736 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.394145  1617 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:49.399017  2123 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:49.399506  1660 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.400203  2020 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.400669  2020 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:49.401885  2020 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.379081  1540 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:49.411105  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 12:59:49.412222  2104 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.412698  2104 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:49.412798  1737 raft_consensus.cc:359] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.413735  1737 raft_consensus.cc:385] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.413548  1738 raft_consensus.cc:359] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.414065  1737 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.411294  1541 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:49.416296  1737 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.414266  1738 raft_consensus.cc:385] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.413470  2104 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.417397  1738 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.418526  1737 ts_tablet_manager.cc:1434] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:59:49.419561  1737 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Bootstrap starting.
W20260709 12:59:49.424474  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:49.425946  1737 tablet_bootstrap.cc:654] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.430755  1738 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.437929  1738 ts_tablet_manager.cc:1434] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.233s	user 0.021s	sys 0.008s
I20260709 12:59:49.438932  1738 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.441478  2021 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.441527  1737 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: No bootstrap required, opened a new log
I20260709 12:59:49.442092  2021 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.442637  1737 ts_tablet_manager.cc:1403] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.008s
I20260709 12:59:49.444597  2021 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.445765  1737 raft_consensus.cc:359] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.446503  1737 raft_consensus.cc:385] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.446818  1737 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.447451  1737 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.451890  1442 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.455458  1737 ts_tablet_manager.cc:1434] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:59:49.455211  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.458833  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 12:59:49.459213  1587 leader_election.cc:343] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:59:49.460799  1587 leader_election.cc:343] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.461169  1587 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:49.462881  2105 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.473585  1738 tablet_bootstrap.cc:654] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.476078  1736 tablet_bootstrap.cc:654] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.484750  2114 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.485272  2114 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.487803  2114 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.489609  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.491339  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.491963  1617 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:49.493709  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.477383  1442 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:49.494412  1661 leader_election.cc:343] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.496701  2122 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.497082  2122 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.497398  2122 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.499065  1738 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.499904  1738 ts_tablet_manager.cc:1403] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.009s
I20260709 12:59:49.503350  1738 raft_consensus.cc:359] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.504006  1738 raft_consensus.cc:385] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.504256  1738 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.505401  1738 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.505537  2122 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.507552  1738 ts_tablet_manager.cc:1434] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:59:49.507905  2122 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.508302  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:49.508574  1738 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.510633  2021 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.511102  2021 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 12:59:49.513042  1661 leader_election.cc:343] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.514424  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:49.515084  1617 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.515496  1738 tablet_bootstrap.cc:654] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.517622  1736 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.518062  1736 ts_tablet_manager.cc:1403] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.127s	user 0.010s	sys 0.006s
I20260709 12:59:49.519167  1689 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.520514  1736 raft_consensus.cc:359] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.521147  1736 raft_consensus.cc:385] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.521414  1736 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.522028  1736 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.524008  1736 ts_tablet_manager.cc:1434] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:59:49.524883  1736 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.536736  1617 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 12:59:49.538137  1736 tablet_bootstrap.cc:654] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.539722  2021 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.540277  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 12:59:49.541361  1587 leader_election.cc:343] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.614336  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:49.621658  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:49.623080  2122 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.623581  2122 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 12:59:49.624372  2122 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.640334  2130 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.640848  2130 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.643725  2130 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.650795  1736 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.651289  1736 ts_tablet_manager.cc:1403] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.127s	user 0.025s	sys 0.013s
I20260709 12:59:49.653903  1736 raft_consensus.cc:359] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.654563  1736 raft_consensus.cc:385] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.654839  1736 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.657047  1738 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.657512  1738 ts_tablet_manager.cc:1403] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.149s	user 0.022s	sys 0.018s
I20260709 12:59:49.660048  1738 raft_consensus.cc:359] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.660702  1738 raft_consensus.cc:385] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.660961  1738 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.661806  1736 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.663967  1736 ts_tablet_manager.cc:1434] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:59:49.664906  1736 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.670845  1738 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.673141  1738 ts_tablet_manager.cc:1434] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 12:59:49.670490  1736 tablet_bootstrap.cc:654] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.674320  1738 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.677521  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.678262  1543 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:49.683046  1738 tablet_bootstrap.cc:654] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.684684  1736 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.685135  1736 ts_tablet_manager.cc:1403] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:59:49.686118  1443 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.688081  1736 raft_consensus.cc:359] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.688726  1736 raft_consensus.cc:385] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.688975  1736 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.689682  1736 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.691926  1736 ts_tablet_manager.cc:1434] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:59:49.692876  1736 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.694211  1738 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.694671  1738 ts_tablet_manager.cc:1403] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 12:59:49.697479  1738 raft_consensus.cc:359] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.698107  1738 raft_consensus.cc:385] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.698359  1736 tablet_bootstrap.cc:654] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.698359  1738 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.699250  1738 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.701640  1738 ts_tablet_manager.cc:1434] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:59:49.703285  1738 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.704836  1736 tablet_bootstrap.cc:492] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.705284  1736 ts_tablet_manager.cc:1403] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:59:49.708173  1736 raft_consensus.cc:359] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.708822  1736 raft_consensus.cc:385] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.709065  1736 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.709636  1736 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.711380  1738 tablet_bootstrap.cc:654] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.712009  1736 ts_tablet_manager.cc:1434] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:59:49.712989  1736 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
W20260709 12:59:49.717314  1587 leader_election.cc:343] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:59:49.717741  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 12:59:49.718500  1736 tablet_bootstrap.cc:654] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.720928  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:49.721550  1693 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 0.
I20260709 12:59:49.728504  2105 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.730706  2120 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.731184  2120 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.731762  1736 tablet_bootstrap.cc:492] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.732191  1736 ts_tablet_manager.cc:1403] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:59:49.736989  2122 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.737104  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.737361  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:49.737936  1693 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.737905  1615 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.737797  2122 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.739292  1511 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.740000  2106 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.740320  2106 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.740619  2106 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.741441  2120 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.742321  2122 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.746666  2120 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.747193  2120 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.748919  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.749521  2120 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.749738  1543 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 12:59:49.752038  2106 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.754022  2106 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.754798  1736 raft_consensus.cc:359] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.755546  1736 raft_consensus.cc:385] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.755673  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.755896  1736 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.756899  1738 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.756812  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.756645  1736 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.757395  1738 ts_tablet_manager.cc:1403] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.008s
I20260709 12:59:49.758124  1660 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:49.758244  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.758826  1615 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.759014  1736 ts_tablet_manager.cc:1434] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:59:49.758876  2020 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.759730  2130 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.759840  1738 raft_consensus.cc:359] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.760165  2130 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.760215  1736 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Bootstrap starting.
I20260709 12:59:49.760545  1738 raft_consensus.cc:385] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.760628  2130 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.760862  1738 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.761495  1738 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.763510  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:49.764113  1691 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.765172  1511 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.768028  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:49.767167  2130 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.768379  1736 tablet_bootstrap.cc:654] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.768561  1615 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.772147  2120 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.772481  2120 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.772768  2120 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.778452  2130 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.780498  2120 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.783818  1738 ts_tablet_manager.cc:1434] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:59:49.784430  2120 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.784791  1738 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.786082  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:49.786665  1691 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.793326  1691 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:49.793906  1736 tablet_bootstrap.cc:492] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: No bootstrap required, opened a new log
I20260709 12:59:49.794394  1736 ts_tablet_manager.cc:1403] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 12:59:49.794415  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:49.795255  2120 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.795702  2120 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:49.796473  2120 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.799968  1738 tablet_bootstrap.cc:654] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.800287  2114 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.800762  2114 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.801867  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:49.802465  1618 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.802078  1736 raft_consensus.cc:359] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.803699  1736 raft_consensus.cc:385] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.803795  2114 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.804451  1736 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.805706  1736 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.810194  1736 ts_tablet_manager.cc:1434] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:59:49.810377  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.811333  1618 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:49.812067  1738 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.812559  1738 ts_tablet_manager.cc:1403] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.003s
I20260709 12:59:49.817440  1615 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:49.812567  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:49.818980  1693 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.826582  1738 raft_consensus.cc:359] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.827478  1738 raft_consensus.cc:385] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.827803  1738 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.828351  1738 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.829233  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:49.829754  1696 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.830264  1738 ts_tablet_manager.cc:1434] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:59:49.829782  1689 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.785529  2020 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.831717  1738 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Bootstrap starting.
I20260709 12:59:49.837992  1738 tablet_bootstrap.cc:654] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Neither blocks nor log segments found. Creating new log.
I20260709 12:59:49.840225  1689 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:49.843779  1687 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.853605  1738 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: No bootstrap required, opened a new log
I20260709 12:59:49.854543  1738 ts_tablet_manager.cc:1403] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.010s
I20260709 12:59:49.855094  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.855445  1511 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.857264  2172 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.856089  1693 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:49.858908  2109 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:49.860271  1738 raft_consensus.cc:359] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.867237  1738 raft_consensus.cc:385] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:59:49.859864  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:49.868803  1738 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Initialized, Role: FOLLOWER
I20260709 12:59:49.868660  2020 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.870180  2109 raft_consensus.cc:697] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 12:59:49.871814  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.872531  2172 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:49.871889  2020 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.872406  1738 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.872331  1540 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.884847  1442 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.887176  1738 ts_tablet_manager.cc:1434] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:59:49.882085  2109 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.893481  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:49.895072  2020 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:49.895318  2106 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.895749  2106 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.895643  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.897257  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:49.897294  1540 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 12:59:49.897868  2106 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.882486  2172 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.898761  2114 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:49.903653  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:49.905081  1693 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.905601  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:49.915299  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.919438  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 0.
I20260709 12:59:49.917593  2106 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.923683  2114 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.923259  2106 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:49.925143  2114 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.925907  2114 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.933264  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:49.934559  1540 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 0.
I20260709 12:59:49.933346  2106 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:49.936842  2123 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:49.938759  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:49.950011  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 12:59:49.950851  2106 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:59:49.951221  2106 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.951553  2106 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:49.972378  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:50.004572  2107 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 12:59:50.005391  2107 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.002013  2105 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:59:50.011601  2107 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:50.012387  2107 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.019619  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.033330  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 12:59:50.026198  2120 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.034660  2120 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.036566  2120 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:50.021762  1893 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:50.038192  1546 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:50.041471  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:50.043327  2106 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.054899  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:50.061626  2106 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:50.061811  1511 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.062690  2106 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:50.079809  1985 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:50.083285  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:50.083906  1622 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:50.073266  1443 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.105826  1442 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.083318  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 12:59:50.092818  2172 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.125934  1622 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 12:59:50.123791  1893 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:50.128695  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:50.137916  2172 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.143924  1893 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.179553  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 12:59:50.189618  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.187108  2106 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:59:50.206024  2106 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 12:59:50.217571  2190 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:50.222563  2172 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:50.225793  2106 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.235932  1893 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:50.211715  2107 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:59:50.213817  2114 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 12:59:50.256285  2114 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:50.257094  1691 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 1: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 12:59:50.261492  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:50.264263  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 12:59:50.267719  1616 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 1: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 12:59:50.272724  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 82440us
I20260709 12:59:50.281313  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:50.284328  1544 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:50.288198  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 12:59:50.290032  1538 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:50.294209  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.296118  1540 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:59:50.299880  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.300818  2188 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:59:50.293702  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 12:59:50.307710  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 12:59:50.402387  2188 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:50.361377  2193 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:59:50.424109  1511 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 12:59:50.430401  2192 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:50.444847  2192 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.417632  1445 catalog_manager.cc:5697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.467300  2120 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.470012  2120 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.483132  2205 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:59:50.488874  2193 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:59:50.536693  2205 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.616832  2120 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:50.627802  2204 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:59:51.076999   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:59:51.105085  2223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:51.105371  2221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:59:51.105911  2220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:59:51.106055   431 server_base.cc:1061] running on GCE node
I20260709 12:59:51.108711   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:59:51.108960   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:59:51.109203   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601991109156 us; error 0 us; skew 500 ppm
I20260709 12:59:51.109828   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:59:51.112774   431 webserver.cc:533] Webserver started at http://127.0.107.196:43101/ using document root <none> and password file <none>
I20260709 12:59:51.113293   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:59:51.113507   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:59:51.113827   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:59:51.115127   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-3-root/instance:
uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
format_stamp: "Formatted at 2026-07-09 12:59:51 on dist-test-slave-n5kz"
I20260709 12:59:51.122994   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:59:51.127135  2228 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:51.127892   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:59:51.128219   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-3-root
uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
format_stamp: "Formatted at 2026-07-09 12:59:51 on dist-test-slave-n5kz"
I20260709 12:59:51.128569   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:59:51.152827   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:59:51.154247   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:59:51.155624   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:59:51.157730   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:59:51.157919   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:51.158110   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:59:51.158246   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:59:51.232414   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:32925
I20260709 12:59:51.232534  2290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:32925 every 8 connection(s)
I20260709 12:59:51.239454   431 auto_leader_rebalancer-test.cc:384] add a tserver: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:51.253163  2291 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35005
I20260709 12:59:51.253600  2291 heartbeater.cc:461] Registering TS with master...
I20260709 12:59:51.254354  2291 heartbeater.cc:507] Master 127.0.107.254:35005 requested a full tablet report, sending...
I20260709 12:59:51.256384  1442 ts_manager.cc:194] Registered new tserver with Master: e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 12:59:51.258031  1442 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47940
I20260709 12:59:51.693854  1616 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:51.701321  1691 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.707680  1538 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.710754  2205 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.712976  2123 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:51.722417  1585 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 831605a002324a04838f4fe562b13530. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:51.721942  2205 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.727348  1691 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.729071  1538 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.742898  1442 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:51.770828  1691 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:51.784344  1539 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.784696  1616 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.786605  1982 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.787479  2188 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:51.794855  1659 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7316b60a2ea04a109142470c7a827717. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:51.798198  2188 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.799794  1616 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.804859  1539 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.825861  1691 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:51.825287  1444 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 12:59:51.846074  1659 consensus_peers.cc:597] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa0547666b41440ebc195aa8cd34bc9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:51.846868  1616 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.848004  1539 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.848573  1982 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.855847  1982 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.862975  2188 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.865520  1616 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.866767  1541 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.879047  1622 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:51.883533  1442 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.888489  1691 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:51.889983  1539 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:51.890404  1585 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a0c52190de849839b129a0fa6099693. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:51.891341  2205 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.892295  2206 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:51.906447  2205 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.908157  1541 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.922850  1442 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:51.925623  1691 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:52.239915  2317 ts_tablet_manager.cc:933] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:52.241916  2317 tablet_copy_client.cc:323] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:52.255751  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 831605a002324a04838f4fe562b13530 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:52.256825  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 831605a002324a04838f4fe562b13530 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-831605a002324a04838f4fe562b13530
I20260709 12:59:52.261057  2291 heartbeater.cc:499] Master 127.0.107.254:35005 was elected leader, sending a full tablet report...
I20260709 12:59:52.265709  1632 tablet_copy_source_session.cc:215] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:52.271052  2317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 831605a002324a04838f4fe562b13530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:52.287112  2317 tablet_copy_client.cc:806] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:52.287802  2317 tablet_copy_client.cc:670] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:52.292790  2317 tablet_copy_client.cc:538] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:52.300655  2317 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:52.325636  2317 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:52.326719  2317 tablet_bootstrap.cc:492] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:52.327347  2317 ts_tablet_manager.cc:1403] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:59:52.331132  2317 raft_consensus.cc:359] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.332023  2317 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:52.332651  2317 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.335615  2317 ts_tablet_manager.cc:1434] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:59:52.337445  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-831605a002324a04838f4fe562b13530 received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:52.337939  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-831605a002324a04838f4fe562b13530 on tablet 831605a002324a04838f4fe562b13530 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:52.342589  2323 ts_tablet_manager.cc:933] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:52.351418  2323 tablet_copy_client.cc:323] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 12:59:52.399537  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 7316b60a2ea04a109142470c7a827717 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 12:59:52.400137  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 7316b60a2ea04a109142470c7a827717 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-7316b60a2ea04a109142470c7a827717
I20260709 12:59:52.407819  1706 tablet_copy_source_session.cc:215] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:52.410833  2323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7316b60a2ea04a109142470c7a827717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:52.418694  2317 ts_tablet_manager.cc:933] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:52.423372  2317 tablet_copy_client.cc:323] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 12:59:52.423976  2323 tablet_copy_client.cc:806] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:52.424553  2323 tablet_copy_client.cc:670] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:52.425117  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet aa0547666b41440ebc195aa8cd34bc9d from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 12:59:52.425906  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet aa0547666b41440ebc195aa8cd34bc9d from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-aa0547666b41440ebc195aa8cd34bc9d
I20260709 12:59:52.429142  2323 tablet_copy_client.cc:538] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:52.439424  2323 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:52.455567  1706 tablet_copy_source_session.cc:215] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:52.473272  2317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0547666b41440ebc195aa8cd34bc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:52.473291  2323 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:52.478009  2323 tablet_bootstrap.cc:492] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:52.478768  2323 ts_tablet_manager.cc:1403] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.006s
I20260709 12:59:52.483657  2323 raft_consensus.cc:359] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.484856  2323 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:52.485760  2323 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.488569  2323 ts_tablet_manager.cc:1434] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:59:52.499300  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7316b60a2ea04a109142470c7a827717 received from {username='slave'} at 127.0.0.1:43624
I20260709 12:59:52.499759  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7316b60a2ea04a109142470c7a827717 on tablet 7316b60a2ea04a109142470c7a827717 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:52.502238  2323 ts_tablet_manager.cc:933] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:52.512188  2323 tablet_copy_client.cc:323] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:52.513859  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 4a0c52190de849839b129a0fa6099693 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:52.513996  2317 tablet_copy_client.cc:806] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:52.514408  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 4a0c52190de849839b129a0fa6099693 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-4a0c52190de849839b129a0fa6099693
I20260709 12:59:52.514600  2317 tablet_copy_client.cc:670] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:52.518473  2317 tablet_copy_client.cc:538] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:52.523835  1632 tablet_copy_source_session.cc:215] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:52.527621  2317 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:52.528446  2323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a0c52190de849839b129a0fa6099693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:52.549331  2323 tablet_copy_client.cc:806] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:52.552211  2323 tablet_copy_client.cc:670] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:52.558730  2323 tablet_copy_client.cc:538] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:52.561069  2317 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:52.562366  2317 tablet_bootstrap.cc:492] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:52.563086  2317 ts_tablet_manager.cc:1403] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.008s
I20260709 12:59:52.565701  2317 raft_consensus.cc:359] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.566325  2317 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:52.567006  2317 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.569612  2323 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:52.576386  2317 ts_tablet_manager.cc:1434] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.004s
I20260709 12:59:52.582868  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-aa0547666b41440ebc195aa8cd34bc9d received from {username='slave'} at 127.0.0.1:43624
I20260709 12:59:52.583345  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-aa0547666b41440ebc195aa8cd34bc9d on tablet aa0547666b41440ebc195aa8cd34bc9d with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:52.591825  2323 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:52.593197  2323 tablet_bootstrap.cc:492] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:52.593873  2323 ts_tablet_manager.cc:1403] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 12:59:52.597198  2323 raft_consensus.cc:359] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.598045  2323 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:52.598678  2323 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:52.600873  2323 ts_tablet_manager.cc:1434] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.007s
I20260709 12:59:52.602938  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-4a0c52190de849839b129a0fa6099693 received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:52.603345  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-4a0c52190de849839b129a0fa6099693 on tablet 4a0c52190de849839b129a0fa6099693 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:52.730489  2266 raft_consensus.cc:1217] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:52.915560  2266 raft_consensus.cc:1217] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.016506  2266 raft_consensus.cc:1217] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.071653  2266 raft_consensus.cc:1217] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:53.271518  2123 raft_consensus.cc:1064] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:53.273880  2123 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.280694  2266 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.281420  1689 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.282531  2205 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.290856  2123 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.292109  1541 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.294188  2123 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.299803  2333 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.311188  2266 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.321053  1444 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.319803  1688 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.331399  1538 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.357333  1982 raft_consensus.cc:1064] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:53.360070  1982 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.378886  2266 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.379691  1539 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.381453  1616 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.384637  2122 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.385732  2188 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.388854  1982 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:53.613405  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 225727us
I20260709 12:59:53.673906  2123 raft_consensus.cc:1064] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:53.676292  2188 raft_consensus.cc:1064] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:53.676713  2123 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.680101  2188 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.679641  1622 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.691273  2265 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:53.694217  2205 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:53.696614  1543 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:53.700580  2264 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.702066  2334 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.707844  2264 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.710863  2334 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:53.714599  1539 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.705523  2344 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.726572  2123 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.732151  2265 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.731501  2333 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.732707  2266 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.737089  2349 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.761240  1696 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.774423  1544 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.776459  2188 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.769809  1541 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.765612  1442 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.766719  1539 raft_consensus.cc:2955] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 12:59:53.911701  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 72087.2us
I20260709 12:59:53.919991  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 831605a002324a04838f4fe562b13530 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:53.939215  1617 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:53.952708  2361 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:53.956693  1444 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:53.959582  2346 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.967384  1622 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.970805  1546 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.978698  1691 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:53.987145  2266 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:53.991487  2188 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:53.992044  2349 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:53.995757  2343 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:53.999773  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 831605a002324a04838f4fe562b13530 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 12:59:54.010440  1546 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.016470  2122 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:59:54.038995  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 105235us
I20260709 12:59:54.038918  1547 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.062525  2349 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.078775  2266 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.082901  2263 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.083731  1444 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.104856  1687 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.112840  1547 raft_consensus.cc:2955] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.121771  1617 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:54.133119  2366 tablet_replica.cc:333] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 12:59:54.134200  2366 raft_consensus.cc:2243] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.134588  2265 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.115048  2263 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.141146  2334 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.147640  2366 raft_consensus.cc:2272] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.148777  1539 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.141921  1442 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:54.167012  1622 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.167786  2334 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.173826  2265 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.175958  1444 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.191231  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7316b60a2ea04a109142470c7a827717 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.197912  2206 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.199986  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4a0c52190de849839b129a0fa6099693 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.204784  2366 ts_tablet_manager.cc:1916] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.209784  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 7316b60a2ea04a109142470c7a827717 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 12:59:54.216755  1445 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.218070  1689 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:54.236240  2368 tablet_replica.cc:333] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 12:59:54.237033  1622 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.237236  2368 raft_consensus.cc:2243] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.237910  2368 raft_consensus.cc:2272] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.239002  2343 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.239580  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 4a0c52190de849839b129a0fa6099693 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 12:59:54.237933  1543 raft_consensus.cc:2955] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.248019  2122 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.249401  1618 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.247658  2265 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:54.256188  2344 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:54.259883  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa0547666b41440ebc195aa8cd34bc9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:54.262781  2368 ts_tablet_manager.cc:1916] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.272913  1442 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:54.265636  2265 raft_consensus.cc:2955] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:54.284300  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet aa0547666b41440ebc195aa8cd34bc9d with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 12:59:54.300086  2366 ts_tablet_manager.cc:1929] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.300784  2366 log.cc:1199] T 831605a002324a04838f4fe562b13530 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/831605a002324a04838f4fe562b13530
I20260709 12:59:54.302443  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 831605a002324a04838f4fe562b13530 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:54.302621  2366 tablet_replica.cc:333] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 12:59:54.304067  2366 raft_consensus.cc:2243] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.304488  2369 tablet_replica.cc:333] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 12:59:54.304893  2366 raft_consensus.cc:2272] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.306000  2369 raft_consensus.cc:2243] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:54.306681  2369 raft_consensus.cc:2272] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:54.308569  2368 ts_tablet_manager.cc:1929] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.309005  2368 log.cc:1199] T 7316b60a2ea04a109142470c7a827717 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/7316b60a2ea04a109142470c7a827717
I20260709 12:59:54.309808  2369 ts_tablet_manager.cc:1916] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.311077  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet 7316b60a2ea04a109142470c7a827717 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:54.312763  2366 ts_tablet_manager.cc:1916] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:54.323601  2369 ts_tablet_manager.cc:1929] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.324013  2369 log.cc:1199] T aa0547666b41440ebc195aa8cd34bc9d P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/aa0547666b41440ebc195aa8cd34bc9d
I20260709 12:59:54.325603  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet aa0547666b41440ebc195aa8cd34bc9d (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:54.326905  2366 ts_tablet_manager.cc:1929] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:54.327338  2366 log.cc:1199] T 4a0c52190de849839b129a0fa6099693 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/4a0c52190de849839b129a0fa6099693
I20260709 12:59:54.328584  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 4a0c52190de849839b129a0fa6099693 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
W20260709 12:59:54.505686  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7260 after lost signal to thread 434
W20260709 12:59:54.506693  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800146720 after lost signal to thread 1479
W20260709 12:59:54.507557  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800304060 after lost signal to thread 1571
W20260709 12:59:54.508358  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08001377c0 after lost signal to thread 1646
W20260709 12:59:54.509390  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08001bea40 after lost signal to thread 1720
W20260709 12:59:54.510413  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf120 after lost signal to thread 2290
I20260709 12:59:55.535377  1542 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:55.582731  1689 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.584535  2207 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.586280  1622 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.594931  2382 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.606319  2207 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.608698  1687 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.621459  1618 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 12:59:55.632031  1510 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c2bf53312944dfc854b092b66a8dce2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:55.645702  1442 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:55.653628  1618 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 12:59:55.681336  1585 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb5d38534bcc45e19c58dcc3139a4ee6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:55.683655  1687 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.684895  1542 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.685420  2364 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.686950  2374 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.714414  2334 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.715603  1688 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.740868  1445 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.748908  1542 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.767064  1618 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 12:59:55.793938  1585 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f9a39f263da4577833a605ef819b007. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:55.795861  1688 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.797206  2374 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.798261  1542 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.799827  2374 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:55.807241  2334 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.810150  1688 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.811947  1547 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.827447  1688 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:55.832580  1444 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.853590  1618 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:59:55.855274  1659 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10a7d9e12aa94413b57ebc59c8f15757. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:55.858924  2376 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:55.860698  1547 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:55.873433  2375 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:55.934667  2376 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.938170  1544 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.959064  1442 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:55.962543  1622 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 12:59:56.000777  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52349.3us
I20260709 12:59:56.067083  2402 ts_tablet_manager.cc:933] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 12:59:56.071447  2402 tablet_copy_client.cc:323] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 12:59:56.110261  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet 7c2bf53312944dfc854b092b66a8dce2 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 12:59:56.110976  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet 7c2bf53312944dfc854b092b66a8dce2 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-7c2bf53312944dfc854b092b66a8dce2
I20260709 12:59:56.119943  1557 tablet_copy_source_session.cc:215] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:56.124050  2402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c2bf53312944dfc854b092b66a8dce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:56.174889  2402 tablet_copy_client.cc:806] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:56.175609  2402 tablet_copy_client.cc:670] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:56.182210  2402 tablet_copy_client.cc:538] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:56.194294  2402 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:56.220870  2402 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:56.221985  2402 tablet_bootstrap.cc:492] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:56.222769  2402 ts_tablet_manager.cc:1403] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.008s
I20260709 12:59:56.225956  2402 raft_consensus.cc:359] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.226835  2402 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:56.227564  2402 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.274245  2402 ts_tablet_manager.cc:1434] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.051s	user 0.013s	sys 0.004s
I20260709 12:59:56.267877  2409 ts_tablet_manager.cc:933] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:56.276093  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7c2bf53312944dfc854b092b66a8dce2 received from {username='slave'} at 127.0.0.1:35956
I20260709 12:59:56.276603  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7c2bf53312944dfc854b092b66a8dce2 on tablet 7c2bf53312944dfc854b092b66a8dce2 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:56.284245  2402 ts_tablet_manager.cc:933] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:56.298123  2409 tablet_copy_client.cc:323] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:56.300365  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet bb5d38534bcc45e19c58dcc3139a4ee6 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:56.300992  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet bb5d38534bcc45e19c58dcc3139a4ee6 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-bb5d38534bcc45e19c58dcc3139a4ee6
I20260709 12:59:56.301205  2402 tablet_copy_client.cc:323] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:56.303563  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 1f9a39f263da4577833a605ef819b007 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:56.304088  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 1f9a39f263da4577833a605ef819b007 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-1f9a39f263da4577833a605ef819b007
I20260709 12:59:56.309695  1632 tablet_copy_source_session.cc:215] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:56.316790  2409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb5d38534bcc45e19c58dcc3139a4ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:56.321843  1631 tablet_copy_source_session.cc:215] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:56.341167  2402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f9a39f263da4577833a605ef819b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:56.354099  2409 tablet_copy_client.cc:806] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:56.354841  2409 tablet_copy_client.cc:670] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:56.363967  2409 tablet_copy_client.cc:538] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:56.372300  2402 tablet_copy_client.cc:806] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:56.380309  2402 tablet_copy_client.cc:670] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:56.380473  2409 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:56.384702  2402 tablet_copy_client.cc:538] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:56.395432  2402 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:56.424954  2409 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:56.426014  2409 tablet_bootstrap.cc:492] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:56.426914  2409 ts_tablet_manager.cc:1403] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.007s
I20260709 12:59:56.430994  2409 raft_consensus.cc:359] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.431916  2409 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:56.432565  2409 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.440070  2409 ts_tablet_manager.cc:1434] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:59:56.442656  2408 ts_tablet_manager.cc:933] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:56.444255  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-bb5d38534bcc45e19c58dcc3139a4ee6 received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:56.444957  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-bb5d38534bcc45e19c58dcc3139a4ee6 on tablet bb5d38534bcc45e19c58dcc3139a4ee6 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:56.452960  2402 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:56.453088  2408 tablet_copy_client.cc:323] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 12:59:56.455428  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 10a7d9e12aa94413b57ebc59c8f15757 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 12:59:56.455987  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 10a7d9e12aa94413b57ebc59c8f15757 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-10a7d9e12aa94413b57ebc59c8f15757
I20260709 12:59:56.464676  1706 tablet_copy_source_session.cc:215] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:56.466688  2402 tablet_bootstrap.cc:492] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:56.467537  2402 ts_tablet_manager.cc:1403] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.013s
I20260709 12:59:56.472282  2408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a7d9e12aa94413b57ebc59c8f15757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:56.480940  2402 raft_consensus.cc:359] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.481865  2402 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:56.482514  2402 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.498200  2402 ts_tablet_manager.cc:1434] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:59:56.506125  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-1f9a39f263da4577833a605ef819b007 received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:56.506570  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-1f9a39f263da4577833a605ef819b007 on tablet 1f9a39f263da4577833a605ef819b007 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:56.515587  2408 tablet_copy_client.cc:806] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:56.516275  2408 tablet_copy_client.cc:670] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:56.523226  2408 tablet_copy_client.cc:538] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:56.534008  2408 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:56.559201  2408 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:56.560921  2408 tablet_bootstrap.cc:492] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:56.561645  2408 ts_tablet_manager.cc:1403] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.015s
I20260709 12:59:56.566872  2265 raft_consensus.cc:1217] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:56.572175  2408 raft_consensus.cc:359] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.573153  2408 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:56.574920  2408 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:56.577363  2408 ts_tablet_manager.cc:1434] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:59:56.581077  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-10a7d9e12aa94413b57ebc59c8f15757 received from {username='slave'} at 127.0.0.1:43624
I20260709 12:59:56.581523  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-10a7d9e12aa94413b57ebc59c8f15757 on tablet 10a7d9e12aa94413b57ebc59c8f15757 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:56.721961  2265 raft_consensus.cc:1217] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:56.737602  2265 raft_consensus.cc:1217] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.018352  2265 raft_consensus.cc:1217] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:57.164170  2207 raft_consensus.cc:1064] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:57.168967  2207 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.175941  2265 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.177038  1689 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.179102  2382 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:57.203819  2419 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:59:57.221675  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 44317.4us
I20260709 12:59:57.228121  1622 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:59:57.240362  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62032.7us
I20260709 12:59:57.246656  2419 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.254256  2374 raft_consensus.cc:1064] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:57.259675  2374 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.270066  2207 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.276292  1687 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.292935  2265 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.312270  1442 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.323350  2426 raft_consensus.cc:1064] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:57.325803  2426 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.339251  2265 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.340911  2334 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.350833  1689 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.354051  2429 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.358292  1618 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.363785  2263 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.366766  2429 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.370473  1689 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.376066  2427 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:57.438181  2401 raft_consensus.cc:1064] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 12:59:57.447814  2401 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.450544  1543 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.450733  1544 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.462553  1542 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.470279  1688 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.471504  2266 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.471712  2419 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.475625  2419 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.480911  2207 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.483184  1688 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.494843  2426 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.494300  2266 raft_consensus.cc:2955] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.500391  2431 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.504623  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c2bf53312944dfc854b092b66a8dce2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:57.507835  1443 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.520350  2263 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.517414  2427 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.535585  2364 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.541039  1618 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.542758  2397 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:57.543109  2266 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.547864  2376 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.551862  1687 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.555835  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c2bf53312944dfc854b092b66a8dce2 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 12:59:57.570531  1547 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:57.572674  2376 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:57.582273  2265 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.588160  1688 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.601413  1443 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.619293  1547 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.625104  2442 tablet_replica.cc:333] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 12:59:57.664784  1622 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.668215  2442 raft_consensus.cc:2243] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.668960  2442 raft_consensus.cc:2272] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.676370  2442 ts_tablet_manager.cc:1916] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:57.714135  2401 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.727320  1444 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 12:59:57.733281  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 62717.7us
I20260709 12:59:57.742714  2263 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.744707  2429 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.749998  2442 ts_tablet_manager.cc:1929] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:57.750516  2442 log.cc:1199] T 7c2bf53312944dfc854b092b66a8dce2 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/7c2bf53312944dfc854b092b66a8dce2
I20260709 12:59:57.765022  1689 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.768167  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet 7c2bf53312944dfc854b092b66a8dce2 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:57.768882  2263 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.758875  2334 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.770911  1544 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.787210  2266 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.796391  1622 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.798084  1617 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 12:59:57.804802  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 93245.5us
I20260709 12:59:57.805671  2265 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.808825  1544 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.808935  2431 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.811013  2426 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.813931  1443 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.826730  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet bb5d38534bcc45e19c58dcc3139a4ee6 with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 12:59:57.828789  1544 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.833458  2364 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.836796  2266 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.838657  1444 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:57.849948  2449 tablet_replica.cc:333] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 12:59:57.851146  2426 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.859321  2449 raft_consensus.cc:2243] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.861565  2449 raft_consensus.cc:2272] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.860805  1691 raft_consensus.cc:2955] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.869365  2449 ts_tablet_manager.cc:1916] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:57.872037  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb5d38534bcc45e19c58dcc3139a4ee6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:57.873719  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f9a39f263da4577833a605ef819b007 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:57.879387  1539 raft_consensus.cc:2955] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.884222  1687 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 12:59:57.894073  1445 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.906375  2449 ts_tablet_manager.cc:1929] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:57.909819  2449 log.cc:1199] T bb5d38534bcc45e19c58dcc3139a4ee6 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/bb5d38534bcc45e19c58dcc3139a4ee6
I20260709 12:59:57.909179  2266 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.912102  1542 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:57.912724  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet bb5d38534bcc45e19c58dcc3139a4ee6 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:57.914290  2448 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:57.915593  2401 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:57.920372  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f9a39f263da4577833a605ef819b007 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 12:59:57.935120  1539 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.939337  2266 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.930760  2448 raft_consensus.cc:2955] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.947432  2450 tablet_replica.cc:333] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 12:59:57.949364  2450 raft_consensus.cc:2243] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.950223  2450 raft_consensus.cc:2272] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.952003  1442 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 12:59:57.953713  2450 ts_tablet_manager.cc:1916] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:57.964221  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10a7d9e12aa94413b57ebc59c8f15757 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:57.970270  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 10a7d9e12aa94413b57ebc59c8f15757 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 12:59:57.971529  2442 tablet_replica.cc:333] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 12:59:57.972541  2442 raft_consensus.cc:2243] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:57.973269  2442 raft_consensus.cc:2272] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:57.976567  2442 ts_tablet_manager.cc:1916] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:57.994238  2450 ts_tablet_manager.cc:1929] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:57.994855  2450 log.cc:1199] T 1f9a39f263da4577833a605ef819b007 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/1f9a39f263da4577833a605ef819b007
I20260709 12:59:57.996824  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 1f9a39f263da4577833a605ef819b007 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 12:59:58.009250  2442 ts_tablet_manager.cc:1929] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:58.009800  2442 log.cc:1199] T 10a7d9e12aa94413b57ebc59c8f15757 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/10a7d9e12aa94413b57ebc59c8f15757
I20260709 12:59:58.011564  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet 10a7d9e12aa94413b57ebc59c8f15757 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
W20260709 12:59:58.451527  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59837.2us
I20260709 12:59:59.041603  1622 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 12:59:59.058712  1585 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5f6768c02504c9cb4195745e3f1970e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.059834  1691 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.060001  1544 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.061318  2452 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.062248  2454 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.091006  2454 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.099623  1691 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.102062  1544 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.110046  1687 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.119987  1445 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.141336  1544 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.142766  1622 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.142701  2401 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.145310  2401 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:59:59.150389  1659 consensus_peers.cc:597] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dae379e1020a47aea6053cd31adaf4a0. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:59.202991  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58734.8us
I20260709 12:59:59.209668  2401 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.276772  1539 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.297593  1622 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.304404  1444 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:59.320807  1617 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 12:59:59.354029  1585 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4bd73d471194556a9ba093049d04790. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.356328  1544 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.357452  1691 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.362306  2452 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.371322  2454 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.382911  2452 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.395907  1687 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.397567  1542 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.407159  1444 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:59.411218  1659 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5fffa415884468d9ae844797cb87109. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:59.416328  1622 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.418658  2401 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.420094  1542 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:59.421928  2401 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:59.440431  2401 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.445099  1542 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.452476  1617 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.454080  1691 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.493569  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 12:59:59.535836  2482 ts_tablet_manager.cc:933] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:59.538151  2482 tablet_copy_client.cc:323] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 12:59:59.539973  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet dae379e1020a47aea6053cd31adaf4a0 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 12:59:59.540547  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet dae379e1020a47aea6053cd31adaf4a0 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-dae379e1020a47aea6053cd31adaf4a0
I20260709 12:59:59.548511  1706 tablet_copy_source_session.cc:215] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.552160  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dae379e1020a47aea6053cd31adaf4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.580178  2482 tablet_copy_client.cc:806] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:59.580817  2482 tablet_copy_client.cc:670] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:59.584743  2482 tablet_copy_client.cc:538] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:59.593976  2482 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:59.627251  2484 ts_tablet_manager.cc:933] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:59.656442  2484 tablet_copy_client.cc:323] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:59.659258  2482 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:59.660322  2482 tablet_bootstrap.cc:492] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:59.660786  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet d5f6768c02504c9cb4195745e3f1970e from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:59.661458  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet d5f6768c02504c9cb4195745e3f1970e from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-d5f6768c02504c9cb4195745e3f1970e
I20260709 12:59:59.661705  2482 ts_tablet_manager.cc:1403] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.016s
I20260709 12:59:59.665220  2482 raft_consensus.cc:359] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.666034  2482 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:59.666708  2482 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.699298  1631 tablet_copy_source_session.cc:215] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.706746  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f6768c02504c9cb4195745e3f1970e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.728672  2482 ts_tablet_manager.cc:1434] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.067s	user 0.016s	sys 0.013s
I20260709 12:59:59.732630  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-dae379e1020a47aea6053cd31adaf4a0 received from {username='slave'} at 127.0.0.1:43624
I20260709 12:59:59.733105  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-dae379e1020a47aea6053cd31adaf4a0 on tablet dae379e1020a47aea6053cd31adaf4a0 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:59.761934  2484 tablet_copy_client.cc:806] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:59.762717  2484 tablet_copy_client.cc:670] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:59.771163  2484 tablet_copy_client.cc:538] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:59.780583  2482 ts_tablet_manager.cc:933] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 12:59:59.784426  2484 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:59.801774  2482 tablet_copy_client.cc:323] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 12:59:59.803638  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet e4bd73d471194556a9ba093049d04790 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 12:59:59.804241  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet e4bd73d471194556a9ba093049d04790 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-e4bd73d471194556a9ba093049d04790
I20260709 12:59:59.822242  1631 tablet_copy_source_session.cc:215] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.828126  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4bd73d471194556a9ba093049d04790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.846246  2484 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:59.847327  2484 tablet_bootstrap.cc:492] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:59.848083  2484 ts_tablet_manager.cc:1403] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.002s
I20260709 12:59:59.853184  2484 raft_consensus.cc:359] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.854221  2484 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:59.855044  2484 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.858218  2484 ts_tablet_manager.cc:1434] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:59:59.863413  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-d5f6768c02504c9cb4195745e3f1970e received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:59.863912  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-d5f6768c02504c9cb4195745e3f1970e on tablet d5f6768c02504c9cb4195745e3f1970e with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:59.867944  2482 tablet_copy_client.cc:806] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:59.868659  2482 tablet_copy_client.cc:670] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:59.875334  2482 tablet_copy_client.cc:538] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:59.887594  2482 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 12:59:59.916409  2482 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:59.917393  2482 tablet_bootstrap.cc:492] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 12:59:59.918087  2482 ts_tablet_manager.cc:1403] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.005s
I20260709 12:59:59.921859  2482 raft_consensus.cc:359] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.922801  2482 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 12:59:59.923399  2484 ts_tablet_manager.cc:933] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 12:59:59.923483  2482 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 12:59:59.937063  2482 ts_tablet_manager.cc:1434] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.004s
I20260709 12:59:59.939289  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-e4bd73d471194556a9ba093049d04790 received from {username='slave'} at 127.0.0.1:47468
I20260709 12:59:59.939749  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-e4bd73d471194556a9ba093049d04790 on tablet e4bd73d471194556a9ba093049d04790 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 12:59:59.949446  2484 tablet_copy_client.cc:323] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 12:59:59.951270  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet f5fffa415884468d9ae844797cb87109 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 12:59:59.951877  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet f5fffa415884468d9ae844797cb87109 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-f5fffa415884468d9ae844797cb87109
I20260709 12:59:59.963264  1706 tablet_copy_source_session.cc:215] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:59.974375  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fffa415884468d9ae844797cb87109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:59.993299  2484 tablet_copy_client.cc:806] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:59.993988  2484 tablet_copy_client.cc:670] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:00.007598  2263 raft_consensus.cc:1217] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:00.012686  2484 tablet_copy_client.cc:538] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:00.027549  2484 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:00.063371  2263 raft_consensus.cc:1217] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:00.089797  2484 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:00.093784  2484 tablet_bootstrap.cc:492] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:00.095184  2484 ts_tablet_manager.cc:1403] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.006s
I20260709 13:00:00.099365  2484 raft_consensus.cc:359] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:00.100266  2484 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:00.100960  2484 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:00.106148  2484 ts_tablet_manager.cc:1434] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:00:00.113775  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f5fffa415884468d9ae844797cb87109 received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:00.114189  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f5fffa415884468d9ae844797cb87109 on tablet f5fffa415884468d9ae844797cb87109 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:00.395090  2263 raft_consensus.cc:1217] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:00.512707  2454 raft_consensus.cc:1064] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:00.517472  2454 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:00.531868  2265 raft_consensus.cc:1217] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:00.546947  2401 raft_consensus.cc:1064] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:00.549144  2401 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:00.571938  1618 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.573414  2265 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.573872  2263 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.576118  2447 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:00.577350  2431 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:00.583959  2447 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:00.591800  1542 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.602986  2463 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:00.618569  2471 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.625488  1617 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.666378  1544 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.682523  1444 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.691185  1546 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.682017  2265 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.705338  1691 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:00.737812  2454 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:00.771104  2496 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:00:00.818689  2454 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.823276  1539 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.846238  2265 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.871537  1444 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.872711  1691 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:00.877365  1687 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.883785  2266 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:00.884035  1618 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:00.885546  2463 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.886448  2447 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.901623  2471 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.903368  2266 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.915921  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dae379e1020a47aea6053cd31adaf4a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:00.915295  1618 raft_consensus.cc:2955] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:00.935283  1443 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.946457  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet dae379e1020a47aea6053cd31adaf4a0 with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:00.952878  2496 raft_consensus.cc:1064] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:00.955339  2496 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:00.963217  1622 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:00.983853  2266 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:00.988812  2454 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.997531  2431 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.009044  2463 raft_consensus.cc:1064] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:01.011020  2266 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.013720  2463 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:01.023295  1691 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.024784  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5f6768c02504c9cb4195745e3f1970e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:01.034014  1443 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.050431  1533 tablet_service.cc:1558] Processing DeleteTablet for tablet d5f6768c02504c9cb4195745e3f1970e with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:01.055285  2507 tablet_replica.cc:333] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:01.056362  2507 raft_consensus.cc:2243] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.057111  2507 raft_consensus.cc:2272] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:01.071914  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47017.2us
I20260709 13:00:01.095908  2451 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.113986  2266 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.115504  2447 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:01.125181  1622 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.132192  1691 raft_consensus.cc:2955] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.135345  2507 ts_tablet_manager.cc:1916] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.136298  2463 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.167847  1690 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.169548  2431 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.182313  2266 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.181679  2447 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.184360  2510 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.194937  2265 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.204943  2507 ts_tablet_manager.cc:1929] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.205430  2507 log.cc:1199] T dae379e1020a47aea6053cd31adaf4a0 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/dae379e1020a47aea6053cd31adaf4a0
I20260709 13:00:01.206985  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet dae379e1020a47aea6053cd31adaf4a0 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:01.207260  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:01.186578  1617 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.217483  2507 tablet_replica.cc:333] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:01.219710  2507 raft_consensus.cc:2243] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.225857  2507 raft_consensus.cc:2272] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:01.226480  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64109.8us
I20260709 13:00:01.240237  2496 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.251582  2507 ts_tablet_manager.cc:1916] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.257385  1543 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.262459  1544 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:01.270144  2471 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:01.272672  1690 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.276441  2265 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.289963  2507 ts_tablet_manager.cc:1929] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.290685  2507 log.cc:1199] T d5f6768c02504c9cb4195745e3f1970e P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/d5f6768c02504c9cb4195745e3f1970e
I20260709 13:00:01.292291  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet d5f6768c02504c9cb4195745e3f1970e (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:01.301311  1443 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.314368  2451 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:01.333518  1543 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.362758  1544 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.727010  1689 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:01.731508  2265 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.732462  1543 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.732985  2471 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.733856  2447 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.741618  2265 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.746847  1543 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.739745  2471 raft_consensus.cc:2955] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.754956  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.762136  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5fffa415884468d9ae844797cb87109 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:01.776620  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet f5fffa415884468d9ae844797cb87109 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:01.780812  2520 tablet_replica.cc:333] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:01.781651  2520 raft_consensus.cc:2243] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.782250  2520 raft_consensus.cc:2272] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:01.785395  2520 ts_tablet_manager.cc:1916] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.800762  2520 ts_tablet_manager.cc:1929] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.801208  2520 log.cc:1199] T f5fffa415884468d9ae844797cb87109 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/f5fffa415884468d9ae844797cb87109
I20260709 13:00:01.802552  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet f5fffa415884468d9ae844797cb87109 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:01.900454  1622 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:01.906487  2265 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.908046  2452 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:01.909521  1543 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:01.916217  2451 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:01.923739  2452 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.942150  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4bd73d471194556a9ba093049d04790 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:01.945855  1543 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.948523  1443 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:01.952071  2265 raft_consensus.cc:2955] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:01.959769  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet e4bd73d471194556a9ba093049d04790 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:01.967067  2523 tablet_replica.cc:333] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:01.968142  2523 raft_consensus.cc:2243] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:01.968961  2523 raft_consensus.cc:2272] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:01.973430  2523 ts_tablet_manager.cc:1916] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:01.988493  2523 ts_tablet_manager.cc:1929] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:01.988785  2523 log.cc:1199] T e4bd73d471194556a9ba093049d04790 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/e4bd73d471194556a9ba093049d04790
I20260709 13:00:01.990388  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet e4bd73d471194556a9ba093049d04790 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:03.031451  1622 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:03.038151  1585 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c6ce8e6dbe04fc3bb43288095f2de7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.038293  1690 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.038805  1544 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.039767  2525 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.040759  2452 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.049911  2451 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.052053  1543 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.053756  1689 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.064070  1622 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:03.074244  1585 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1b77a1e7d2d64ba8b40eabf9b87292f3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.069810  1443 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.077904  1689 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.084095  1544 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.084045  2526 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:03.086007  2451 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.097784  2452 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.101526  1690 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.101758  1544 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.123974  1690 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.137254  1442 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.139830  1618 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:03.140720  1659 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e6d6de7d5b64994853322d5806d6eb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.141148  1544 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.141237  2471 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.142371  2447 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:03.150395  2471 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.153877  1618 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.169303  1544 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.170658  1543 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.174137  1443 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.186022  1691 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.187424  2456 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:03.188333  1510 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ad53e26a3894902b237f56d0f92b47e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:03.197657  2544 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.199060  1690 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.200258  1618 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:03.201561  2456 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:03.218963  1618 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:03.227605  1443 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:03.492882  2546 ts_tablet_manager.cc:933] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:03.494931  2546 tablet_copy_client.cc:323] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:03.496510  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:03.497025  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-1b77a1e7d2d64ba8b40eabf9b87292f3
I20260709 13:00:03.503885  1631 tablet_copy_source_session.cc:215] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:03.506688  2546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:03.522431  2546 tablet_copy_client.cc:806] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:03.523077  2546 tablet_copy_client.cc:670] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:03.527536  2546 tablet_copy_client.cc:538] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:03.539469  2546 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:03.568018  2549 ts_tablet_manager.cc:933] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:03.574652  2546 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:03.575641  2546 tablet_bootstrap.cc:492] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:03.575573  2549 tablet_copy_client.cc:323] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:03.576418  2546 ts_tablet_manager.cc:1403] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.007s
I20260709 13:00:03.577461  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet 4ad53e26a3894902b237f56d0f92b47e from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:03.578044  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet 4ad53e26a3894902b237f56d0f92b47e from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-4ad53e26a3894902b237f56d0f92b47e
I20260709 13:00:03.579836  2546 raft_consensus.cc:359] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.580670  2546 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:03.581315  2546 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.592483  2546 ts_tablet_manager.cc:1434] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.010s
I20260709 13:00:03.594198  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-1b77a1e7d2d64ba8b40eabf9b87292f3 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:03.594660  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-1b77a1e7d2d64ba8b40eabf9b87292f3 on tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:03.594767  1557 tablet_copy_source_session.cc:215] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:03.598915  2549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ad53e26a3894902b237f56d0f92b47e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:03.620054  2549 tablet_copy_client.cc:806] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:03.620620  2549 tablet_copy_client.cc:670] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:03.625162  2549 tablet_copy_client.cc:538] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:03.634397  2549 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:03.652491  2546 ts_tablet_manager.cc:933] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:03.654165  2546 tablet_copy_client.cc:323] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:03.655664  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:03.656193  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 7c6ce8e6dbe04fc3bb43288095f2de7b from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-7c6ce8e6dbe04fc3bb43288095f2de7b
I20260709 13:00:03.662104  2549 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:03.663125  2549 tablet_bootstrap.cc:492] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:03.663805  2549 ts_tablet_manager.cc:1403] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.003s
I20260709 13:00:03.666800  2549 raft_consensus.cc:359] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.667451  1631 tablet_copy_source_session.cc:215] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:03.667575  2549 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:03.668323  2549 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.671058  2546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:03.673866  2549 ts_tablet_manager.cc:1434] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:03.677399  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-4ad53e26a3894902b237f56d0f92b47e received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:03.677841  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-4ad53e26a3894902b237f56d0f92b47e on tablet 4ad53e26a3894902b237f56d0f92b47e with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:03.687064  2546 tablet_copy_client.cc:806] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:03.687597  2546 tablet_copy_client.cc:670] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:03.691277  2546 tablet_copy_client.cc:538] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:03.707790  2546 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:03.722365  2549 ts_tablet_manager.cc:933] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:03.728242  2549 tablet_copy_client.cc:323] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:00:03.729920  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 8e6d6de7d5b64994853322d5806d6eb0 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:00:03.730463  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 8e6d6de7d5b64994853322d5806d6eb0 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-8e6d6de7d5b64994853322d5806d6eb0
I20260709 13:00:03.734876  2546 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:03.735695  2546 tablet_bootstrap.cc:492] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:03.736384  2546 ts_tablet_manager.cc:1403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.004s
I20260709 13:00:03.739066  1706 tablet_copy_source_session.cc:215] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:03.739444  2546 raft_consensus.cc:359] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.741035  2546 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:03.741664  2546 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.743530  2549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e6d6de7d5b64994853322d5806d6eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:03.744167  2546 ts_tablet_manager.cc:1434] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:03.748842  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7c6ce8e6dbe04fc3bb43288095f2de7b received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:03.749254  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-7c6ce8e6dbe04fc3bb43288095f2de7b on tablet 7c6ce8e6dbe04fc3bb43288095f2de7b with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:03.760900  2549 tablet_copy_client.cc:806] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:03.761551  2549 tablet_copy_client.cc:670] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:03.765205  2549 tablet_copy_client.cc:538] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:03.774887  2549 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:03.800169  2549 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:03.801126  2549 tablet_bootstrap.cc:492] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:03.801756  2549 ts_tablet_manager.cc:1403] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 13:00:03.804611  2549 raft_consensus.cc:359] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.805418  2549 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:03.806022  2549 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:03.815307  2549 ts_tablet_manager.cc:1434] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:00:03.816906  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-8e6d6de7d5b64994853322d5806d6eb0 received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:03.817313  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-8e6d6de7d5b64994853322d5806d6eb0 on tablet 8e6d6de7d5b64994853322d5806d6eb0 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:04.034083  2266 raft_consensus.cc:1217] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:04.115833  2266 raft_consensus.cc:1217] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:04.133725  2263 raft_consensus.cc:1217] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:04.220294  2263 raft_consensus.cc:1217] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:04.495584  2560 raft_consensus.cc:1064] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:04.497465  2560 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.504612  1689 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.504936  2263 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.506513  2559 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.507513  1618 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.509339  2469 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.511587  2560 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.516966  2469 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.526363  2265 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.526363  1618 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.546291  1443 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.555955  2540 raft_consensus.cc:1064] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:04.559386  1690 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.561781  2540 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.571725  1618 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.574836  1544 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.574740  2471 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.579953  2265 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.581383  2471 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.583794  2471 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.610208  2558 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.616832  1546 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.632449  2263 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.634896  2559 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.635660  2452 raft_consensus.cc:1064] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:04.636854  1690 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.638302  2452 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.640867  2559 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.642194  1543 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.650509  2544 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.669953  2263 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.676126  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4ad53e26a3894902b237f56d0f92b47e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:04.675061  1690 raft_consensus.cc:2955] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.682884  2526 raft_consensus.cc:1064] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:04.685621  2526 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.690285  1615 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.693826  2265 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.703696  1444 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.711994  2266 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.717809  2452 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.733078  1690 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:04.735783  2264 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.737823  2525 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.745239  1546 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:04.747104  2568 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.754705  2558 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.757206  1546 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.760932  1445 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:04.765484  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e6d6de7d5b64994853322d5806d6eb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:04.768309  2264 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:00:04.768849  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 134992us
I20260709 13:00:04.772006  2558 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:04.775198  1690 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.775192  1543 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.782933  1690 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.785338  2265 raft_consensus.cc:2955] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.786983  1543 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:04.793440  2526 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.795814  2526 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.803551  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 4ad53e26a3894902b237f56d0f92b47e with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:04.805505  2526 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:04.814095  2452 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:04.844552  1444 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.850368  2452 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.851408  1539 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.869048  2580 tablet_replica.cc:333] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:04.875348  2580 raft_consensus.cc:2243] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:04.888517  2580 raft_consensus.cc:2272] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:04.892843  2580 ts_tablet_manager.cc:1916] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:04.899119  2574 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.937721  1445 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:04.946043  2580 ts_tablet_manager.cc:1929] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:04.946580  2580 log.cc:1199] T 4ad53e26a3894902b237f56d0f92b47e P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/4ad53e26a3894902b237f56d0f92b47e
W20260709 13:00:05.004175  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101193us
I20260709 13:00:04.957470  2262 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.015769  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet 4ad53e26a3894902b237f56d0f92b47e (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:05.013782  1689 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.018293  1546 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.018255  1690 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.043982  2265 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.084777  1444 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.103765  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 8e6d6de7d5b64994853322d5806d6eb0 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:05.106276  2580 tablet_replica.cc:333] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:05.118737  2580 raft_consensus.cc:2243] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:05.119536  2580 raft_consensus.cc:2272] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:05.131615  2580 ts_tablet_manager.cc:1916] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:05.219183  2580 ts_tablet_manager.cc:1929] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:05.219796  1622 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:05.221264  2580 log.cc:1199] T 8e6d6de7d5b64994853322d5806d6eb0 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/8e6d6de7d5b64994853322d5806d6eb0
I20260709 13:00:05.219764  1615 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:05.224025  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet 8e6d6de7d5b64994853322d5806d6eb0 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:05.233168  2263 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:05.234803  2262 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:05.237308  2586 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:05.238306  2594 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:05.250005  1691 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:05.251643  2581 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:05.261744  1539 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:05.268678  2595 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.300275  2262 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.301723  2581 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.301798  2586 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:05.315897  1690 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.317443  1542 raft_consensus.cc:2955] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.332592  2262 raft_consensus.cc:2955] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.348389  1445 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.352181  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:05.360018  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:05.360023  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c6ce8e6dbe04fc3bb43288095f2de7b with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:05.333762  1444 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:05.375003  2598 tablet_replica.cc:333] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:05.387770  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:05.393071  2599 tablet_replica.cc:333] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:05.394009  2598 raft_consensus.cc:2243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:05.394371  2599 raft_consensus.cc:2243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:05.394769  2598 raft_consensus.cc:2272] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:05.395164  2599 raft_consensus.cc:2272] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:05.399011  2598 ts_tablet_manager.cc:1916] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:05.399662  2599 ts_tablet_manager.cc:1916] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:05.412292  2598 ts_tablet_manager.cc:1929] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:05.412770  2598 log.cc:1199] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/7c6ce8e6dbe04fc3bb43288095f2de7b
I20260709 13:00:05.414088  2599 ts_tablet_manager.cc:1929] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:05.414577  2599 log.cc:1199] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/1b77a1e7d2d64ba8b40eabf9b87292f3
I20260709 13:00:05.437538  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet 7c6ce8e6dbe04fc3bb43288095f2de7b (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:05.460361  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 1b77a1e7d2d64ba8b40eabf9b87292f3 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:06.477718  1615 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:06.484670  1690 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.484686  1539 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:06.484776  1585 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca134e523abd4f159806116930d9aece. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:06.486217  2595 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:06.487257  2600 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.496186  2581 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.497900  1690 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.498106  1544 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.519560  1442 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.524683  1615 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:06.531875  1585 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73951993cbd34d1cbe7ed6fe93812a5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:06.532678  1690 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.533506  1543 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.534999  2595 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.536926  2595 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.556071  2581 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.558205  1544 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.561302  1691 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.573077  1544 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:06.583684  1615 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.585112  2596 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:06.590122  1510 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c19c7246dc654e7c82b45abe1250e568. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:06.596352  1691 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.598228  2596 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.599752  1444 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.602272  1615 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.605815  2610 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:06.647706  1691 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.656402  1615 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:06.659876  1443 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.686326  1691 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:00:06.686489  1585 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5be703fc2dd046c1b14909b95d460cd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:06.686903  1544 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:06.687794  2452 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.688570  2600 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:06.696846  2595 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.700073  1691 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.702265  1544 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:06.719656  1444 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.996158  2622 ts_tablet_manager.cc:933] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:07.001711  2622 tablet_copy_client.cc:323] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:07.003899  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 73951993cbd34d1cbe7ed6fe93812a5f from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:07.004506  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 73951993cbd34d1cbe7ed6fe93812a5f from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-73951993cbd34d1cbe7ed6fe93812a5f
I20260709 13:00:07.014314  1631 tablet_copy_source_session.cc:215] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.018307  2625 ts_tablet_manager.cc:933] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:07.020056  2622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73951993cbd34d1cbe7ed6fe93812a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.029510  2625 tablet_copy_client.cc:323] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:07.031389  1631 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet ca134e523abd4f159806116930d9aece from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:07.032001  1631 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet ca134e523abd4f159806116930d9aece from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-ca134e523abd4f159806116930d9aece
I20260709 13:00:07.044338  1631 tablet_copy_source_session.cc:215] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.048636  2627 ts_tablet_manager.cc:933] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:07.057271  2627 tablet_copy_client.cc:323] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:07.059401  2625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca134e523abd4f159806116930d9aece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.059796  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet c19c7246dc654e7c82b45abe1250e568 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:07.060349  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet c19c7246dc654e7c82b45abe1250e568 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-c19c7246dc654e7c82b45abe1250e568
I20260709 13:00:07.068554  1557 tablet_copy_source_session.cc:215] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.071847  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c19c7246dc654e7c82b45abe1250e568. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.072557  2622 tablet_copy_client.cc:806] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.073231  2622 tablet_copy_client.cc:670] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.081101  2625 tablet_copy_client.cc:806] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.088717  2622 tablet_copy_client.cc:538] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.089077  2625 tablet_copy_client.cc:670] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.092952  2625 tablet_copy_client.cc:538] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.097986  2622 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:07.088138  2627 tablet_copy_client.cc:806] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.098778  2627 tablet_copy_client.cc:670] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.103066  2627 tablet_copy_client.cc:538] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.105130  2625 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:07.112025  2627 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:07.148922  2625 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.149346  2622 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.149991  2625 tablet_bootstrap.cc:492] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:07.150597  2622 tablet_bootstrap.cc:492] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:07.150840  2625 ts_tablet_manager.cc:1403] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.009s
I20260709 13:00:07.151428  2622 ts_tablet_manager.cc:1403] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.009s
I20260709 13:00:07.154498  2625 raft_consensus.cc:359] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.154712  2622 raft_consensus.cc:359] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.155419  2625 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:07.155663  2622 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:07.156183  2625 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.156412  2622 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.157979  2627 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.158900  2627 tablet_bootstrap.cc:492] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:07.159529  2627 ts_tablet_manager.cc:1403] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.014s
I20260709 13:00:07.167169  2627 raft_consensus.cc:359] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.172720  2627 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:07.173367  2627 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.175910  2627 ts_tablet_manager.cc:1434] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 13:00:07.177560  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-c19c7246dc654e7c82b45abe1250e568 received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:07.178045  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-c19c7246dc654e7c82b45abe1250e568 on tablet c19c7246dc654e7c82b45abe1250e568 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:07.187388  2622 ts_tablet_manager.cc:1434] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:00:07.191105  2625 ts_tablet_manager.cc:1434] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.040s	user 0.020s	sys 0.017s
I20260709 13:00:07.195623  1631 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-73951993cbd34d1cbe7ed6fe93812a5f received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:07.196074  1631 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-73951993cbd34d1cbe7ed6fe93812a5f on tablet 73951993cbd34d1cbe7ed6fe93812a5f with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:07.196816  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ca134e523abd4f159806116930d9aece received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:07.197219  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ca134e523abd4f159806116930d9aece on tablet ca134e523abd4f159806116930d9aece with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:07.201313  2627 ts_tablet_manager.cc:933] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:07.211884  2627 tablet_copy_client.cc:323] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:07.217440  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 5be703fc2dd046c1b14909b95d460cd8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:07.218158  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 5be703fc2dd046c1b14909b95d460cd8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-5be703fc2dd046c1b14909b95d460cd8
I20260709 13:00:07.242367  1632 tablet_copy_source_session.cc:215] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:07.245759  2627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5be703fc2dd046c1b14909b95d460cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:07.278426  2627 tablet_copy_client.cc:806] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:07.279078  2627 tablet_copy_client.cc:670] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:07.283229  2627 tablet_copy_client.cc:538] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:07.295017  2627 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:07.325335  2627 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:07.326221  2627 tablet_bootstrap.cc:492] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:07.326896  2627 ts_tablet_manager.cc:1403] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.006s
I20260709 13:00:07.331008  2627 raft_consensus.cc:359] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.331826  2627 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:07.332427  2627 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:07.335299  2627 ts_tablet_manager.cc:1434] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:07.340495  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-5be703fc2dd046c1b14909b95d460cd8 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:07.340924  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-5be703fc2dd046c1b14909b95d460cd8 on tablet 5be703fc2dd046c1b14909b95d460cd8 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:07.479195  2263 raft_consensus.cc:1217] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:07.593633  2263 raft_consensus.cc:1217] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:07.621065  2265 raft_consensus.cc:1217] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:07.610437  2263 raft_consensus.cc:1217] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:07.938822  2581 raft_consensus.cc:1064] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:07.940600  2581 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:07.947016  1691 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:07.947317  2263 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:07.947337  1539 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:07.948681  2636 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:07.949579  2637 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:07.950317  2638 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:07.971992  2636 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:07.976697  1691 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:07.992395  2263 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:07.992651  1442 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:07.996484  1539 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.029348  2596 raft_consensus.cc:1064] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:08.032022  2596 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.049525  1691 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.051198  1615 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.049518  2265 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.051591  2617 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.053917  2596 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.054900  2610 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.092144  2638 raft_consensus.cc:1064] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:08.096479  1618 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.100940  2638 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:08.123570  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70595.9us
I20260709 13:00:08.129458  2265 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.131326  2637 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.141567  2636 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.145092  2265 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.151746  1690 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.155967  2596 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.167112  2581 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.174371  2581 raft_consensus.cc:1064] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:08.175745  2263 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.176972  2581 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.180068  2262 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.181855  2637 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.186152  1691 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.194654  1443 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.208084  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73951993cbd34d1cbe7ed6fe93812a5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:00:08.216524  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 47513us
I20260709 13:00:08.216616  1543 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.221498  1690 raft_consensus.cc:2955] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.232533  2265 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.233670  1444 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.234166  2654 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:08.238260  1690 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.241098  2636 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:00:08.244458  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 83740.4us
I20260709 13:00:08.247457  1544 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.246987  2262 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.249526  2649 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.250654  2581 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.251194  1544 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.254192  2265 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.254491  1615 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.257623  1687 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:08.255427  1691 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.260021  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c19c7246dc654e7c82b45abe1250e568 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:08.262207  2610 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.266969  1691 raft_consensus.cc:2955] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.277247  2581 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.278146  2637 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.279287  2581 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:08.285257  1442 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.299456  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet 73951993cbd34d1cbe7ed6fe93812a5f with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:08.336891  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet c19c7246dc654e7c82b45abe1250e568 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:08.340466  2660 tablet_replica.cc:333] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:08.371973  2638 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.386662  2664 tablet_replica.cc:333] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:08.377081  2636 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.379150  2262 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.391608  2664 raft_consensus.cc:2243] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.392416  2664 raft_consensus.cc:2272] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.403151  1690 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.395849  2664 ts_tablet_manager.cc:1916] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.409071  1445 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.412034  1539 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.415277  1542 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.419273  2660 raft_consensus.cc:2243] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.420042  2660 raft_consensus.cc:2272] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.425133  2660 ts_tablet_manager.cc:1916] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.426386  1444 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.426743  2262 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.447750  1691 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.466961  2664 ts_tablet_manager.cc:1929] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:08.467555  2664 log.cc:1199] T c19c7246dc654e7c82b45abe1250e568 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/c19c7246dc654e7c82b45abe1250e568
I20260709 13:00:08.469162  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet c19c7246dc654e7c82b45abe1250e568 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:08.475149  2660 ts_tablet_manager.cc:1929] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:08.475752  2660 log.cc:1199] T 73951993cbd34d1cbe7ed6fe93812a5f P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/73951993cbd34d1cbe7ed6fe93812a5f
I20260709 13:00:08.475391  1622 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.477625  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet 73951993cbd34d1cbe7ed6fe93812a5f (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:08.480481  1615 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:08.484030  1691 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.484139  2262 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.485666  2637 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.486481  2581 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.487267  2262 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.488751  2581 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.489372  1542 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:08.493901  2637 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:08.494551  2636 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.496235  2665 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.496721  1690 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.504585  2262 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.506739  2265 raft_consensus.cc:2955] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.513806  1542 raft_consensus.cc:2955] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.525687  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca134e523abd4f159806116930d9aece with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:08.519531  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:08.529644  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5be703fc2dd046c1b14909b95d460cd8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:08.530507  1445 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:08.546726  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet ca134e523abd4f159806116930d9aece with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:08.550072  2667 tablet_replica.cc:333] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:08.552249  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet 5be703fc2dd046c1b14909b95d460cd8 with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:08.553536  2660 tablet_replica.cc:333] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:08.554646  2660 raft_consensus.cc:2243] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.555294  2660 raft_consensus.cc:2272] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.551316  2667 raft_consensus.cc:2243] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:08.559252  2660 ts_tablet_manager.cc:1916] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.559268  2667 raft_consensus.cc:2272] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:08.565306  2667 ts_tablet_manager.cc:1916] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:08.573145  2660 ts_tablet_manager.cc:1929] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:08.573627  2660 log.cc:1199] T 5be703fc2dd046c1b14909b95d460cd8 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/5be703fc2dd046c1b14909b95d460cd8
I20260709 13:00:08.574932  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet 5be703fc2dd046c1b14909b95d460cd8 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:08.576725  2667 ts_tablet_manager.cc:1929] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:08.577129  2667 log.cc:1199] T ca134e523abd4f159806116930d9aece P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/ca134e523abd4f159806116930d9aece
I20260709 13:00:08.578686  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet ca134e523abd4f159806116930d9aece (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:09.642813  1622 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:09.650077  1585 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad9c8a969843427fb32b4afb149874ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.650681  1691 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.650980  1543 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.652015  2636 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.653853  2669 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.662199  2638 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.663761  1543 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.677026  1691 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.677671  1442 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.688441  1543 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:09.706907  1510 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d91481bc55434187a86af0d9c4f9d149. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.708145  1690 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.708962  1622 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.710310  2654 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.711300  2610 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.721469  2610 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.723842  1622 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.741112  1543 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:09.755878  1510 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ff8d8fdfe5b4dd999061f7d92c12c5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.767813  1618 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.767875  1443 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.770284  2610 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:09.771535  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49815.3us
I20260709 13:00:09.773427  1690 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.777457  2610 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.777661  1691 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.804061  2610 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.806516  1618 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.809906  1696 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.820587  1691 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:09.823370  1443 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:09.856245  1618 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.858011  1542 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:09.859572  2668 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:00:09.861251  1659 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3c2089bb9c240cc97c2b79e1d4c648f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:09.865672  2624 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:09.892215  2624 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.899099  1543 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.902534  1618 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:09.914959  1442 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:10.191213  2691 ts_tablet_manager.cc:933] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:10.193341  2691 tablet_copy_client.cc:323] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:10.195055  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:10.195577  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-0ff8d8fdfe5b4dd999061f7d92c12c5d
I20260709 13:00:10.202142  1557 tablet_copy_source_session.cc:215] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.205237  2691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.210283  2693 ts_tablet_manager.cc:933] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:10.216615  2693 tablet_copy_client.cc:323] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:10.218317  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet ad9c8a969843427fb32b4afb149874ba from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:10.218880  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet ad9c8a969843427fb32b4afb149874ba from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-ad9c8a969843427fb32b4afb149874ba
I20260709 13:00:10.224352  2691 tablet_copy_client.cc:806] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:10.225016  2691 tablet_copy_client.cc:670] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:10.227167  1632 tablet_copy_source_session.cc:215] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.228762  2691 tablet_copy_client.cc:538] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:10.233083  2693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8a969843427fb32b4afb149874ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.242969  2691 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:10.253170  2693 tablet_copy_client.cc:806] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:10.253865  2693 tablet_copy_client.cc:670] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:10.258697  2693 tablet_copy_client.cc:538] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:10.267851  2693 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:10.276778  2691 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.277762  2691 tablet_bootstrap.cc:492] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:10.278478  2691 ts_tablet_manager.cc:1403] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.010s
I20260709 13:00:10.281651  2691 raft_consensus.cc:359] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.282532  2691 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:10.283304  2691 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.303297  2693 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.305078  2693 tablet_bootstrap.cc:492] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:10.306778  2693 ts_tablet_manager.cc:1403] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.009s
I20260709 13:00:10.309772  2693 raft_consensus.cc:359] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.311801  2693 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:10.311911  2691 ts_tablet_manager.cc:1434] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.006s
I20260709 13:00:10.312520  2693 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.313946  2698 ts_tablet_manager.cc:933] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:10.315238  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-0ff8d8fdfe5b4dd999061f7d92c12c5d received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:10.315376  2693 ts_tablet_manager.cc:1434] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:10.315687  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-0ff8d8fdfe5b4dd999061f7d92c12c5d on tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:10.321998  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ad9c8a969843427fb32b4afb149874ba received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:10.322470  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ad9c8a969843427fb32b4afb149874ba on tablet ad9c8a969843427fb32b4afb149874ba with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:10.326018  2698 tablet_copy_client.cc:323] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:10.329270  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet d91481bc55434187a86af0d9c4f9d149 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:10.329799  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet d91481bc55434187a86af0d9c4f9d149 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-d91481bc55434187a86af0d9c4f9d149
I20260709 13:00:10.338510  1557 tablet_copy_source_session.cc:215] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.341666  2698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d91481bc55434187a86af0d9c4f9d149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.354362  2698 tablet_copy_client.cc:806] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:10.355196  2698 tablet_copy_client.cc:670] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:10.358564  2698 tablet_copy_client.cc:538] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:10.365278  2698 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:10.386274  2693 ts_tablet_manager.cc:933] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:10.387730  2698 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.388739  2698 tablet_bootstrap.cc:492] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:10.389469  2698 ts_tablet_manager.cc:1403] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.024s	user 0.025s	sys 0.001s
I20260709 13:00:10.394477  2698 raft_consensus.cc:359] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.396028  2698 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:10.396274  2693 tablet_copy_client.cc:323] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:00:10.396798  2698 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.398222  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet e3c2089bb9c240cc97c2b79e1d4c648f from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:00:10.398804  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet e3c2089bb9c240cc97c2b79e1d4c648f from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-e3c2089bb9c240cc97c2b79e1d4c648f
I20260709 13:00:10.402112  2698 ts_tablet_manager.cc:1434] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:10.406733  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-d91481bc55434187a86af0d9c4f9d149 received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:10.407219  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-d91481bc55434187a86af0d9c4f9d149 on tablet d91481bc55434187a86af0d9c4f9d149 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:10.414810  1706 tablet_copy_source_session.cc:215] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:10.419488  2693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c2089bb9c240cc97c2b79e1d4c648f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:10.438207  2693 tablet_copy_client.cc:806] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:10.438867  2693 tablet_copy_client.cc:670] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:10.442729  2693 tablet_copy_client.cc:538] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:10.452013  2693 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:10.472961  2693 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:10.473838  2693 tablet_bootstrap.cc:492] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:10.474521  2693 ts_tablet_manager.cc:1403] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:00:10.477100  2693 raft_consensus.cc:359] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.477737  2693 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:10.478250  2693 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:10.480785  2693 ts_tablet_manager.cc:1434] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:00:10.487926  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-e3c2089bb9c240cc97c2b79e1d4c648f received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:10.488399  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-e3c2089bb9c240cc97c2b79e1d4c648f on tablet e3c2089bb9c240cc97c2b79e1d4c648f with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:10.604125  2262 raft_consensus.cc:1217] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:10.697803  2262 raft_consensus.cc:1217] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:10.790407  2262 raft_consensus.cc:1217] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:10.859349  2262 raft_consensus.cc:1217] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:10.988511  2705 raft_consensus.cc:1064] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:10.990675  2705 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:10.998061  2265 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:10.999449  2636 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:10.999509  1543 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.001243  1691 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.003327  2636 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.005648  2636 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:11.013516  2669 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.027372  2265 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.035126  1444 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.040325  1543 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.044090  1691 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.084203  1618 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.088804  2265 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.090301  2705 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.097318  2636 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.098966  1544 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.100417  2638 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.099262  2265 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.104465  1544 raft_consensus.cc:2955] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.106033  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad9c8a969843427fb32b4afb149874ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.117825  1442 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.131062  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet ad9c8a969843427fb32b4afb149874ba with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:11.143537  2714 tablet_replica.cc:333] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:11.144351  2714 raft_consensus.cc:2243] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:11.145102  2714 raft_consensus.cc:2272] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:11.148344  2714 ts_tablet_manager.cc:1916] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:11.162065  2714 ts_tablet_manager.cc:1929] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:11.162541  2714 log.cc:1199] T ad9c8a969843427fb32b4afb149874ba P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/ad9c8a969843427fb32b4afb149874ba
I20260709 13:00:11.164987  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet ad9c8a969843427fb32b4afb149874ba (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:11.244802   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:11.301151  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:11.301818  1622 raft_consensus.cc:606] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:11.326440  2704 raft_consensus.cc:1064] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:11.328984  2704 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.334827  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:11.335450  1691 raft_consensus.cc:606] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:11.336050  2540 raft_consensus.cc:1064] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:11.338047  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:11.338553  1691 raft_consensus.cc:606] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:11.338218  2540 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.344584  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:11.345306  1691 raft_consensus.cc:606] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:11.348119  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:11.348663  1622 raft_consensus.cc:606] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:11.349812   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:11.351385   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:11.357000  2262 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.357318  1622 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.360456  2689 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.371620  2540 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:11.379441  2262 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.379925  1691 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.381860  2684 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.382515  1544 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.389922  2610 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.404843  1622 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.409157  2610 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:00:11.413793  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54839.5us
I20260709 13:00:11.424058  2684 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.415962  2540 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.447530  2610 raft_consensus.cc:1064] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:11.454445  1622 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.490883  2638 raft_consensus.cc:993] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:11.492179  2638 raft_consensus.cc:1081] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:11.451434  2610 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.505115  2265 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.511313  1445 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.512048  2262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42592
I20260709 13:00:11.512913  2262 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.513259  2262 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:11.522568  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 163715us
I20260709 13:00:11.525050  2262 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.550652  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:11.551353  1542 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.551939  2540 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.553797  2263 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.558355  1542 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:11.561334  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:11.561546  2262 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:11.562299  2697 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.566437  2697 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:11.567279  2697 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.575409  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:11.576146  1622 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.576503  1622 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:11.577237  1622 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.578725  1622 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.589836  1443 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.581128  1445 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.604869  1618 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.608956  2540 raft_consensus.cc:993] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.609462  2540 raft_consensus.cc:1081] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.619262  2720 raft_consensus.cc:993] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.619932  2689 raft_consensus.cc:1081] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.643342  2265 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.646239  2610 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.650193  1690 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.653059  1622 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:11.661974  1696 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.663626  2728 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.666137  1696 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.677557  2263 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.679236  2722 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.687665  2721 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.695288  1618 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.699352  2263 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.715788  1618 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:11.719522  2540 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.720196  1544 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.722234  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3c2089bb9c240cc97c2b79e1d4c648f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.737100  1445 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.745127  2703 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.755486  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet e3c2089bb9c240cc97c2b79e1d4c648f with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:11.737167  1622 raft_consensus.cc:2955] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.764060  1691 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.794206  1445 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.808655  2265 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.826095  1544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:11.826349  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:11.826872  1544 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.826946  1542 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.827301  1544 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.827383  1542 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.830878  2737 tablet_replica.cc:333] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:11.831214  1618 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.831852  2737 raft_consensus.cc:2243] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:11.832260  2263 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.832453  2737 pending_rounds.cc:70] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Trying to abort 1 pending ops.
I20260709 13:00:11.834105  2684 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:11.836350  2704 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:11.837399  2728 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.839702  2722 raft_consensus.cc:993] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.839926  1544 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.840931  2722 raft_consensus.cc:1081] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:11.841668  1544 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:11.846167  1542 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.832866  2737 pending_rounds.cc:77] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305633838436179968 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } } }
I20260709 13:00:11.847182  2737 raft_consensus.cc:2917] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:00:11.847651  2737 raft_consensus.cc:2889] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:00:11.848049  2737 raft_consensus.cc:2272] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:11.860427  2703 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.855856  1542 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:11.857237  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:11.862241  1690 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.862534  1690 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:11.863271  1690 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.864395  1690 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.851737  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:11.869364  1691 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.870661  1691 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:11.871026  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:11.871455  1691 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.872538  1691 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.880690  1691 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:11.882472  1544 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:11.882882  2263 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.899370  2265 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.900352  1544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:11.900884  1544 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.901227  1544 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.898172  1445 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:11.891031  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:11.902367  1618 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.901248  1696 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:11.909726  1618 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:11.888584  2737 ts_tablet_manager.cc:1916] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:11.894301  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:11.909740  1544 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.912500  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:11.913266  2703 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.913728  2703 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:11.914535  2703 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.915843  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:11.891764  1690 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:11.910766  1615 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.911614  2684 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.916944  2610 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:11.919669  1544 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:11.923578  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:11.924147  1691 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:11.924422  1691 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:11.925218  1691 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.926523  1691 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.933015  2729 raft_consensus.cc:993] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:11.933532  2638 raft_consensus.cc:1081] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:11.935741  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:11.934806  2704 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.936282  1696 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.936631  1696 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:11.940639  2262 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.943655  1696 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.945206  1691 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:11.948055  1618 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:11.949541  2731 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:11.951365  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:11.952436  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:11.953702  2734 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.952025  1691 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.951622  1615 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:11.960645  1696 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:11.954200  2734 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:11.975306  1615 raft_consensus.cc:2955] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.985126  2610 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:11.967605  2734 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:11.993251  1622 raft_consensus.cc:2955] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:11.999783  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:12.000391  1544 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.004114  1445 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:12.013932  2610 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:12.019793  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.021667  1617 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.021963  2739 tablet_replica.cc:333] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:12.021974  1617 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:12.023010  2739 raft_consensus.cc:2243] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.023803  2739 raft_consensus.cc:2272] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.023550  1617 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.024753  1617 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.020627  2610 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.038497  1544 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.048064  2739 ts_tablet_manager.cc:1916] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:12.058271  1617 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.060381  1660 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:12.063844  2540 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.064291  2540 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:12.071162  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.071913  1619 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.075312  2540 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:12.109747  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79419.8us
I20260709 13:00:12.152657  1619 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
W20260709 13:00:12.154935  2745 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:00:12.224483  2737 ts_tablet_manager.cc:1929] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:12.224990  2737 log.cc:1199] T e3c2089bb9c240cc97c2b79e1d4c648f P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/e3c2089bb9c240cc97c2b79e1d4c648f
I20260709 13:00:12.234448  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet e3c2089bb9c240cc97c2b79e1d4c648f (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
W20260709 13:00:12.278070  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139383us
I20260709 13:00:12.308090  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d91481bc55434187a86af0d9c4f9d149 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:12.356300   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.360611  1442 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:12.376024  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 53238.3us
I20260709 13:00:12.401803  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet d91481bc55434187a86af0d9c4f9d149 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:12.407024  1445 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.411913  2763 tablet_replica.cc:333] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:12.413053  2763 raft_consensus.cc:2243] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:12.413801  2763 raft_consensus.cc:2272] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:12.426101  2763 ts_tablet_manager.cc:1916] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:12.428591  2739 ts_tablet_manager.cc:1929] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:12.429109  2739 log.cc:1199] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/0ff8d8fdfe5b4dd999061f7d92c12c5d
I20260709 13:00:12.431187  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 0ff8d8fdfe5b4dd999061f7d92c12c5d (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:12.434782  1545 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:12.451472  2763 ts_tablet_manager.cc:1929] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:12.452036  2763 log.cc:1199] T d91481bc55434187a86af0d9c4f9d149 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/d91481bc55434187a86af0d9c4f9d149
I20260709 13:00:12.461485   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:12.462447  2759 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:12.480778  1691 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.483261  1690 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.483330  2756 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:12.487221  1445 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.488793  1445 catalog_manager.cc:5697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.490391  1618 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.493192  2755 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:12.502171  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet d91481bc55434187a86af0d9c4f9d149 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:12.515666  1619 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.515797  2610 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:12.518750  2756 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:12.529659  1622 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.531641  2744 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:12.551707  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:12.552385  1619 raft_consensus.cc:606] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:12.555442  1619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:12.556206  1619 raft_consensus.cc:606] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:12.556844  1690 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.559175  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:12.559326  1619 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.559695  1617 raft_consensus.cc:606] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:12.561810  2756 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:12.564625  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:12.565348  1691 raft_consensus.cc:606] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:12.566761  2610 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:12.580477  1542 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:12.581741  2540 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:12.602591  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:12.619196  1687 raft_consensus.cc:606] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:12.625511   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:12.627074   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:12.827059  2729 raft_consensus.cc:993] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.827541  2761 raft_consensus.cc:1081] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.828819  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:12.829253  1691 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.829568  1691 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.835376  1691 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.836911  1691 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:12.837601  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:12.837889  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.838165  1542 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.838488  1622 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.838853  1622 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:12.839605  1622 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.840626  1622 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.844187  1542 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.845953  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:12.846793  1622 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.846748  2540 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.847743  2540 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:12.848433  2540 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.867266  2755 raft_consensus.cc:993] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:12.866439  1445 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.867841  2748 raft_consensus.cc:1081] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:12.870911  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:12.871429  1542 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.871775  1542 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.880570  2761 raft_consensus.cc:993] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.881156  2761 raft_consensus.cc:1081] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.883457  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:12.883913  1690 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.884202  1690 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.888249  1542 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.891477  1542 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:12.891597  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.890136  1690 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.892166  1622 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.893352  1690 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:12.895968  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.896456  1617 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.896682  1617 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:12.897430  1617 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.898135  1622 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:12.898429  1617 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.901124  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:12.901921  2741 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.902393  2741 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:12.903266  2741 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.904400  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:12.904955  1542 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.908521  1617 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.909801  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:12.910830  1542 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.911684  2720 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.912436  2720 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:12.913479  2720 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.927456  1445 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:12.911720  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:12.936841  1690 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.938433  1690 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:12.939297  1690 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.940546  1690 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.944034  2636 raft_consensus.cc:993] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.944515  2636 raft_consensus.cc:1081] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:12.946238  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:12.946775  1687 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.947119  1687 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.948163  1445 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.949362  1690 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:12.957379  1687 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.961493  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:12.965085  1542 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.971285  1687 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:12.972375  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.972961  1617 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.973026  1542 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.973348  1617 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:12.974220  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:12.974128  1617 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.975346  2540 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:12.976007  2540 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:12.976296  1617 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.976738  2540 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.982191  1617 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:12.986696  2720 raft_consensus.cc:993] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:12.987141  2540 raft_consensus.cc:1081] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:12.988485  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:12.989225  1542 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:12.988444  1444 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:12.989547  1542 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.995868  1542 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:12.997670  1542 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:12.998157  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:12.998685  1617 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:12.999034  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:12.999555  1687 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:12.999858  1687 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:13.000686  1687 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:13.002184  1687 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.005240  1617 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:13.006213  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:13.006891  2741 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:13.007333  2741 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:13.007952  1687 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:13.008163  2741 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:13.018504  1444 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:13.343544  1617 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.344659  2741 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.360239  1696 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.364380  2610 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.371373  1618 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.375166  2540 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:13.394915  1617 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.396152  2540 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.405030  1622 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:13.426388  1585 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab05924031f84a848a47260864c78193. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.430696  1542 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.431679  1687 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.433267  1545 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.433120  2761 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.431679  1618 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.436036  2761 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.433326  2720 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:00:13.440714  2540 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:13.460112  1690 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.464881  1546 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.466516  2748 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:13.471994  2636 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.482162  1546 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.484647  2756 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.484896  2748 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.485862  1545 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.528759  1696 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:13.542506  1659 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0a119b71a994fd1aeb21c6ba31e339b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.531661  1622 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:13.544857  1542 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:00:13.547194  2789 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:13.549430  2610 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.551231  1691 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.549430  1622 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:13.552366  2720 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:13.552714  1442 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.560493  2540 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:13.568778  2720 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.571609  1542 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.572961  1617 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.591348  1622 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:13.603317  1445 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:00:13.608076  1585 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29466a5fdaaa4059bb44d95ca1ec63b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.609156  1542 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.609535  1691 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.610666  2761 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.611690  2636 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.620604  2761 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.625828  1542 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.626379  1691 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.627975   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:13.635766  1687 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:13.637110  1444 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:13.648700  1659 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78df79e3d5044daa8ed98fe19b18d0fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:13.649199  1542 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.650535  1622 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:13.650738  2720 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.656556  2720 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:13.683624  2540 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.685499  1541 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.703217   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:13.711133  1445 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.714131  1617 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:13.792758  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:13.793342  1542 raft_consensus.cc:606] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:13.796479  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:13.796936  1691 raft_consensus.cc:606] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:13.799193  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:13.799618  1617 raft_consensus.cc:606] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:13.801954  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:13.802469  1542 raft_consensus.cc:606] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:13.805085  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:13.805548  1687 raft_consensus.cc:606] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:13.807824  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:13.808338  1542 raft_consensus.cc:606] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:13.809401   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:13.810940   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:13.866479  2741 raft_consensus.cc:993] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:13.867020  2741 raft_consensus.cc:1081] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:13.868678  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:13.869216  1687 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.869565  1687 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.875766  1687 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:13.877671  1687 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:13.878500  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:13.879277  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:13.879632  1542 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:13.879829  1617 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.879988  1542 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:13.880812  1542 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:13.881693  1542 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.886034  1542 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:13.886060  1617 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:13.887307  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:13.887998  2748 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:13.888545  2748 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:13.889504  2748 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:13.906663  1444 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.921373  2748 raft_consensus.cc:993] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:13.921885  2720 raft_consensus.cc:1081] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:13.923497  2262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:13.937742  2262 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.938126  2262 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.953006  2262 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:13.958392  2262 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:13.959017  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:13.960090  1687 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:13.960206  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:13.960853  1617 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.960422  1687 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:13.962437  1687 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:13.963593  1687 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:13.967862  1617 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:13.969010  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:13.969818  2759 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:13.976485  2759 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:13.977417  2759 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:13.976523  1687 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:13.989647  1444 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.997310  2750 raft_consensus.cc:993] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:13.997819  2729 raft_consensus.cc:1081] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:13.999459  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:56132
I20260709 13:00:13.999903  1541 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.000192  1541 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.004310  1541 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.006474  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:14.007306  1617 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:14.007598  1617 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:14.006789  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:14.008348  1687 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.008353  1617 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.011463  1617 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.006610  1541 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:14.014657  1687 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:14.015733  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:14.016489  2756 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:14.017004  2756 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:14.017879  2756 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.019449  1617 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:14.023552  2816 ts_tablet_manager.cc:933] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:14.035327  2816 tablet_copy_client.cc:323] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:14.036856  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet ab05924031f84a848a47260864c78193 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:14.037376  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet ab05924031f84a848a47260864c78193 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-ab05924031f84a848a47260864c78193
I20260709 13:00:14.039314  2610 raft_consensus.cc:993] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:14.039752  2610 raft_consensus.cc:1081] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:14.041342  2263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42620
I20260709 13:00:14.041855  2263 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.042204  2263 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.043781  1444 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:14.045591  1632 tablet_copy_source_session.cc:215] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.048786  2263 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.049268  2816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab05924031f84a848a47260864c78193. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.051990  2263 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:14.053138  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:14.053702  1687 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.053957  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:14.054467  1542 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:14.054768  1542 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:14.055471  1542 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.056635  1542 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.062955  1542 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:14.062955  1687 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:14.064129  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:14.064901  2759 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:14.065397  2759 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:14.066053  2759 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.071579  2816 tablet_copy_client.cc:806] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.072134  2816 tablet_copy_client.cc:670] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.076174  1444 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.081082  2816 tablet_copy_client.cc:538] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.090400  2816 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:14.108557  2816 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.109321  2816 tablet_bootstrap.cc:492] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:14.109848  2816 ts_tablet_manager.cc:1403] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:00:14.112444  2816 raft_consensus.cc:359] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.113035  2816 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:14.113590  2816 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.115556  2816 ts_tablet_manager.cc:1434] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:00:14.117614  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ab05924031f84a848a47260864c78193 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:14.118011  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-ab05924031f84a848a47260864c78193 on tablet ab05924031f84a848a47260864c78193 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:14.150275  2816 ts_tablet_manager.cc:933] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:14.152161  2816 tablet_copy_client.cc:323] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:00:14.154819  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet a0a119b71a994fd1aeb21c6ba31e339b from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:00:14.155342  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet a0a119b71a994fd1aeb21c6ba31e339b from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-a0a119b71a994fd1aeb21c6ba31e339b
I20260709 13:00:14.171679  1706 tablet_copy_source_session.cc:215] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.185120  2823 ts_tablet_manager.cc:933] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:14.193876  2748 raft_consensus.cc:993] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:14.194164  2816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a119b71a994fd1aeb21c6ba31e339b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.194487  2748 raft_consensus.cc:1081] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:14.196547  2262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:14.197211  2262 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.197681  2262 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.212173  2816 tablet_copy_client.cc:806] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.212899  2816 tablet_copy_client.cc:670] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.215884  2822 ts_tablet_manager.cc:933] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:14.216948  2816 tablet_copy_client.cc:538] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.217882  2822 tablet_copy_client.cc:323] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:00:14.220340  2262 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.224099  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 78df79e3d5044daa8ed98fe19b18d0fe from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:00:14.224663  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 78df79e3d5044daa8ed98fe19b18d0fe from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-78df79e3d5044daa8ed98fe19b18d0fe
I20260709 13:00:14.228016  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:14.228807  1617 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.233248  2756 raft_consensus.cc:993] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:14.233765  2756 raft_consensus.cc:1081] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:14.233814  1706 tablet_copy_source_session.cc:215] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.239065  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:14.239614  1691 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.239946  1691 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.223158  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:14.243729  1687 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:14.244055  1687 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:14.244801  1687 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.245841  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.251900  2816 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:14.259922  1691 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.268347  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:14.269471  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:14.270291  2759 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:14.270934  2759 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:14.271763  2759 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.280860  1617 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:14.285264  2823 tablet_copy_client.cc:323] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:14.285583  2816 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.292379  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:14.292641  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:14.292944  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 29466a5fdaaa4059bb44d95ca1ec63b8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-29466a5fdaaa4059bb44d95ca1ec63b8
I20260709 13:00:14.293231  1542 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:14.293521  1542 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:14.293602  1444 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.294281  1542 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.295650  1542 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.300740  1632 tablet_copy_source_session.cc:215] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:14.301597  2816 tablet_bootstrap.cc:492] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:14.308568  2816 ts_tablet_manager.cc:1403] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.003s
I20260709 13:00:14.303897  2822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78df79e3d5044daa8ed98fe19b18d0fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.304793  1622 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.304908  1542 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:14.311403  2262 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:14.311658  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:14.312140  2823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29466a5fdaaa4059bb44d95ca1ec63b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:14.312588  2540 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:14.313035  2540 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:14.313863  2748 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.313795  2540 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:14.321262  2816 raft_consensus.cc:359] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.322738  2816 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:14.323367  2816 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.326884  2816 ts_tablet_manager.cc:1434] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:00:14.332321  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-a0a119b71a994fd1aeb21c6ba31e339b received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:14.332764  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-a0a119b71a994fd1aeb21c6ba31e339b on tablet a0a119b71a994fd1aeb21c6ba31e339b with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:14.339102  2822 tablet_copy_client.cc:806] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.339696  2822 tablet_copy_client.cc:670] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.348399  2822 tablet_copy_client.cc:538] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.357610  2823 tablet_copy_client.cc:806] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:14.358273  2823 tablet_copy_client.cc:670] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:14.360208  2822 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:14.370047  2823 tablet_copy_client.cc:538] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:14.305678  1691 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:14.307526  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:14.378716  1618 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:14.389253  1618 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:14.396019  2823 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:14.400633  1442 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.419983  1541 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.426169  2720 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.431043  2262 raft_consensus.cc:1217] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:14.432082  1691 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:14.433732  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44380.6us
I20260709 13:00:14.441579  2814 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:14.454497  2822 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.455447  2822 tablet_bootstrap.cc:492] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:14.456193  2822 ts_tablet_manager.cc:1403] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.051s
I20260709 13:00:14.463666  1617 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:14.464936  2759 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:14.465438  2822 raft_consensus.cc:359] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.466238  2822 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:14.466935  2822 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.484973  2822 ts_tablet_manager.cc:1434] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:00:14.487152  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-78df79e3d5044daa8ed98fe19b18d0fe received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:14.487630  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-78df79e3d5044daa8ed98fe19b18d0fe on tablet 78df79e3d5044daa8ed98fe19b18d0fe with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:14.494218  2823 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:14.495173  2823 tablet_bootstrap.cc:492] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:14.496224  2823 ts_tablet_manager.cc:1403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.000s
I20260709 13:00:14.498909  2823 raft_consensus.cc:359] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.499640  2823 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:14.500204  2823 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:14.502369  2823 ts_tablet_manager.cc:1434] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:14.503969  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-29466a5fdaaa4059bb44d95ca1ec63b8 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:14.504343  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-29466a5fdaaa4059bb44d95ca1ec63b8 on tablet 29466a5fdaaa4059bb44d95ca1ec63b8 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:14.543221  1691 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:14.544651  2759 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:14.575214  1541 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:14.576853  2839 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:14.599435  2262 raft_consensus.cc:1217] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:14.613853  1696 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.616223  2756 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.631011  1617 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.633500  2610 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.657816  2262 raft_consensus.cc:1217] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:14.707607  2262 raft_consensus.cc:1217] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:14.727294  1696 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:14.728451  2839 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:14.738320  1617 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:14.739799  2759 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:14.811798   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:14.847780  2750 raft_consensus.cc:1064] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:14.850361  2750 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:14.856889  1542 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.858951  2748 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:14.865516  2262 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:14.867044  2636 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:14.878548  1696 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:14.881080  2729 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:14.884601  1541 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:14.884986   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:14.887363  2750 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:14.910844  1617 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:14.912909  2540 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:14.926162  2750 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:14.928546  1541 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:14.939261  1696 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:14.961344  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:14.961961  1687 raft_consensus.cc:606] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:14.963690  1444 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:14.971524  2262 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:14.991976  2720 raft_consensus.cc:993] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:14.992467  2720 raft_consensus.cc:1081] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:14.994879  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:14.995584  1541 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:14.996016  1541 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:14.998910  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:14.999682  1542 raft_consensus.cc:606] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:15.005282  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:15.005807  1618 raft_consensus.cc:606] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:15.010576  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:15.011150  1618 raft_consensus.cc:606] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:15.025379  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5fffa415884468d9ae844797cb87109"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:15.025949  1687 raft_consensus.cc:606] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:15.027280   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:15.026886  1541 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.028934   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:15.032177  1541 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:15.033407  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:15.034040  1618 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.036072  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:15.036720  1687 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.036985  1687 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:15.037775  1687 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.038906  1687 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.048908  1618 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:15.050144  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:15.051023  2756 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.052139  2756 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:15.052942  2756 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.062391  1687 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:15.063663  1442 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.074854  1618 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.086062  2729 raft_consensus.cc:993] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:15.086513  2729 raft_consensus.cc:1081] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:15.089499  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:15.090001  1696 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.090344  1696 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.105398  2262 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.106170  1687 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.106935  2636 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.107769  2750 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.111459  1696 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.113354  1696 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:15.115280  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:15.115926  1545 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.116042  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:15.116592  1617 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.116848  1617 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:15.117045  2636 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.124421  2748 raft_consensus.cc:1064] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:15.122536  1545 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:15.126170  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:15.127120  2748 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.127207  2262 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.131983  2853 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.132560  2853 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:15.133407  2853 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.133600  1687 raft_consensus.cc:2955] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.117537  1617 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.140304  1617 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.140791  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab05924031f84a848a47260864c78193 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:15.149067  1442 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.152984  2265 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.161681  1618 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.163345  2861 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.169319  2720 raft_consensus.cc:1064] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:15.171108  1541 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.173084  2833 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.172981  2720 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.177186  2833 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:15.172566  1445 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.186187  1617 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:15.194716  2750 raft_consensus.cc:1064] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:15.196584  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet ab05924031f84a848a47260864c78193 with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:15.197156  2750 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.211072  2262 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:15.212519  2861 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.213454  1545 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:15.217895  2861 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.223116  2866 tablet_replica.cc:333] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:15.223201  1619 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:15.227839  2833 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.231233  2866 raft_consensus.cc:2243] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:15.233287  2866 raft_consensus.cc:2272] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:15.237882  2866 ts_tablet_manager.cc:1916] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:15.240913  2833 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.248647  2265 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.255580  2263 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.257009  2636 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.255529  1617 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.266577  1542 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.271135  2856 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.276360  2741 raft_consensus.cc:993] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:15.276823  2741 raft_consensus.cc:1081] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:15.278811  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:15.279422  1687 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.279610  2866 ts_tablet_manager.cc:1929] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:15.252189  2720 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.280259  2866 log.cc:1199] T ab05924031f84a848a47260864c78193 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/ab05924031f84a848a47260864c78193
I20260709 13:00:15.282114  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet ab05924031f84a848a47260864c78193 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:15.279776  1687 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.252288  1541 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:00:15.291424  2867 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:15.293236  1696 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:15.290411  1687 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.305994  1442 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.297844  1687 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:15.308348  1445 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.318966  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:15.319624  1542 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:15.319938  1542 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:15.320621  1542 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.321976  1542 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.328917  1691 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.333189  2729 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.338056  1541 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.334594  2263 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.337339  2264 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.356806  2856 raft_consensus.cc:993] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:15.357362  2856 raft_consensus.cc:1081] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:15.358134  2833 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.360827  2856 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.362965  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:56132
I20260709 13:00:15.363509  1545 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.363823  1545 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.365381  1619 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.366714  1617 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.370735  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:15.371417  1622 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:15.376814  1542 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:15.377915  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:15.381461  2853 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.385056  1545 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.386813  2540 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:15.394658  1545 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:15.395591  1622 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:15.396937  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:15.397599  1619 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:15.397646  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47638.7us
I20260709 13:00:15.398039  1619 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:15.398959  1619 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.400677  1619 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.407521  1619 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:15.409739  1445 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.410894  1691 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.409288  2263 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.417089  2748 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:15.417656  2748 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:15.418927  2748 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.422513  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:15.423053  1687 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.429175  1687 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:15.431671  1511 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:15.434161  2741 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.435277  2741 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:15.434638  2265 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.434978  1545 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.436144  2741 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:15.437635  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78df79e3d5044daa8ed98fe19b18d0fe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:15.451316  1617 raft_consensus.cc:2955] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.469282  1619 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:15.470860  2873 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:15.481935  1443 catalog_manager.cc:5697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 3, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.483794  1445 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.501238  2833 raft_consensus.cc:993] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:15.501744  2833 raft_consensus.cc:1081] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:15.503327  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5fffa415884468d9ae844797cb87109"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:15.503836  2265 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:15.504158  2265 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.508865  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet 78df79e3d5044daa8ed98fe19b18d0fe with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:15.509859  2866 tablet_replica.cc:333] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:15.510927  2866 raft_consensus.cc:2243] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:15.511653  2866 raft_consensus.cc:2272] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:15.517200  2265 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.519832  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:15.520408  1545 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.520891  2866 ts_tablet_manager.cc:1916] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:15.525069  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:15.525655  1691 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:15.525936  1691 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:15.523136  2265 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:15.526602  1691 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.530489  1691 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:15.537247  1691 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:15.538348  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:15.539302  2839 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:15.539808  2839 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:15.540657  2839 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.543134  1687 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:15.545127  2873 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.548295  1545 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:15.623075  2866 ts_tablet_manager.cc:1929] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:15.625051  2866 log.cc:1199] T 78df79e3d5044daa8ed98fe19b18d0fe P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/78df79e3d5044daa8ed98fe19b18d0fe
I20260709 13:00:15.632702  1444 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:15.639870  1617 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:15.644311  2878 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:15.645962  1442 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:15.681463  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet 78df79e3d5044daa8ed98fe19b18d0fe (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:15.723565  1687 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.732658  2263 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:15.735010  2748 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:15.751972  1541 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:15.752146  1545 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:15.756165  2720 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:15.756381  2878 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:15.771616  1545 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.786019  1622 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:15.830075  2265 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.831404  2263 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.835239  2885 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:15.846457  2729 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.856539  2264 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.789201  2748 raft_consensus.cc:2955] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.876446  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:15.879755  1618 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:15.881858  2540 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:15.884788  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0a119b71a994fd1aeb21c6ba31e339b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:15.891685  1442 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.901281  1444 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:15.914093  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48331.6us
I20260709 13:00:15.916394  1542 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:15.921402  2729 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:15.924794  1542 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:15.926525  1545 raft_consensus.cc:2955] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:15.928269  2540 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:15.941493  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 29466a5fdaaa4059bb44d95ca1ec63b8 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:15.941524  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet a0a119b71a994fd1aeb21c6ba31e339b with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:15.944914  2891 tablet_replica.cc:333] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:15.947633  2891 raft_consensus.cc:2243] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:15.949165  2891 raft_consensus.cc:2272] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:15.958535  2891 ts_tablet_manager.cc:1916] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:15.969285  1687 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:15.971068  2887 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:15.982141  2890 tablet_replica.cc:333] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:15.983994  2891 ts_tablet_manager.cc:1929] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:15.984148  1618 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:15.988507  2891 log.cc:1199] T a0a119b71a994fd1aeb21c6ba31e339b P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/a0a119b71a994fd1aeb21c6ba31e339b
I20260709 13:00:15.988402  2887 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:15.990752  2890 raft_consensus.cc:2243] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:15.991710  2890 raft_consensus.cc:2272] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:15.992838  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet a0a119b71a994fd1aeb21c6ba31e339b (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:16.000502  2890 ts_tablet_manager.cc:1916] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:16.020098  2890 ts_tablet_manager.cc:1929] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:16.020797  2890 log.cc:1199] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/29466a5fdaaa4059bb44d95ca1ec63b8
I20260709 13:00:16.025575  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 29466a5fdaaa4059bb44d95ca1ec63b8 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:16.028357  1545 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.029764  2839 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.031564   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:16.063396  1687 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.065068  2814 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:16.114100   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:16.156840  1618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:16.157536  1618 raft_consensus.cc:606] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:16.164057  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:16.164717  1545 raft_consensus.cc:606] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:16.167701  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:16.168232  1687 raft_consensus.cc:606] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:16.171140  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:16.171682  1545 raft_consensus.cc:606] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:16.174279  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:16.174774  1687 raft_consensus.cc:606] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:16.175745   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:16.176769   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:16.205731  2540 raft_consensus.cc:993] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.206271  2833 raft_consensus.cc:1081] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.207641  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:16.208138  2265 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.208406  2265 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.213798  2265 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.215592  2265 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:16.216524  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:16.217213  1618 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.218233  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:16.218835  1696 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.219121  1696 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:16.219866  1696 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.221068  1696 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.224244  1618 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.225418  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:16.226138  2839 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.226567  2839 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:16.227135  1696 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.227510  2839 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.237813  1444 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.263047  2540 raft_consensus.cc:993] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.263564  2748 raft_consensus.cc:1081] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.265101  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:16.265645  2265 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.265961  2265 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.273002  2265 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.274958  2265 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:16.275691  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:16.275992  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:16.276262  1545 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.276645  1696 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.276958  1696 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:16.277729  1696 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.278887  1696 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.282150  1545 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.283394  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:16.287020  2839 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.287688  2839 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:16.288539  2839 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.298784  1696 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.298288  1445 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.312107  2887 raft_consensus.cc:993] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.312721  2610 raft_consensus.cc:1081] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.314373  2264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42620
I20260709 13:00:16.314884  2264 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.315202  2264 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.320366  2264 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.322422  2264 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:16.323743  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:16.324404  1696 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.325963  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:16.326534  1545 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.326843  1545 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:16.327579  1545 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.328828  1545 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.331678  1696 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.333325  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:16.333938  2839 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.334394  2839 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:16.335847  1545 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.335904  2839 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.353104  1445 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.466035  2610 raft_consensus.cc:993] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:16.466750  2741 raft_consensus.cc:1081] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:16.468343  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:16.468899  1696 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.469252  1696 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.473783  1696 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:16.476085  1696 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:16.476046  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:16.476302  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:16.476863  1545 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:16.476894  1622 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.477313  1545 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:16.478056  1545 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:16.479516  1545 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:16.484083  1622 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:16.485215  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:16.485834  1545 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:16.485976  2833 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:16.486593  2833 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:16.487473  2833 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:16.496608  1445 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 3, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.620501  2636 raft_consensus.cc:993] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.620972  2636 raft_consensus.cc:1081] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:16.622413  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42592
I20260709 13:00:16.622951  2265 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:16.623276  2265 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.629578  2265 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.631155  2265 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:16.632078  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:16.631727  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:16.632699  1696 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.633422  1622 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:16.633737  1622 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:16.634560  1622 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.635758  1622 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:16.639364  1696 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.640326  1622 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:16.640622  2231 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:16.641494  2839 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:16.641950  2839 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:16.642830  2839 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:16.659138  1444 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:16.729485  1618 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.730675  2839 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.745069  1696 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.746407  2839 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.752125  1545 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.753530  2839 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.777778  1696 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.779340  2759 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.787940  1542 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.793298  2839 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:16.817034  1696 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:16.819088  2814 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:16.939124  1618 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:16.940295  2748 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:16.950045  1542 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:16.952070  2861 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:17.031436  1696 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.037202  1545 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:00:17.037796  1659 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f950ec06ccd64933a117a4c6e6114ed3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.038156  1618 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:17.038671  2833 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:17.039484  2861 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:17.046986  2861 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.049364  1618 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.049782  1542 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.067487  1622 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:17.069028  2839 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.069559  1444 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 3, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.082329  1542 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:17.091281  1510 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 854dc9ecb21b45069ab7661dc5c021c9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.092252  1696 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.095458  2741 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.096431  1696 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:17.101681  2839 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.106926  1618 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.109203  2741 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.144578  2741 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.150698  1691 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.165594  1542 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.172639  1445 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:17.190423  1510 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f85ee981fb9947eb9c9c17aa40779ecc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.183846   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:17.195147  1618 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.198711  1622 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.200456  2922 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.206739  1696 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.217638  2925 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.227933  2922 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.237285  1691 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.235949  1622 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.245494  1618 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.252389  1445 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:17.266428  1585 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6548704b45e547b6ab8bc4081d8b3ad7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:17.268723  1691 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.269196  1541 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:17.271211  2729 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:17.274461  2929 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:17.285842  2636 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.293205  1691 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.296921  1541 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:17.310403  1445 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.322162   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:17.375265  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:17.375864  1691 raft_consensus.cc:606] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:17.378369  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:17.378914  1622 raft_consensus.cc:606] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:17.382421  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "831605a002324a04838f4fe562b13530"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:17.383179  1622 raft_consensus.cc:606] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:17.386188  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab05924031f84a848a47260864c78193"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:17.386840  1622 raft_consensus.cc:606] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:17.389454  1622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca134e523abd4f159806116930d9aece"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:17.389981  1622 raft_consensus.cc:606] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:17.391180   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:17.392343   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:17.450515  2932 ts_tablet_manager.cc:933] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:17.452983  2932 tablet_copy_client.cc:323] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:00:17.455005  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet f950ec06ccd64933a117a4c6e6114ed3 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:00:17.455531  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet f950ec06ccd64933a117a4c6e6114ed3 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-f950ec06ccd64933a117a4c6e6114ed3
I20260709 13:00:17.464839  1706 tablet_copy_source_session.cc:215] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:17.468271  2932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f950ec06ccd64933a117a4c6e6114ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.482769  2932 tablet_copy_client.cc:806] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:17.483351  2932 tablet_copy_client.cc:670] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:17.487115  2932 tablet_copy_client.cc:538] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:17.496433  2932 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:17.521853  2932 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:17.522804  2932 tablet_bootstrap.cc:492] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:17.523504  2932 ts_tablet_manager.cc:1403] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.003s
I20260709 13:00:17.526562  2932 raft_consensus.cc:359] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.527470  2932 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:17.528108  2932 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.530675  2932 ts_tablet_manager.cc:1434] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:17.535679  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f950ec06ccd64933a117a4c6e6114ed3 received from {username='slave'} at 127.0.0.1:43624
I20260709 13:00:17.536163  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f950ec06ccd64933a117a4c6e6114ed3 on tablet f950ec06ccd64933a117a4c6e6114ed3 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:17.565233  2729 raft_consensus.cc:993] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:17.565670  2636 raft_consensus.cc:1081] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:17.567128  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "831605a002324a04838f4fe562b13530"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42592
I20260709 13:00:17.567641  2265 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:17.567981  2265 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.574415  2265 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.576651  2265 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:17.576793  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:17.577456  1541 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.579397  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:17.579998  1622 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.580255  1622 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:17.580905  1622 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.582057  1622 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.583940  1541 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:17.585117  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:17.585858  2839 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.586331  2839 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:17.587184  2839 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.590843  1622 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:17.596995  1445 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.600497  2932 ts_tablet_manager.cc:933] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:17.606657  2932 tablet_copy_client.cc:323] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:17.608484  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet f85ee981fb9947eb9c9c17aa40779ecc from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:17.609047  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet f85ee981fb9947eb9c9c17aa40779ecc from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-f85ee981fb9947eb9c9c17aa40779ecc
I20260709 13:00:17.617318  1557 tablet_copy_source_session.cc:215] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:17.620694  2932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85ee981fb9947eb9c9c17aa40779ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.637394  2932 tablet_copy_client.cc:806] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:17.637990  2932 tablet_copy_client.cc:670] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:17.642257  2932 tablet_copy_client.cc:538] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:17.651183  2932 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:17.658579  2729 raft_consensus.cc:993] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:17.659139  2929 raft_consensus.cc:1081] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:17.661300  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca134e523abd4f159806116930d9aece"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:56132
I20260709 13:00:17.661835  1541 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:17.662428  1541 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.669090  1541 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.671837  1541 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:17.673641  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:17.692291  2264 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.671167  2932 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:17.699435  2932 tablet_bootstrap.cc:492] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:17.700384  2932 ts_tablet_manager.cc:1403] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.000s
I20260709 13:00:17.703547  2932 raft_consensus.cc:359] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.704389  2932 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:17.705044  2932 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.713128  2264 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:17.714942  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:17.715350  2932 ts_tablet_manager.cc:1434] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:00:17.715808  2887 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.716389  2887 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:17.717511  2887 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.719146  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f85ee981fb9947eb9c9c17aa40779ecc received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:17.719777  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-f85ee981fb9947eb9c9c17aa40779ecc on tablet f85ee981fb9947eb9c9c17aa40779ecc with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:17.733798  2636 raft_consensus.cc:993] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:17.734305  2636 raft_consensus.cc:1081] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:17.671217  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:17.739077  1622 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.739380  1622 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:17.740303  1622 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.741990  1622 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.746272  1442 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.755851  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:17.756505  1696 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:17.756871  1696 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.757789  2932 ts_tablet_manager.cc:933] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:17.765143  1696 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.781365  2932 tablet_copy_client.cc:323] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:17.783048  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet 854dc9ecb21b45069ab7661dc5c021c9 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:17.783267  1696 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:17.783644  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet 854dc9ecb21b45069ab7661dc5c021c9 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-854dc9ecb21b45069ab7661dc5c021c9
I20260709 13:00:17.784165  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:17.784729  1618 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.784981  1618 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:17.785818  1618 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.786412  1622 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:17.782248  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:17.787336  1541 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.795537  1541 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:17.795557  1557 tablet_copy_source_session.cc:215] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:17.796705  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:17.797663  2833 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.798219  2833 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:17.799273  2833 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.796646  1618 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.814344  2932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854dc9ecb21b45069ab7661dc5c021c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.815593  1618 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:17.816140  1442 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:17.827023  2938 ts_tablet_manager.cc:933] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:17.828667  2938 tablet_copy_client.cc:323] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:17.830344  2932 tablet_copy_client.cc:806] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:17.830487  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 6548704b45e547b6ab8bc4081d8b3ad7 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:17.830936  2932 tablet_copy_client.cc:670] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:17.831188  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 6548704b45e547b6ab8bc4081d8b3ad7 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-6548704b45e547b6ab8bc4081d8b3ad7
I20260709 13:00:17.839563  2932 tablet_copy_client.cc:538] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:17.841403  1632 tablet_copy_source_session.cc:215] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:17.844594  2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6548704b45e547b6ab8bc4081d8b3ad7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.849287  2932 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:17.863827  2938 tablet_copy_client.cc:806] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:17.864485  2938 tablet_copy_client.cc:670] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:17.866004  2914 raft_consensus.cc:993] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:17.866637  2914 raft_consensus.cc:1081] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:17.868582  2938 tablet_copy_client.cc:538] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:17.872295  2636 raft_consensus.cc:993] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:17.873041  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:17.873564  1542 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:17.873622  2636 raft_consensus.cc:1081] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:17.873962  1542 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.875803  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab05924031f84a848a47260864c78193"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:17.876329  1691 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:17.876659  1691 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.881182  2938 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:17.884146  1691 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.886642  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:17.887219  1618 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.887562  1618 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:17.888403  1618 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.889561  1618 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.888559  1542 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.896229  1542 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:17.897068  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:17.897642  1622 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.898371  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:17.898955  2264 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.900370  2265 raft_consensus.cc:1217] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:00:17.901748  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:17.902288  1696 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:17.902565  1696 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:17.903330  1696 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.904371  1696 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:17.905901  2264 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:17.907130  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:17.908203  2914 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.908665  2914 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:17.909461  2914 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:17.914961  1691 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:17.916399  1618 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:17.920084  1622 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:17.921239  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:17.922176  2922 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:17.922643  2922 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:17.923600  1696 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:17.923454  2922 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:17.933372  2932 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:17.934259  2932 tablet_bootstrap.cc:492] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:17.934930  2932 ts_tablet_manager.cc:1403] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.086s	user 0.031s	sys 0.012s
I20260709 13:00:17.937497  2932 raft_consensus.cc:359] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.947347  2932 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:17.947974  2932 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.950681  1442 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.956148  2932 ts_tablet_manager.cc:1434] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:00:17.964547  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-854dc9ecb21b45069ab7661dc5c021c9 received from {username='slave'} at 127.0.0.1:35956
I20260709 13:00:17.965022  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-854dc9ecb21b45069ab7661dc5c021c9 on tablet 854dc9ecb21b45069ab7661dc5c021c9 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:17.965957  1445 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.974694  1542 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:17.980110  2942 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:17.978417  2938 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:17.982129  2938 tablet_bootstrap.cc:492] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:17.982856  2938 ts_tablet_manager.cc:1403] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.017s
I20260709 13:00:17.985774  2938 raft_consensus.cc:359] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.986564  2938 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:17.987226  2938 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:17.990638  2938 ts_tablet_manager.cc:1434] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:00:17.992307  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-6548704b45e547b6ab8bc4081d8b3ad7 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:17.992761  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-6548704b45e547b6ab8bc4081d8b3ad7 on tablet 6548704b45e547b6ab8bc4081d8b3ad7 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:18.031350  1622 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.039080  2942 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.093585  2264 raft_consensus.cc:1217] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:18.119684  1617 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.120935  2924 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.129801  2264 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.132874  2924 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.210891  2264 raft_consensus.cc:1217] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:18.239635  1622 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:18.240859  2914 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.259527  1544 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:18.260928  2914 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.337903  2914 raft_consensus.cc:1064] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:18.340206  2914 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:18.353253  2264 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.354691  1544 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.355194  1622 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:18.355917  2833 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:18.357560  2833 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:00:18.363726  2748 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:18.383374  2914 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.385922  1622 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.388211  1545 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.393326  1696 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:18.394573   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:18.396171  2264 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.396461  2265 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.400506  2922 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.406949  2748 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.441470  2263 raft_consensus.cc:1217] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:00:18.446662  1622 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.448877  2914 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.454909  1445 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.469333  1696 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:18.475764  2265 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.477552  2748 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:18.478531  2741 raft_consensus.cc:1064] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:18.480842  2741 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:18.486671  2748 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.497260  2263 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.506363  1545 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:18.506359  1622 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:18.512403  2922 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:18.521658  2961 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:18.534006  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101765us
I20260709 13:00:18.539527  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f950ec06ccd64933a117a4c6e6114ed3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:18.543599  1542 raft_consensus.cc:2955] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.578343  1445 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.622185  2265 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.623226  1618 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.624231  1696 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.624565  2887 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:18.626518  2887 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:18.629932  2887 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:18.638767  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet f950ec06ccd64933a117a4c6e6114ed3 with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:18.642128   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:18.651636  2924 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.652695  1691 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.667984  2976 tablet_replica.cc:333] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:18.670804  1618 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.673374  1444 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.679036  2976 raft_consensus.cc:2243] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.679939  2976 raft_consensus.cc:2272] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.683756  2976 ts_tablet_manager.cc:1916] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:18.686066  2265 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.701925  2976 ts_tablet_manager.cc:1929] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:18.702481  2976 log.cc:1199] T f950ec06ccd64933a117a4c6e6114ed3 P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/f950ec06ccd64933a117a4c6e6114ed3
I20260709 13:00:18.704234  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet f950ec06ccd64933a117a4c6e6114ed3 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:18.708946  1542 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:18.715871  2265 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:18.717042  1618 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:18.717850  2924 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:18.721555  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab05924031f84a848a47260864c78193"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:18.722157  1696 raft_consensus.cc:606] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:18.721807  2924 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:18.726913  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:18.727499  1544 raft_consensus.cc:606] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:18.728144  2887 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.730089  1544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:18.730660  1544 raft_consensus.cc:606] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:18.735148   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:18.736961  1617 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.737776  2263 raft_consensus.cc:2955] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.736961   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:18.762735  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 854dc9ecb21b45069ab7661dc5c021c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:18.767446  1444 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 3 to 4, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:18.777987  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 854dc9ecb21b45069ab7661dc5c021c9 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42310
I20260709 13:00:18.779948  2978 tablet_replica.cc:333] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:00:18.781004  2978 raft_consensus.cc:2243] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:18.783546  2978 raft_consensus.cc:2272] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:18.794190  2978 ts_tablet_manager.cc:1916] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:18.795280  2924 raft_consensus.cc:1064] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:00:18.795717  2924 raft_consensus.cc:1068] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Service unavailable: leader transfer in progress
I20260709 13:00:18.810995  2978 ts_tablet_manager.cc:1929] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:18.811496  2978 log.cc:1199] T 854dc9ecb21b45069ab7661dc5c021c9 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/854dc9ecb21b45069ab7661dc5c021c9
I20260709 13:00:18.813095  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 854dc9ecb21b45069ab7661dc5c021c9 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:18.849298  2924 raft_consensus.cc:993] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:18.849829  2924 raft_consensus.cc:1081] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Signalling peer c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:18.851495  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:00:18.851949  1617 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:18.852260  1617 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.868361  1617 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:18.871845  1617 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:18.873759  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:18.878054  1696 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.876111  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:18.878839  1544 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:18.879166  1544 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:18.879917  1544 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:18.880915  1544 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:18.888070  1544 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:18.889222  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:18.890023  2929 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:18.890486  2929 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:18.891310  2929 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:18.892562  1696 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:18.906134  1443 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 3, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.968972  2636 raft_consensus.cc:1064] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:18.970777  2636 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:18.976261  2265 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.977814  1544 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.977676  2636 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:18.978168  1696 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:00:18.980682  2968 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:18.981571  2929 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.015944  2636 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.022373  1544 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.027323  1691 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.036254  2263 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.039654  1443 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 3, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.058426  2961 raft_consensus.cc:993] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:19.059055  2961 raft_consensus.cc:1081] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Signalling peer c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:19.060707  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab05924031f84a848a47260864c78193"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:38818
I20260709 13:00:19.061203  1617 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.061543  1617 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.068015  1617 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:19.072455  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:19.074013  1618 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:19.073074  1691 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:19.075346  1691 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:19.076071  1691 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:19.076840  1691 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.077572  1617 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:19.079293  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:19.079887  2263 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:19.084241  1696 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:19.084774  2265 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:00:19.085737  2636 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.086093  1691 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:19.087318  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:19.088006  2636 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:19.091589  2981 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.096319  2263 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:19.102265  2636 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:19.101452  2981 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.105211  2636 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:19.105786  2265 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.114092  1690 raft_consensus.cc:2955] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.126502  1445 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.150359  1445 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 3 to 4, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.154790  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6548704b45e547b6ab8bc4081d8b3ad7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:19.173440  1530 tablet_service.cc:1558] Processing DeleteTablet for tablet 6548704b45e547b6ab8bc4081d8b3ad7 with delete_type TABLET_DATA_TOMBSTONED (TS 9fbc4df0bb934bba941cfa20c0afead2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35464
I20260709 13:00:19.175812  2986 tablet_replica.cc:333] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:00:19.176872  2986 raft_consensus.cc:2243] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:19.177613  2986 raft_consensus.cc:2272] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:19.181365  2986 ts_tablet_manager.cc:1916] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:19.193804  2986 ts_tablet_manager.cc:1929] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:00:19.194172  2986 log.cc:1199] T 6548704b45e547b6ab8bc4081d8b3ad7 P 9fbc4df0bb934bba941cfa20c0afead2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-0-root/wals/6548704b45e547b6ab8bc4081d8b3ad7
I20260709 13:00:19.195803  1431 catalog_manager.cc:5028] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): tablet 6548704b45e547b6ab8bc4081d8b3ad7 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:19.204180  2924 raft_consensus.cc:1064] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:00:19.204664  2924 raft_consensus.cc:1068] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Service unavailable: leader transfer in progress
I20260709 13:00:19.212363  2741 raft_consensus.cc:993] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:19.212817  2924 raft_consensus.cc:1081] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:19.214182  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:19.214753  1691 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.215049  1691 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.219666  1691 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:19.221101  1691 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:19.221892  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:19.222091  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:19.222446  1545 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.222698  1617 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.222847  1545 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:19.223647  1545 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:19.224799  1545 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.229609  1617 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:19.231115  1660 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:19.231982  2961 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.232435  2961 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:19.232725  1545 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:19.233325  2961 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:19.244971  1445 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.314563  1545 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.315851  2981 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.342412  1691 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:19.344719  2981 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.525003  2265 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:19.526417  2636 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:19.539489  1691 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:19.541438  2981 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:19.677243  2263 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Advancing to term 2
I20260709 13:00:19.682209  2263 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:19.684000  2961 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.696228  2748 raft_consensus.cc:1064] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:00:19.696656  2748 raft_consensus.cc:1068] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:19.731618  1617 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:19.732975  2748 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:19.748911  1545 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:00:19.753989   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:19.763195  2999 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:00:19.766858  2914 raft_consensus.cc:1064] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:19.779033  2914 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:19.788039  2263 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:19.790164  1617 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:19.792303  2961 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.797554  1544 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:00:19.800834  2748 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.803349  2961 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:19.815907  2999 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.817453  1544 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.865036  1618 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.896620  2263 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.909374  1445 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index 2 to 4, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:19.990152  1691 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.007522  2263 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:20.007957  1545 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:20.009848  2748 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:20.010951  2999 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:20.022886  2914 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:20.026480  1544 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:20.027550  2265 raft_consensus.cc:2955] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:20.039407  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f85ee981fb9947eb9c9c17aa40779ecc with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:20.047219  1444 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 4 to 5, VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:20.049266   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:20.061628  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet f85ee981fb9947eb9c9c17aa40779ecc with delete_type TABLET_DATA_TOMBSTONED (TS c5f349bdadfc40b9bff8e1682b5c271b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38802
I20260709 13:00:20.064476  3007 tablet_replica.cc:333] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:00:20.065460  3007 raft_consensus.cc:2243] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:20.066597  3007 raft_consensus.cc:2272] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:20.069826  3007 ts_tablet_manager.cc:1916] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:00:20.088474  3007 ts_tablet_manager.cc:1929] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:00:20.088903  3007 log.cc:1199] T f85ee981fb9947eb9c9c17aa40779ecc P c5f349bdadfc40b9bff8e1682b5c271b: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-1-root/wals/f85ee981fb9947eb9c9c17aa40779ecc
I20260709 13:00:20.090678  1430 catalog_manager.cc:5028] TS c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): tablet f85ee981fb9947eb9c9c17aa40779ecc (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:00:20.105819  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:20.106426  1617 raft_consensus.cc:606] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:20.108940  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:20.109346  1691 raft_consensus.cc:606] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:20.112912  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:37266
I20260709 13:00:20.113405  1617 raft_consensus.cc:606] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:20.115471  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:20.116019  1691 raft_consensus.cc:606] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Received request to transfer leadership to TS e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:20.117031   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:20.118712   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:20.185482  2968 raft_consensus.cc:993] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:20.186079  2981 raft_consensus.cc:1081] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:20.187659  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:20.188145  1696 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.188470  1696 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.193254  1696 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.194967  1696 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:20.195675  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:20.195902  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:20.196255  1617 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:20.196395  2265 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.196480  1617 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:20.197106  1617 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.197882  1617 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.201134  2265 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:20.202324  1659 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:20.202332  1617 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:20.203406  2914 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.203871  2914 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:20.204747  2914 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.213951  1442 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.270051  2999 raft_consensus.cc:993] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:20.270524  2914 raft_consensus.cc:1081] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Signalling peer e51b0b5dc04b4f5aaf6a3a870f291345 to start an election
I20260709 13:00:20.271888  2265 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
 from {username='slave'} at 127.0.0.1:42608
I20260709 13:00:20.272317  2265 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.272603  2265 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.278321  2265 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.279886  2265 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:20.280830  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:20.281419  1544 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.282215  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:20.282945  1696 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.283250  1696 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:20.283941  1696 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.284907  1696 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.288906  1544 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:20.289539  1545 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:20.291571  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:20.292279  3006 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.292755  3006 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:20.293546  3006 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.295378  1696 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:20.301494  1442 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.496371  2968 raft_consensus.cc:993] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:20.496886  2968 raft_consensus.cc:1081] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:20.501025  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:00:20.501586  1691 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.501924  1691 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.506739  1691 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.508471  1691 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:20.508987  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:20.509375  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:20.509562  1618 raft_consensus.cc:3055] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:20.509953  2265 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.509963  1618 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:20.511046  1618 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.512202  1618 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:20.515363  2265 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:20.516319  1659 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:20.516834  1618 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:20.517175  2914 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:20.517729  2914 raft_consensus.cc:697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:20.518767  2914 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:20.529724  1442 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.674288  2265 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:20.675683  2914 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:20.686311  1618 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:20.688534  1691 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:20.688784  2914 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:20.691910  3006 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:20.713979  1545 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:20.714491  3014 raft_consensus.cc:993] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:20.719126  3014 raft_consensus.cc:1081] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:20.738379  3020 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:00:20.757215  1544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:20.757997  1544 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:20.758466  1544 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.778646  1544 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:20.788182  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:20.788727  1618 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.790457  1544 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:20.791400  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:20.791955  1691 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:20.792230  1691 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:20.792912  1691 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:20.794080  1691 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:20.795542  1618 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:20.797034  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:20.798283  3023 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:20.798821  3023 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:20.799543  3023 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:20.800356  1691 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:20.809276  1443 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:20.962735  2265 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:20.969825  3015 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:22.144572  3027 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.145121  3027 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.147261  3027 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.148002  3027 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.149041  3027 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.151577  3027 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.309037   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:22.509109  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08000a7660 after lost signal to thread 434
I20260709 13:00:22.683621  3030 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.685904  3031 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.686221  3033 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:22.684758  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.000s	sys 0.009s
W20260709 13:00:22.687376  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.009s
I20260709 13:00:22.686800  3033 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.691095  3031 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.724115  3033 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.724671  3033 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.724987  3031 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.725184  3033 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.727375  3033 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.685398  3030 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.739363  3038 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.740000  3006 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.739933  3038 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.740553  3006 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.740751  3030 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.742101  3038 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.742635  3038 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.742498  3006 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.765105  3006 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.748364  3034 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.765604  3006 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.765893  3034 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.767823  3006 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.749073  3031 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.749486  3033 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.769850  3038 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.770395  3033 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.772286  3033 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.769881  3031 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.773976  3038 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.775782  3031 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.750447  3040 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.757104  3030 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.762660  3037 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.777040  3030 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.777519  3037 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.764456  3042 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.767871  3034 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.780018  3030 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.780544  3030 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.781461  3040 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.781219  3030 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.785403  3030 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.787827  3040 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.753155  3032 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.788944  3032 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.791640  3032 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.779517  3042 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.797107  3042 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.798593  3037 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.802173  3015 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.802877  3015 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.804258  3046 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.804996  3015 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.804783  3046 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.808739  3043 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.809293  3043 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.812650  3030 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.813354  3015 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.813184  3030 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.813419  3019 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.813879  3015 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.815147  3035 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.815752  3035 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.817579  3015 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.818105  3035 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.816016  3040 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.819885  3040 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.821848  3038 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.822119  3040 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.819239  2999 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.814074  3019 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.822713  2999 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.823669  3049 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.824435  3019 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.824862  2999 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.825028  3019 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.825405  2999 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.825728  3051 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.825628  3019 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.825968  2999 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.830495  2999 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.826269  3051 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.809625  3006 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.839139  3035 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.839473  3006 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.839720  3035 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.841869  3043 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.842425  3043 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.842919  3019 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.842880  3043 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.815770  3030 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.844439  3030 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.844853  3043 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.844920  3030 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.846768  3006 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.847177  3030 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.848812  3019 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.849390  3006 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.849951  3006 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.852115  3006 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.852640  3006 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:22.853196  3006 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.853938  3035 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.824172  3049 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.822395  3038 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.776408  3044 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.860760  3049 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.861701  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.862926  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.863258  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.863389  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.863504  1622 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:22.864496  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.849406  3019 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.877708  3034 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:22.878299  3034 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.879019  3019 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.880020  3046 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.854753  3015 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.856000  3032 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.864274  3044 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.999366  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:22.977523  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:22.993538  3047 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.021922  3047 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.024314  3058 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.024720  3047 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:22.984911  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.025586  3047 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.025017  3058 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.993484  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.026829  1621 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:23.018090  3054 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:22.994120  3057 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.027730  3054 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.028131  3057 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.029060  3052 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.030035  3052 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.030709  3054 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.928416  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.031332  3054 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.024829  3055 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.031747  2265 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:22.974013  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.032238  3055 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.033090  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:22.887631  3033 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.034372  3033 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.865641  3040 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:22.882468  3051 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.857646  2999 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.018877  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:22.962922  3042 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.034498  3055 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:22.979494  3036 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.041855  3036 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:22.951647  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.043617  2230 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.044555  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.045426  3036 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:23.045807  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2040 after lost signal to thread 1479
W20260709 13:00:23.047114  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08003156e0 after lost signal to thread 1571
I20260709 13:00:22.993883  3053 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.046288  3055 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.048870  3040 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.039443  3057 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.018774  3032 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.041400  3020 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:22.976372  3038 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.044697  2939 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.034499  3031 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.050720  2939 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.051120  2939 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.050927  3031 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.051918  3040 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.019627  3015 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.964304  3006 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.054380  3015 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:22.968858  3049 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:23.056206  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800253540 after lost signal to thread 1646
I20260709 13:00:23.047797  3053 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.037614  3063 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.059489  3063 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:22.996367  3034 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.050244  3020 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.060978  3053 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.060791  3020 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.063087  3031 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.063827  3032 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.065917  3044 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.068195  3063 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.048964  3055 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:23.069981  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.018s	sys 0.011s
W20260709 13:00:23.072012  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.852s	user 0.018s	sys 0.011s
I20260709 13:00:23.072400  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.075501  3034 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.076031  3034 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.037357  3045 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.076887  3045 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.078250  3034 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.055079  3049 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.047959  2999 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:23.087080  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800339c40 after lost signal to thread 1720
I20260709 13:00:23.087793  3046 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.070102  3055 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.026044  3047 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.031963  3054 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.079062  2939 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:23.098042  1568 debug-util.cc:398] Leaking SignalData structure 0x7b0800227380 after lost signal to thread 1721
I20260709 13:00:23.040715  3042 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.098752  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.100791  3049 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.101400  3046 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.088414  3031 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:23.111052  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 66561.1us
I20260709 13:00:23.112417  3039 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.113718  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.111313  3034 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.140316  1617 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:23.039006  3056 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.110343  3030 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.111115  3064 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.143000  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.147372  2265 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:23.140606  3061 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.115278  3037 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.121244  3019 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:23.169802  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.139067  3055 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.139642  3006 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.172808  1618 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:23.177142  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.150220  3058 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.182932  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:23.183188  3044 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.175184  3066 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.183612  1618 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:23.149917  3045 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:23.175473  1568 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd120 after lost signal to thread 2290
I20260709 13:00:23.183429  3068 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.171139  3037 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.190819  3050 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.195968  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.192504  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.197059  1691 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:23.149545  3031 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.181180  3055 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.193825  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.167558  3019 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.177968  3033 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.198539  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.210767  1616 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:23.184022  3060 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.175400  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.183890  3063 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.163775  3030 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.196552  2265 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:23.166458  3034 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.188712  2939 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.183264  3062 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.217949  3076 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.193325  3054 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.183871  3044 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.226807  3073 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.192569  3043 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.184551  3006 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.255501  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.220587  3049 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.212744  3019 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.206452  3058 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.211813  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.246380  2265 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:23.218636  3033 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.221782  3047 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.256296  1696 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:23.233070  1618 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:23.236101  3041 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.222844  3051 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.227540  3020 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.247434  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.179589  3064 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.280668  3049 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.223687  3063 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.223033  3050 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.172425  3056 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.183928  3066 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.212579  3068 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.167096  3039 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.256736  3062 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.408674   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.430408  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.317221  3070 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.397149  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.433226  1696 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:23.433517  3070 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.338858  3071 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.305984  3051 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.300019  3042 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.257980  2939 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.285214  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.332026  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.297401  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.228631  3060 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.463195  3060 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.462514  3055 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.436195  1616 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:23.189117  3061 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:23.471284  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.472136  1617 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:23.316391  3074 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.434980  3063 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.311590  3054 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.429788  3037 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.266641  3073 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.336843  3052 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.258883  3043 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.448899  3069 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.447664  2999 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.299448  3033 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.492175  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.289462  3058 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.455830  3015 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.499533  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:23.500028  3059 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.480340  3055 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:23.502377  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 205039us
I20260709 13:00:23.515276  3075 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.503126  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.258558  3076 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.516655  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.511785  1696 raft_consensus.cc:606] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:23.472896  2939 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.515301  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.497967  3031 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:23.519385  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 237101us
I20260709 13:00:23.317910  3041 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.512281  3053 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:23.495105  3054 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.501701  3069 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.515470  3085 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.522193  3060 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:23.591010  3083 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.521713  3068 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:23.595371  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79570.1us
I20260709 13:00:23.517334  3015 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.582871  3064 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.491291  3071 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.515890  3075 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:23.667791  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.521001  2257 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:23.599447  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.527307  3059 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:23.671537  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 72191.6us
I20260709 13:00:23.672271  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.672864  1622 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:23.601459  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.675149  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.595160  3046 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.646750  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.511739  3074 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.693367  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.685904  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.694095  1544 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:23.634639  3030 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.634272  3048 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.634537  3081 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:23.614899  3020 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.701676  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.688119  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.690184  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.590397  3053 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.669822  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.704391  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.634214  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.647927  3083 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.706245  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.707466  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.693130  3049 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.709401  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.710731  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.711143  3070 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.701122  3051 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.614441  3085 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.781842  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.732450  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.733498  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.736466  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.634200  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.635195  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.595752  3060 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.648082  2230 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:23.792546  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:23.703827  3082 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.708285  3078 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:23.685811  3052 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:23.775044  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.851804  3015 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.852080  3052 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:23.852262  1544 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:23.792356  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:23.777415  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.778901  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.691552  3080 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:00:23.522816  3055 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:23.791105  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.791142  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.791546  3073 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.841377  1545 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:23.840040  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.839709  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.838153  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.851151  3054 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.851583  3038 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:23.780063  3048 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:23.852626  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.999982  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:24.000794  3019 consensus_meta.cc:287] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.004s
I20260709 13:00:24.001631  3019 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.005651  1696 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:23.972909  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.991892  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.002496  3059 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:23.887265  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 94805.2us
I20260709 13:00:23.840698  3058 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.003696  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.944803  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:23.992416  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.023715  1547 raft_consensus.cc:606] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:23.968506  3074 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.963346  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.013525  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.014554  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.015712  1542 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:23.945619  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.998816  3085 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.022284  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.028632  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.028781  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.023958  1694 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:24.032480  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.033356  1687 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:23.790601  3033 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.840116  3060 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.034488  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.035549  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.790228  1613 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:24.032714  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:23.838287  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 229489us
I20260709 13:00:24.013598  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.948051  3084 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:23.842593  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.841034  3043 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:23.840418  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.969944  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.945190  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.853451  2939 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.024375  3052 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.986727  3075 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:23.971248  3053 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.071674  3066 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.074908  3052 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.075472  3044 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.077230  3052 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:23.888413  3071 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.034435  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.049072  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.048863  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:23.946336  3078 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.027349  3082 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.051862  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:24.052476  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.025789  3038 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:23.853374  3061 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.051803  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:23.838686  3083 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.055320  3037 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.038851  1621 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:24.055740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:23.886912  3076 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.057435  1622 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.058465  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.188645  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.191921  1696 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:24.059154  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.192361  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.192704  1687 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:24.192800  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:23.780746  3081 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:24.061271  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.059875  3056 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.065487  1695 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:24.066027  3048 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.090049  1690 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:24.070222  3050 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.118847  3069 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.131142  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.092583  3078 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.125370  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.116237  3038 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.127117  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.206931  1691 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:24.130820  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.184751  3037 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.209517  1538 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:24.210959  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.116052  3006 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.118083  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.115206  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.132798  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.110355  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.136415  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.119320  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.092921  3082 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.180028  2266 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.222086  1541 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:24.180094  3039 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.181288  3054 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.209636  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:24.184484  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 151869us
I20260709 13:00:24.212903  3037 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.193827  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.182091  3019 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.186604  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.202934  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.205559  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.176927  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.208530  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.208621  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:24.256083  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69549.4us
I20260709 13:00:24.117695  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.216526  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.216560  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.219272  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.221261  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.235873  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.209342  3041 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.222064  1547 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:24.181156  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.208659  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.249589  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.250803  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.193676  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.251822  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.255100  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.256978  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.257429  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.263811  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.218252  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.268858  1545 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:24.272137  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:24.273778  1692 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:24.313439  1620 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.275447  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.311648  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.265671  3044 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.279536  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.320351  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.315143  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.331303  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.315872  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.335158  1688 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:24.339414  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.343401  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.269912  3047 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:24.274001  3041 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.273135  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.248602  3054 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:24.352007  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 78944.2us
I20260709 13:00:24.315176  3055 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.273456  3034 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.316414  1538 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.315069  1546 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.349150  1694 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:24.316445  3019 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.316841  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.353994  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.331745  3044 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:24.355731  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.268121  3062 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.357386  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.361685  1538 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.357024  3044 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.362548  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.363169  1546 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.363266  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.363981  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:24.364392  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.355048  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.359809  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.365430  1694 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.368407  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.351363  3041 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.384603  3081 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.385439  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.364637  3039 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.357367  3056 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.387292  3056 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:24.387660  3056 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.384644  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.278692  3079 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:00:24.381916  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.386610  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:24.389441  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.390566  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.391476  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.393942  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.394455  1547 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:24.394908  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.396420  3062 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.400601  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.401136  3062 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.401528  3062 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.401893  3062 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.355542  3047 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:24.405400  3047 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.405951  3047 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:24.407872  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.400663  3091 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.408991  3091 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.408326  3054 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.409323  3091 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.410095  3054 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.389465  3041 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.431941  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.436436  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.413694  1688 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.419284  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.419968  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.420114  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.421641  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.422078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.422580  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.425606  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.426851  2257 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:24.427774  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:24.450908  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56075.6us
I20260709 13:00:24.451083  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.428275  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.452045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.429505  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.453233  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:24.406443  3047 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.456099  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.456499  3039 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:24.456606  3047 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.457679  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:24.457989  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.458338  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.459903  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.460680  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.461416  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.462275  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.462765  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.462910  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.463326  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.464321  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.465420  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.465965  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.466323  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.467198  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.467360  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.467700  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:24.468271  1691 raft_consensus.cc:606] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:24.470327  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.418193  3037 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.419279  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.500087  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.527405  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.500226  3037 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.541338  3044 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.642671  3082 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.645617  3082 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.645298  3078 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.557966  3056 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:24.672434  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.675505  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 191155us
W20260709 13:00:24.676890  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 133052us
W20260709 13:00:24.677625  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 278712us
I20260709 13:00:24.680310  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:24.681299  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.681938  3038 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.682327  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.683262   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:24.687013   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:24.682992  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:24.688247  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.683596  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:24.682657  3038 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.690320  3038 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.646323  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:24.690847  3038 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.648738  3062 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:24.697175  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:24.699307  2231 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.701092  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.703050  1620 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:24.703168  3084 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.703733  3084 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.704195  3084 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.751211  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:24.753026  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52045.1us
I20260709 13:00:24.753682  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.754570  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.756098  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.758889  1617 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:24.776639  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.776690  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.699409  3094 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.748131  3037 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.782048  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:24.791263  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.785287  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.756983  3020 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.795362  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:24.792112  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.792344  3078 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.684814  3041 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:24.755645  3039 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:24.780311  3044 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.774080  3006 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.775849  2939 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:24.797533  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 358541us
I20260709 13:00:24.779433  3043 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.804236  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.804587  3043 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.804916  3056 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.805011  3043 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.798955  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.798880  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.778829  3062 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.757395  3091 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:24.811862  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.813139  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 568) took 1381 ms. Trace:
I20260709 13:00:24.813321  3091 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.799616  3079 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.814237  3079 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:24.814800  3079 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:24.782163  3037 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.801797  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.780174  3094 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:24.801303  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 102944us
I20260709 13:00:24.805912  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.810835  3081 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.813576  2262 rpcz_store.cc:276] 0709 13:00:23.431401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.431568 (+   167us) service_pool.cc:224] Handling call
0709 13:00:24.041747 (+610179us) spinlock_profiling.cc:243] Waited 9.98 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:24.812938 (+771191us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54006a2054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:24.813058 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1118030464}
I20260709 13:00:24.818178  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.830858  2263 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:24.832300  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.832870  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.833761  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.834286  3094 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.834602  3061 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.835095  3066 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.835974  3082 raft_consensus.cc:993] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:24.834666  3081 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:24.862957  3038 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.863796  3081 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.864848  3058 raft_consensus.cc:1081] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Signalling peer c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:00:24.865077  3038 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:24.841427  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.844949  3054 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:24.851464  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.867758  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:24.859486  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.806898  2939 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:24.819437  3037 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.844316  3066 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.865881  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:24.879937  1585 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01e623ba813c4c3a8152a1de588cda91. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:24.868165  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.865298  3081 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.847618  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.846577  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.873858  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.819670  3078 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:24.874926  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.862304  3043 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.877094  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:24.881255  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:24.865856  3034 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.877992  1615 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:24.885198  1618 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:24.869328  3058 raft_consensus.cc:993] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:24.870280  3054 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.874780  2939 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.878214  3066 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:24.892236  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.501s (SENT) [suppressed 3 similar messages]
I20260709 13:00:24.897346  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:24.875288  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 82377.5us
I20260709 13:00:24.878948  3082 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.904032  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:24.934724  3061 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:24.931074  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:24.891875  3020 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:24.931664  3054 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:24.944993  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 65520.8us
I20260709 13:00:24.947173  3099 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:24.943485  3094 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:24.954214  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 75501.9us
I20260709 13:00:24.957715  3061 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:24.952350  3020 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:24.958099  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:24.958736  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:24.959088  3078 raft_consensus.cc:1081] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:24.955217  3099 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.986951  3099 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:24.959990  3041 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:24.955510  3037 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:24.960806  3079 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:24.981566  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92632.2us
I20260709 13:00:25.001494  3043 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:25.001757  3037 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.002593  3079 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:24.979271  2939 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.003449  3097 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:24.981670  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 91726.3us
W20260709 13:00:24.982131  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 114504us
I20260709 13:00:25.004792  3097 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:25.005002  2939 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.005707  3097 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:25.006117  3097 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:25.006942  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:24.983239  3048 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:25.005609  2939 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:25.007771  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:24.983356  3020 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.019447  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:25.019976  1692 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:25.021665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.007490  3039 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.023831  3034 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.024154  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.024255  3034 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:25.024945  3095 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.025336  3034 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.026515  3034 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.016829  1585 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.025671  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.029558  3100 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:25.029950  3100 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:25.031428  2263 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.031677  2262 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.032157  2257 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.032462  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:25.032665  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:25.030772  3100 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.034257  3100 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.034673  3043 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.035575  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:25.038805  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 99624.6us
I20260709 13:00:25.040560  1442 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:25.043901  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.010744  2939 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:25.044414  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:25.045369  2939 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.009716  3084 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.050864  3093 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:25.052726  3084 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.052829  3062 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.053241  3062 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:25.041643  3089 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:00:25.049153  3039 consensus_queue.cc:1175] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2080b3bca2e64a1a953c17b506b668d2" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:00:25.049304  3041 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:25.049827  3094 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.049140  3044 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:25.043383  3095 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.034279  2257 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.058265  3041 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:25.055668  3062 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.060274  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.063968  3066 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.057055  3056 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.065712  3044 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.070297  3093 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:00:25.073081  3044 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:25.073700  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 181999us
I20260709 13:00:25.074879  3043 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.077193  3093 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.029980  3103 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:25.076509  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 68837.2us
I20260709 13:00:25.053668  3054 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.084348  3054 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.079246  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.069723  3079 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:25.092106  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 84435us
I20260709 13:00:25.078410  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.080730  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.067376  3041 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:25.081147  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 234631us
I20260709 13:00:25.082360  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.074021  3044 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.109791  3066 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.109943  2939 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.109839  3044 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.091331  3079 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:25.111371  3079 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.113207  3062 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.097007  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.114794  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.118537  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.119496  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.119699  1613 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:25.060398  3097 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.101297  3102 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.080416  3093 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:25.107203  3041 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.118472  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.118299  3096 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.097723  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.126250  2257 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.126401  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.127745  3093 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.128252  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.129264  3093 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.129426  3096 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.073097  3099 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:25.134541  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.135004  3081 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.135530  3109 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.122685  3066 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:25.145160  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64507.6us
I20260709 13:00:25.145879  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.144495  3109 raft_consensus.cc:993] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:25.139008  3103 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.146813  3109 raft_consensus.cc:1081] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:00:25.147012  3103 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:25.147089  1511 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.147521  3103 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.147861  3061 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.143244  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.148278  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.149464  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.149995  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.147619  3020 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.152798  3054 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.166496  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.138437  3111 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.140128  3041 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.137063  3056 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:25.141893  3097 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.151707  3108 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.156011  3006 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:25.148867  3066 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:25.160728  3082 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.161805  3099 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.163856  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.153607  3048 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.180208  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.168805  2259 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.178145  3056 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.170027  3020 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.171025  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.180222  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.184660  1511 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.184113  3081 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.185568  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.167929  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.185746  3054 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.185825  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.186373  3096 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.182468  3111 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.186815  3096 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:25.187026  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:38818
I20260709 13:00:25.187245  3096 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.187685  1613 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:25.185197  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.188740  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.177569  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.189766  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.191061  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.191462  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:25.192795  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.193147  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.193953  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:25.194528  1619 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.194428  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:25.193147  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.196538  1694 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:25.199054  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:25.179519  3034 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.142040  3079 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.219790  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.220296  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.179167  3066 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.220902  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.200896  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.221959  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.222278  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.199780  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:25.182348  3056 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:25.200484  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.196846  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.197335  1687 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.179378  3109 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:00:25.200871  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.198074  3043 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.198288  3048 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:25.234057  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56537.9us
I20260709 13:00:25.219359  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.186971  3111 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.179770  3044 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.186251  3054 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:25.223285  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.188082  1613 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.184903  1620 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:25.235952  3111 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.231350  3099 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.232810  3082 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.227547  3104 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:25.236271  3114 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:25.236944  3056 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.227442  3078 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.227299  3058 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.240315  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.244431  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.246105  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.227670  3101 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.246768  3054 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.239485  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:25.248874  3102 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.253269  3058 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.253371  1694 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.239516  3044 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:25.240072  3079 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.254135  3056 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.255065  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.255646  3078 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.248461  3109 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.256500  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.259683  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.269167  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.256477  3061 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:25.250325  3104 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.265990  3044 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.286011  3099 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.262362  3058 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.263069  3081 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.252379  3110 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.283079  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.302798  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.308284  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.309172  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.281980  3104 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.313673  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.314262  3100 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.314889  3102 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.314914  3100 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.315899  3101 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:25.315985  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60997.2us
W20260709 13:00:25.315024  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55410.6us
I20260709 13:00:25.316680  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.317752  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.319638  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:25.319137  3061 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.320746  3114 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.312783  3099 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.328272  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.328097  3044 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.337991  3109 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.309947  3078 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.339988  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:25.339766  3044 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.288921  3105 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.313494  3082 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:25.354419  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.354470  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:25.353801  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 95562.3us
I20260709 13:00:25.355379  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.282969  3103 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.357156  1511 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.359043  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.362689  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.359090  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.359926  3096 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.363752  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:25.344265  3118 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:00:25.374354  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.375447  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.376015  3044 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.376865  3044 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.377579  3044 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.366829  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.379712  3121 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:25.380388  3121 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.385594  3121 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:25.371188  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:25.390590  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.392496  3127 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.392851  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:25.340801  3079 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:25.395015  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 172804us
I20260709 13:00:25.395961  1542 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:25.411571  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.412534  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.343660  3109 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:25.409117  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:25.355865  3105 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.365324  3081 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.441118  2231 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:25.442116  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44774.6us
I20260709 13:00:25.361644  3082 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.371727  3091 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.445302  1622 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:25.395170  3034 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.447862  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:25.460168  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 69699.7us
I20260709 13:00:25.417708  3109 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.462033  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51302
I20260709 13:00:25.439740  3094 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.463011  1688 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:25.463181  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.466221  1688 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:25.445978  3105 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.455035  3082 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:25.447932  3095 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.446151  3043 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.461969  3020 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.446578  3081 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:25.414546  3121 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:00:25.451591  3106 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:25.463555  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.470466  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:25.360555  3120 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:00:25.475629  3114 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:25.476931  3081 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.479117  3122 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:25.508462  3106 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:25.514758  1695 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:25.537834  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 71806.6us
W20260709 13:00:25.557468  3119 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:00:25.568929  1619 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:25.570142  3050 raft_consensus.cc:2764] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:25.551530  3108 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:25.563521  3096 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.589119  3103 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:25.589133  3084 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:25.593442  3084 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.574193  3108 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:25.615545  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 152439us
I20260709 13:00:25.616600  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:25.618146  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:25.574461  3106 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.621335  3102 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.622442  3114 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:25.668349  2264 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:25.644512  3102 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:25.682008  1613 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.688799  3102 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.703112  1617 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:25.701632  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 153031us
W20260709 13:00:25.713680  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 265886us
I20260709 13:00:25.645483  3108 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.720695  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:25.728183  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.701473  3082 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.800001  3082 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.742430  3047 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:00:25.804611  3066 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
W20260709 13:00:25.815685  3056 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
W20260709 13:00:25.810438  3054 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.543s	user 0.006s	sys 0.003s
I20260709 13:00:25.742808  3084 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.825662  3104 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.826649  3108 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:25.828969  3058 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.003s
W20260709 13:00:25.836051  3111 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.573s	user 0.007s	sys 0.003s
I20260709 13:00:25.850795  3058 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.853856  3058 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.844249  3054 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.859823  3054 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:25.854529  3111 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.818584  3066 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:25.741933  3105 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.866220  3066 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:25.657064  3114 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:25.890993  3114 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.907447  3109 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.910471  3109 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:25.943058  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.946943  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:25.949867  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:25.952539  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.963562  1540 consensus_meta.cc:287] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.010s
I20260709 13:00:25.964330  1540 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:25.972124  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:25.975638  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:25.972506  1613 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:25.985231  1688 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:00:25.986804  1689 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.986317  1688 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.988700  1694 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:25.988802  1692 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:25.991466  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:25.993795  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:25.994823  1542 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:25.995421  1542 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:25.997833  1688 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.999146  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.000330  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:25.841606  3102 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.024964  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.045615  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.047096  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.048766  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.049986  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.051120  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.052554  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:26.052736  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52842.6us
I20260709 13:00:26.053122  3038 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.053716  3038 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:26.054183  3079 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.054580  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 585) took 1023 ms. Trace:
I20260709 13:00:26.055083  2264 rpcz_store.cc:276] 0709 13:00:25.030583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.032432 (+  1849us) service_pool.cc:224] Handling call
0709 13:00:26.054078 (+1021646us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54006aead4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:26.054284 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1359599872}
I20260709 13:00:26.026943  3111 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:26.059281  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.060442  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.055377  3038 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.027153  3082 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:26.067500  3082 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.068980  3082 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:25.915328  3114 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.032866  3043 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:26.073230  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.034235  3047 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.036819  3104 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:26.039546  3081 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.004s
I20260709 13:00:26.039682  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.040905  3061 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.040999  3127 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.042061  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.024928  3105 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:25.969660   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.072863  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.075623  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.084856  1545 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:26.080579  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.080953  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.095137  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.095254  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.092392  3056 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.097811  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.096295  3095 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.099020  3081 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.104007  1613 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.102562  3095 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.111884  3095 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.113142  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 197) took 1089 ms. Trace:
I20260709 13:00:26.106093  1545 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:26.114998  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.099080  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.105046  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:26.119961  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.010s	sys 0.014s
I20260709 13:00:26.117512  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:26.122889  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.014s
I20260709 13:00:26.117141  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:26.126447  3138 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.128194  3138 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:00:26.124503  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.056s	sys 0.099s
I20260709 13:00:26.133072  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:26.136076  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.057s	sys 0.099s
W20260709 13:00:26.135147  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.009s	sys 0.039s
I20260709 13:00:26.132737  1542 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.129980  3138 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:26.141237  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 700187us
W20260709 13:00:26.141383  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68376.5us
I20260709 13:00:26.143432  3056 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:26.144002  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.145108  3056 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.145277  3094 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.145562  3056 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.147169  3114 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:26.148651  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.039s
I20260709 13:00:26.135430  3095 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:26.129686  3089 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.047s	sys 0.099s
I20260709 13:00:26.145673  3102 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:26.160423  1542 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.167191  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.168049  2259 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.146960  3056 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.174764  1547 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:26.149947  3081 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:26.175567  1615 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.181588  1617 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.190096  3056 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.189862  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.192759  1617 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:26.195407  1620 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.198194  3141 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.199389  3043 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:26.199831  3141 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:26.200876  3043 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.201249  3141 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:26.201864  3141 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.202976  3136 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.203421  1688 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.203410  3136 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.204404  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.201313  3043 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.205222  1689 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.205075  3136 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.205801  3043 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.207432  1694 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.207659  3043 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:26.212278  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.212827  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.212956  1616 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.213739  3047 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:26.203199  3138 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.214442  3047 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.215118  3138 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.224747  3047 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.227288  3141 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.230465  3141 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.232196  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.234651  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.235030  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:26.241912  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 98131.7us
I20260709 13:00:26.113641  1442 rpcz_store.cc:276] 0709 13:00:25.023155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.023301 (+   146us) service_pool.cc:224] Handling call
0709 13:00:26.112919 (+1089618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:25.179496 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:25.186860 (+  7364us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:25.186891 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:00:25.186910 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:25.187246 (+   336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:25.187295 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:25.187324 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:25.187503 (+   179us) tablet.cc:701] Row locks acquired
0709 13:00:25.187523 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:25.187679 (+   156us) write_op.cc:270] Start()
0709 13:00:25.187788 (+   109us) write_op.cc:276] Timestamp: P: 1783602025187622 usec, L: 0
0709 13:00:25.187810 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:25.223531 (+ 35721us) log.cc:844] Serialized 536 byte log entry
0709 13:00:25.478361 (+254830us) op_driver.cc:464] REPLICATION: finished
0709 13:00:25.682981 (+204620us) write_op.cc:301] APPLY: starting
0709 13:00:25.683079 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:25.683177 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:25.692268 (+  9091us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:25.712441 (+ 20173us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:25.742406 (+ 29965us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:25.764373 (+ 21967us) write_op.cc:312] APPLY: finished
0709 13:00:25.786678 (+ 22305us) log.cc:844] Serialized 23 byte log entry
0709 13:00:25.786879 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:25.786962 (+    83us) write_op.cc:454] Released schema lock
0709 13:00:25.786999 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:25.787334 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:25.787363 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":185040,"apply.run_cpu_time_us":2457,"apply.run_wall_time_us":107955,"num_ops":1,"prepare.queue_time_us":90014,"prepare.run_cpu_time_us":18225,"prepare.run_wall_time_us":114966,"raft.queue_time_us":95095,"raft.run_cpu_time_us":25393,"raft.run_wall_time_us":116334,"replication_time_us":290392,"thread_start_us":236305,"threads_started":4,"wal-append.queue_time_us":61310}]]}
W20260709 13:00:26.178021  3089 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.048s	sys 0.100s
I20260709 13:00:26.246083  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.247038  3094 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.248787  3037 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:26.246979  1616 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.252698  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:26.253438  3137 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.253996  3137 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:26.261040  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.261299  3135 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:26.262173  3135 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.262828  3137 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.265163  3137 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.265290  3132 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.266255  3135 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.269877  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:26.272650  3037 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.272799  3136 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.273283  3037 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:26.273162  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.272809  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.274428  3037 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.275084  2257 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:26.277318  1616 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:26.278282  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.278725  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.279330  1613 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:26.279959  3135 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.280942  3132 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:26.281919  3132 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:26.282231  3132 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.283213  3132 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.284435  3132 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.283213  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:26.271607  1689 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:26.291108  3105 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:26.291689  3105 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.292749  3105 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.297533  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.293547  3135 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.301846  1545 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:26.302254  1547 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.302728  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.304198  1542 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.304862  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.305480  1538 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.308511  1689 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.316627  1538 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:26.312233  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.327955  3102 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:26.331513  3102 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.331987  3102 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.336408  1694 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.336308  3127 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.337555  3114 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.338191  3114 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.339478  3114 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.341286  3114 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.342818  2259 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:26.337673  3102 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.344374  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.345290  3127 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.345690  3043 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.345889  3141 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.345762  3127 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.346668  3141 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.345772  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.347365  3102 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.347366  3127 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.348996  3141 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.349956  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.350587  3043 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.353559  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:26.355500  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:26.356371  1694 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 2: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:26.356771  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.357697  3136 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.357702  3047 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.358379  3136 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.359088  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.359467  3136 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.360549  3056 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.360616  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.365470  3081 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.367245  3141 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.383666  1443 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:26.387646  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52311.7us
W20260709 13:00:26.388703  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.397212  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.399427  3135 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.398523  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:26.403718  3127 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.405015  3081 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:26.406843  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.407053  3114 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.407384  3081 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.407711  3135 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.407948  3056 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.408027  3081 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.408371  3056 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:26.408828  3056 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.409030  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.409507  3081 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:26.410826  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.412187  3081 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.416359  3114 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.418738  3037 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:26.418843  3114 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.419800  3137 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:26.420194  3137 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:26.421116  3137 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.422828  3137 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.422915  3038 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:26.424170  3037 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.424515  3037 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:26.425836  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.425658  3037 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.431160  3136 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.420217  3114 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.431869  3136 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.434201  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.416788  3135 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.443521  3037 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:26.444113  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45703.2us
I20260709 13:00:26.455346  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.455410  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.455756  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.456123  1546 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.456328  2262 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:26.456462  1546 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.456822  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.457129  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:26.448221  1538 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.448599  1539 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.450191  1542 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.446233  1692 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:26.451282  3056 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.451671  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.452067  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.452620  3137 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.452950  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.457224  3141 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.450737  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.459461  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.457371  1546 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.459717  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.460786  3095 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.460969  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.469372  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.470202  2263 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:26.461243  2262 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.470566  1546 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.464008  1540 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.471150  3095 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:26.470822  1539 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.471570  3095 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.476516  1692 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:26.480057  1546 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:26.486567  3141 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:00:26.487589  3106 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.487850  3047 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.488202  3047 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.488157  3106 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.489380  3136 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.489194  3047 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.490515  3047 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.490350  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.495702  1613 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.496289  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.496826  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:26.497458  1614 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:26.498792  3089 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.499655  3137 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.500379  2257 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:26.501279  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.501533  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.482831  1442 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.490342  3106 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:26.504230  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.457911  3102 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:26.505187  1539 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:26.504894  2262 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:26.505901  1442 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.507486  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.507663  1546 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:26.500896  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.512010  3106 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.512392  3106 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.512732  3106 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.513392  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.514600  2261 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:26.516582  1442 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.518740  1585 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.520313  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.513018  3095 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.521867  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.522877  3141 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:26.513559  3136 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.523630  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.526966  1689 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.527343  1689 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.529453  3043 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:26.530752  3043 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.531288  3043 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.536394  3127 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.536871  3127 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.537802  3127 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.526955  3141 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.539592  3141 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.542524  1616 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.544380  3155 ts_tablet_manager.cc:933] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:26.545837  1689 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:26.548164  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.558701  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.548466  3056 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:26.565558  1689 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.567224  3135 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.546502  3061 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:00:26.573218  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.556577  3138 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.579880  3138 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.580972  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.582091  3081 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.583596  3138 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.583662  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.586179  1512 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.571888  3127 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.590778  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.591230  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:26.596035  1617 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.593338  3102 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.597764  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.593974  3056 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:26.592054  2257 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:26.607757  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.599735  1620 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:26.600211  3061 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.601068  3132 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.612432  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:26.612504  1689 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:26.602188  3056 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:26.597000  3138 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:00:26.613019  3095 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:26.620962  3056 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.626672  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:26.621203  3111 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.635740  3135 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.640254  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:26.641280  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.634490  3091 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:26.641747  1614 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:26.641876  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.631548  3111 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.645906  1546 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:26.647114  1542 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.642535  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.648803  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:26.649454  1687 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:26.660604  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.661024  1620 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:26.646591  3111 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.645331  3138 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.662704  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.663415   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.667187  3108 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.667002  3094 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.655992  3095 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:00:26.676946  3138 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.677727  1542 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.679061  3082 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.684132  3082 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.684943  3125 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:00:26.681926  3104 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.686133  3105 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:26.683461  3106 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.686595  3104 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.691313  3104 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.691437  3140 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.692358  3104 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.677870  3108 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:26.694592  3108 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.696051  3108 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.683475  3138 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:26.687315  3157 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:26.682390  3095 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.685310  3082 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.693576  3104 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.716938  3095 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:26.721446  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 89053.3us
I20260709 13:00:26.704259  3043 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:26.725790  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65556.3us
I20260709 13:00:26.717219  3155 tablet_copy_client.cc:323] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:00:26.740571  3141 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.725980  3125 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:26.679680  3163 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:26.761176  3162 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.751309  3082 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.753298  3106 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:26.732223  3091 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.760008  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.760226  3089 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.771224  3043 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.726713  3095 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.757221  3125 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:26.776909  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.776824  3125 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.778672  3125 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.779377  1542 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.770349  1692 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.781502  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.783429  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.784154  1546 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.788856  1617 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:26.791494  3167 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:26.791862  3100 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:26.792096  3167 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.793593  3091 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.799553  3105 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.799973  3105 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.802577  3105 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.803009  3106 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.803617  3106 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.805677  3106 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:26.807368  3141 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.807017  3111 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.807058  3095 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:26.809926  1689 raft_consensus.cc:2368] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:26.810375  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:26.810989  1613 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.789536  3056 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.815623  1616 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.816720  3056 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.817870  3111 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.819566  1613 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:26.820355  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.828783  1616 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:26.835071  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:26.839593  3135 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:26.836421  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45759.8us
I20260709 13:00:26.841279  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:26.840651  1538 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.845542  1587 leader_election.cc:400] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:26.835124  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 74408.9us
I20260709 13:00:26.841508  1542 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.846153  1587 leader_election.cc:403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:26.866864  3164 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:00:26.903806  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 58480.9us
I20260709 13:00:26.905880  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.846306  1546 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:26.830560  3167 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:26.847811  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:26.861423  3166 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:26.908296  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:26.848160  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:26.831100  2257 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.896761  1692 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:26.834225  3138 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.897244  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.913825  2262 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.913898  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.846535  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.861568  3168 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.831758  3111 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:00:26.900246  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:26.900818  3135 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:26.901131  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:26.901306  3089 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.899585  1694 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:26.908190  2261 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.907737  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:26.898921  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 01e623ba813c4c3a8152a1de588cda91 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:00:26.914580  1538 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.918901  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:26.909955  3136 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:26.921363  3169 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.154s	user 0.004s	sys 0.002s
I20260709 13:00:26.909942  3095 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.903566  3047 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.922713  3168 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:26.960034  3168 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:26.962100  2257 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:26.927263  2263 raft_consensus.cc:2368] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:26.935647  2262 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:26.936105  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.936991  3094 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:26.934792  2231 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.950505  1541 raft_consensus.cc:2368] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:26.937804  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 01e623ba813c4c3a8152a1de588cda91 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-01e623ba813c4c3a8152a1de588cda91
I20260709 13:00:26.955835  3047 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:26.970647  1585 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.969640  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:26.963991  3095 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:26.938051  3167 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:26.975473  1585 leader_election.cc:400] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
W20260709 13:00:26.986100  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139653us
I20260709 13:00:26.988453  1585 leader_election.cc:403] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:26.988955  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:26.989645  1587 leader_election.cc:400] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:26.973498  3037 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:26.976783  3162 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:26.987387  3043 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:26.993111  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 91421.1us
I20260709 13:00:26.994694  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:26.985581  3137 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.996757  1538 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:26.993083  3037 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.006994  3037 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:26.994549  3056 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:26.983681  3106 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:00:27.002446  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:26.990317  3163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:47466 (request call id 15) took 3714 ms. Trace:
I20260709 13:00:27.010882  1694 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:26.991394  1613 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:27.009529  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:27.000613  3043 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:27.011068  3163 rpcz_store.cc:276] 0709 13:00:23.252044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.254472 (+  2428us) service_pool.cc:224] Handling call
0709 13:00:24.084829 (+830357us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b4c00439480. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f18ba6a20 00007f7f18bb7a29 00007f7f18b7d644 00007f7f18ba4f2d 00007f7f18ba4b93 00007f7f1a8331af 00007f7f1a832f3e 00007f7f1a8b8888 00007f7f1a8d575c 00007f7f1a8d676a 00007f7f1a8d591b
0709 13:00:24.086040 (+  1211us) log.cc:844] Serialized 506 byte log entry
0709 13:00:24.424427 (+338387us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b54002cd920. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a853142 00007f7f1a833eaa 00007f7f1a83ad53 00007f7f1a83acd9 00007f7f1a83ac69 00007f7f1a83ac31 00007f7f1a839dfd 000000000038f354 000000000038f199 00007f7f177ed475
0709 13:00:26.940028 (+2515601us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34,"raft.queue_time_us":15663,"raft.run_cpu_time_us":18117,"raft.run_wall_time_us":291067,"spinlock_wait_cycles":27627008,"thread_start_us":100031,"threads_started":1,"wal-append.queue_time_us":131173,"wal-append.run_cpu_time_us":1880,"wal-append.run_wall_time_us":1061915}
I20260709 13:00:27.014096  3047 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.007699  1692 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:27.018781  3179 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:27.009769  3162 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.028216  3043 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.010191  3135 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.029687  3081 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:27.035408  3081 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.034552  3104 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:27.040066  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 68412.6us
I20260709 13:00:27.040750  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:27.041677  1613 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:27.042102  2263 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.042299  3105 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.043030  2261 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:27.046097  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:27.072474  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 63034.4us
I20260709 13:00:27.073604  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:27.078222  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 88930.4us
I20260709 13:00:27.082469  1694 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:27.051322  3081 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.090638  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:27.097108  3176 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.071154  3141 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.098495  3141 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:27.100664  1689 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.102289  1694 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:27.104259  1541 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:27.085110  3160 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:00:27.104653  1541 pending_rounds.cc:85] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 2
I20260709 13:00:27.086588  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.095254  3179 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:27.109436  1541 pending_rounds.cc:107] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:27.132776  1541 raft_consensus.cc:2889] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:27.115346  2257 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:27.122757  3140 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:27.109319  3114 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.095999  3104 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:00:27.083601  3137 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:27.134788  3140 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:27.148114  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 161717us
I20260709 13:00:27.153805  3104 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:27.155164  3037 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:27.158046  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 544a0a0b5c034de2956e73d089c51085: Illegal state: Replica 2080b3bca2e64a1a953c17b506b668d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:27.142897  3114 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.180076  1632 tablet_copy_source_session.cc:215] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:27.180930  3037 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:27.181178  3170 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:27.181600  3170 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:27.182401  3170 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.183777  3170 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.184736  3114 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.188767  3155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e623ba813c4c3a8152a1de588cda91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:27.102877  3141 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.192281  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:27.192945  1614 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.200985  1692 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.194341  1442 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 3, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.174880  3104 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:27.210860  3176 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:27.223265  3137 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.225194  3162 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.225813  3162 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.228036  3162 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.228518  3179 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.229023  3179 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.229467  3138 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:27.230067  3138 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.231175  3179 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.232010  3138 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:27.211066  3167 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:00:27.239409  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:27.239259  3104 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.243041  3176 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.243599  2262 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:27.241072  1617 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
W20260709 13:00:27.247962  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 109466us
I20260709 13:00:27.251827  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.252578  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:27.252949  2262 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:27.253176  1542 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:27.252066  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:27.255539  1539 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:27.257045  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:27.259577  3114 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:27.261123  3114 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:27.261583  3114 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.256855  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:27.268242  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:27.268440  1540 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.268797  1694 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.269423  3141 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.269807  3141 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.270303  3141 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.269774  3140 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.247552  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:27.285416  1613 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:00:27.286734  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 5c6369221c274c789a9f8654d6ee9417: Illegal state: Replica 9fbc4df0bb934bba941cfa20c0afead2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:27.287330  1614 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:27.268859  3111 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.289323  3111 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.289700  3111 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.274008  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.293215  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:27.274734  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.275130  3081 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:27.282732  1694 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:27.284226  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.284732  3140 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.310170  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:27.311132  1544 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:27.312160  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:27.312369  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:27.312928  1545 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:27.313408  1544 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:27.291246  3167 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:00:27.320465  1541 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.299695  3095 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.313980  3141 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.338572  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:27.339473  3179 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:27.321714  2261 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:27.315363  3114 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.351377  1614 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:27.320464  3108 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:27.327008  3192 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:27.358891  3189 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.346339  3135 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.328656  3095 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.341190  3170 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:00:27.395018  3192 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.397925  3192 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.399082  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.399820  2261 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:27.404422  3114 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.408090  3141 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.409879  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:27.410569  1542 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.412330  1659 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:27.412856  1510 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:27.407995  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:27.409770  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:27.424923  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:27.370656  3135 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:27.387986  3189 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:27.431723  3061 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.434201  1543 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.421240  1542 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:27.445094  1689 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.428525  3135 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.447582  2261 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:27.430449  3108 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.434201  3061 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:27.432570  3170 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:00:27.446182  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:27.493516  3189 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.487547  3108 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:27.515100  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 199929us
I20260709 13:00:27.496531  3061 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.510738  3108 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.490201  3141 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:00:27.526481  1614 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:27.535627  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:27.542685  1694 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:27.558287  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:27.558714  1694 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:27.536847  3082 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:27.564476  3056 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:27.583246  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:27.590719  1511 leader_election.cc:400] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:27.591254  1511 leader_election.cc:403] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:00:27.594310  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68602.3us
W20260709 13:00:27.586004  3193 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:27.567974  3125 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:00:27.608170  2261 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:27.585870  3056 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.611608  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:27.591686  3167 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:27.591674  3095 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.614507  2262 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:27.618784  3205 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:27.620697  3197 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:27.592252  3160 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:27.634181  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:27.615387  3056 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.657793  1689 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:27.628036  3167 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:27.631403  3104 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:27.673100  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 82611.7us
I20260709 13:00:27.681892  2263 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:27.651924  3176 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:27.692945  3211 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:27.714604  3182 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.715413  3182 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.719484  3182 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:27.720039  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:27.720701  1688 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:27.721906  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:27.686841  3137 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:27.744916  3182 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:27.747112  3182 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.747506  3182 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:27.751648  3204 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:27.754509  3206 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:27.754913  3206 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:27.754797  3182 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.755952  3198 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:27.755796  3206 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.756469  3198 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.756960  3206 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:27.756979  3182 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:27.693259  3106 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.755148  3202 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:27.813356  3111 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.005s
I20260709 13:00:27.805382  3167 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:27.803663  3208 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:27.801594  3198 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:27.807338  3137 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.854532  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:27.869577  1616 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:27.860985  1615 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:27.867849  3205 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.867875  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:27.875715  1691 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:27.858307  3140 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.002s
I20260709 13:00:27.874775  3207 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:27.871654  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:27.846465  3038 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.897212  3210 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:27.863423  3211 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.903172  3211 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.848589  3106 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.914345  3038 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.862700  3111 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.901522  3160 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.875350  3108 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.958925  3160 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:27.975611  3160 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.989483  1538 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:27.920115  3198 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:27.992888  3038 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:27.993585  3038 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:27.948596  3140 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:27.997292  3138 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:28.033135  3138 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.035903  3138 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:27.997802  3170 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:28.036799  3170 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.052073  3211 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.057986  3111 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.060469  1688 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:27.933709  3210 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.063721  3210 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.068056  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:28.068812  1620 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:27.922994  3205 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.075635  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.077350  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:27.997295  3043 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:28.001710  3160 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.076594  1615 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:28.078054  1543 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:28.077148  3125 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.003509  3082 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:27.942966  3207 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.098171  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.101965  1691 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:28.117955  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.100s	sys 0.195s
W20260709 13:00:28.121657  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.101s	sys 0.195s
I20260709 13:00:28.128253  3037 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.128994  3037 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.131603  3037 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:28.135769  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.028s	sys 0.045s
W20260709 13:00:28.136158  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.028s	sys 0.045s
I20260709 13:00:28.137385  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:28.138160  1688 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:28.139279  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:28.140323  1695 raft_consensus.cc:2368] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3.
I20260709 13:00:28.144402  1546 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:28.003850  3140 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:27.929253  3202 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:28.184721  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.028s	sys 0.048s
I20260709 13:00:28.166764  3137 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.167246  3179 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.998165  3198 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.081514  3168 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.172010  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:28.143556  3155 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
W20260709 13:00:28.185124  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.028s	sys 0.048s
I20260709 13:00:28.087878  3127 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:28.150986  3081 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:28.016566  3061 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.208611  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.210420  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.220103  1615 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:00:28.226276  3118 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.002s	sys 0.016s
W20260709 13:00:28.226783  3118 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.002s	sys 0.017s
I20260709 13:00:28.201678  3037 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:28.112948  3160 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.143767  3125 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.145810  3043 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.192991  3198 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.146229  3082 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:28.221012  3135 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.727s	user 0.011s	sys 0.001s
I20260709 13:00:28.217268  3081 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.236151  3210 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.214418  3227 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.195734  3179 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.246054  3218 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.199623  3168 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:28.247406  3056 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.000s
I20260709 13:00:28.248385  3108 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.248973  3061 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.238740  3170 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.254354  1620 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
W20260709 13:00:28.259063  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.065s	sys 0.124s
I20260709 13:00:28.246299  3082 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.247085  3081 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.218752  3127 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.236258  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:28.283424  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47299.8us
I20260709 13:00:28.284444  2231 leader_election.cc:400] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3.
I20260709 13:00:28.284762  2231 leader_election.cc:403] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:28.266120  3141 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.021s	sys 0.043s
I20260709 13:00:28.261742  3160 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.240442  3037 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:28.265738  3205 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.264245  3106 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:28.267782  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.066s	sys 0.124s
I20260709 13:00:28.251122  3135 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:28.289626  3141 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.021s	sys 0.043s
I20260709 13:00:28.302249  1691 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:28.260303  3210 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.304345  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.307288  1620 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:28.305708  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.308372  1617 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:28.289456  3182 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:28.290040  3061 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:28.262737  3227 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.267040  3056 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.295001  3137 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.313763  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.296481  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:28.231262  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 131466us
I20260709 13:00:28.297412  3155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42592 (request call id 594) took 1836 ms. Trace:
I20260709 13:00:28.264737  3218 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.277555  3217 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:28.312269  3182 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.309566  3167 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:28.358325  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44691.1us
I20260709 13:00:28.318344  3178 raft_consensus.cc:476] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:28.362074  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.364369  1539 raft_consensus.cc:2368] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:28.306412  3082 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:00:28.363056  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.327225  3205 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.365422  1620 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:28.367357  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.334976  3206 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.366768  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.332196  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:28.369596  1542 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:28.370246  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.525131  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.526652  1542 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:28.529045  3161 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:28.519831  3127 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.539242  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:28.540098  1538 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.427007  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.442461  1539 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:28.443020  3178 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.366261  3108 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.499730  3228 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:28.444579  3205 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.446666  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:28.546377  1541 raft_consensus.cc:606] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:28.503655  3227 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.546878  1541 raft_consensus.cc:614] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:28.365644  3202 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.427878  3231 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:28.431097  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:28.490538  3104 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.812s	user 0.012s	sys 0.000s
I20260709 13:00:28.439527  3206 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.434194  3235 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.502889  3222 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:00:28.430143  3204 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:00:28.358492  3061 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:28.599917  3237 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:28.601578  3061 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.358230  3179 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.602747  3160 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:28.603255  3160 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.605165  3160 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.364926  3167 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.605901  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.430737  2261 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:28.606752  1613 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:28.432214  2259 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:28.370972  3140 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.607652  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.364235  3037 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.608412  1620 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:28.609802  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.491781  3043 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.610569  1617 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:28.521306  3239 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:00:28.492013  3207 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.336704  3155 rpcz_store.cc:276] 0709 13:00:26.453598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.453868 (+   270us) service_pool.cc:224] Handling call
0709 13:00:26.544748 (+ 90880us) ts_tablet_manager.cc:934] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
0709 13:00:27.187281 (+642533us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:27.353922 (+166641us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:27.357929 (+  4007us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:28.218331 (+860402us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:28.240666 (+ 22335us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:28.282993 (+ 42327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:28.289668 (+  6675us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":69581,"tablet-copy.queue_time_us":89757,"thread_start_us":114975,"threads_started":2}
I20260709 13:00:28.622570  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:28.623124  3155 tablet_copy_client.cc:806] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:28.520792  3135 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.360656  3182 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:28.532763  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.624342  3205 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.624660  1542 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:28.625923  1542 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:28.626359  1613 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:28.629608  3201 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.061s	user 0.007s	sys 0.000s
I20260709 13:00:28.544859  1545 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:28.631434  3226 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.543553  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:28.632107  3226 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.633019  1539 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:28.581423  1538 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:28.533944  3056 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.542990  3210 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.545297  3192 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.593915  3230 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.544421  3125 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.598349  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:28.519110  3216 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.263s	user 0.001s	sys 0.001s
I20260709 13:00:28.614444  3168 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.611980  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:28.614639  3233 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:28.617345  1620 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:28.618773  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.620108  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.575002  3108 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.587945  3111 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.621352  3235 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.623719  1614 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:28.639894  3127 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.442911  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 140035us
I20260709 13:00:28.667737  1546 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:28.628526  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.593007  3202 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:28.631055  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1857) took 1386 ms. Trace:
I20260709 13:00:28.637915  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1863) took 1045 ms. Trace:
I20260709 13:00:28.643127  1617 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:28.642351  1615 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:28.679345  2264 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:28.682650  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54211.1us
I20260709 13:00:28.623775  3155 tablet_copy_client.cc:670] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:28.695274  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.690979  1694 rpcz_store.cc:276] 0709 13:00:27.592743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.593484 (+   741us) service_pool.cc:224] Handling call
0709 13:00:27.593901 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.611007 (+ 17106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.611039 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.611436 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.123822 (+512386us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:28.123862 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.123935 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.637664 (+513729us) raft_consensus.cc:1685] finished
0709 13:00:28.637702 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.637853 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6859,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9598,"thread_start_us":464019,"threads_started":1,"wal-append.queue_time_us":568542}
I20260709 13:00:28.590574  3231 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.680969  3127 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.689601  1692 rpcz_store.cc:276] 0709 13:00:27.244132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.248221 (+  4089us) service_pool.cc:224] Handling call
0709 13:00:27.248560 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:27.250094 (+  1534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:27.250309 (+   215us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.259243 (+  8934us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.489301 (+230058us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:27.489349 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.489443 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.626919 (+1137476us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:28.630692 (+  3773us) raft_consensus.cc:1685] finished
0709 13:00:28.630726 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.630963 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1106,"raft.queue_time_us":2011,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":17618,"spinlock_wait_cycles":5527808,"thread_start_us":191319,"threads_started":1,"wal-append.queue_time_us":222374}
I20260709 13:00:28.702952  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:28.709403  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:28.711876  2262 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.709281  3168 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.635867  3192 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.718466  3168 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.720773  3192 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.637578  3135 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.721647  3135 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.721712  3168 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.724171  3135 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.724857  2262 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
W20260709 13:00:28.726281  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 394890us
I20260709 13:00:28.642978  3167 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.668093  3140 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.642429  3188 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.747319  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:28.634606  3226 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.652972  3108 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.777843  1510 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:28.643806  3218 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.744415  1615 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:28.703598  3105 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:28.693756  3233 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.589983  3178 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.775252  3232 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:00:28.740809  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.710279  3231 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.732132  3094 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:28.792770  3218 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:28.801538  3218 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:28.802732  3218 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.693426  3111 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:28.804492  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 63761.6us
I20260709 13:00:28.809405  3105 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:28.746706  3038 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.814131  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:28.738212  3227 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:00:28.710839  3202 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.792098  1661 leader_election.cc:400] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:28.829582  3108 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:28.829977  3225 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:28.810804  3105 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.836468  1661 leader_election.cc:403] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:28.793334  3082 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:00:28.662433  1540 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:28.823241  1615 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:28.795554  3094 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.852105  3254 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.852350  3210 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.853029  3207 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:28.853587  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.037s
W20260709 13:00:28.853080  2263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.039s
I20260709 13:00:28.855887  3192 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.858465  3106 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:28.636193  3230 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.857430   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:28.790635  3233 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:28.755498  3140 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:28.871294  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 53622.7us
W20260709 13:00:28.875011  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.024s
W20260709 13:00:28.941098  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.007s	sys 0.024s
I20260709 13:00:28.819875  3167 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:28.943216  3167 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.945252  3167 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.820639  3188 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.887313  3178 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:28.889669  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:28.894729  3037 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:28.858027  3198 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.597s	user 0.003s	sys 0.010s
W20260709 13:00:28.902264  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 125664us
W20260709 13:00:28.886389  1696 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.032s	sys 0.052s
W20260709 13:00:28.953737  1696 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.033s	sys 0.052s
W20260709 13:00:28.907840  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.037s
W20260709 13:00:28.907920  2263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.011s	sys 0.039s
W20260709 13:00:28.955117  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 618608us
I20260709 13:00:28.856400  3213 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:28.910763  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.020s	sys 0.040s
W20260709 13:00:28.961500  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.021s	sys 0.041s
W20260709 13:00:28.961930  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 626186us
I20260709 13:00:28.858771  3179 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:28.912684  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:28.897890  3094 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.823240  3038 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.923357  3243 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:28.872562  3225 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.889747  3127 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:28.931697  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.897240  3205 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:28.875123  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:28.941481  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 604582us
I20260709 13:00:28.942595  3206 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.911504  3138 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:28.934775   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:28.924439  3192 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.965198  2264 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:28.967389  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:28.967495  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:28.974470  3114 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.973850  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61249.3us
I20260709 13:00:28.966341  3198 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.975642  3172 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:28.896559  3254 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.914098  3210 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.988897  3243 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.914295  3207 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.965240  3187 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:28.964483  3178 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.872108  3108 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:28.991662  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:28.970784  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 600640us
W20260709 13:00:29.035593  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 44012.1us
W20260709 13:00:28.992966  3219 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.033s	sys 0.068s
I20260709 13:00:28.997552  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:28.998204  3249 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:28.926047  3106 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:28.976722  3135 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.979763  3225 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.005687  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:28.999073  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:29.010841  3114 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:29.092316  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 86671.6us
I20260709 13:00:29.012382  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.014508  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.017966  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:28.971338  3179 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.023234  3244 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.031836  3260 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.032673  3202 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:28.999722  3037 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.040799  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.124342  1691 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:29.114984  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.034993  3111 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.041141  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:29.043627  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.127147  1687 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.127274  1538 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:29.074342  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.076730  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.128036  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:29.079233  3251 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:29.073546  3167 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:00:29.092221  3198 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:28.979383  3104 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.039520  3187 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.970854  3213 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.031644  2265 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.113757  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:29.117301  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 99426.7us
I20260709 13:00:29.044864  3209 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.118644  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.118680  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.161837  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.162485  1615 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:29.040102  3178 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.128527  1542 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:00:29.101853  3222 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:29.128036  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.128459  1688 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:29.085465  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.133105  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.094519  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:29.044579  3219 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.033s	sys 0.069s
I20260709 13:00:29.135664  3244 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.118907  2257 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.116243  3235 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.100755  3127 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:29.123100  3155 tablet_copy_client.cc:538] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:29.140166  3111 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:29.136377  3137 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.003s
I20260709 13:00:29.122012  3190 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:29.045409  3141 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.083392  3135 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.009933  3205 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.162768  1691 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:29.161780  1622 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.167192  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.230890  1538 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:29.176578  3230 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.177932  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.178789  1539 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:29.183034  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.141311  3104 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.234038  1542 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:29.148042  3187 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.188999  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:29.033514  3172 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.131115  3037 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.166054  3140 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.211547  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.244748  1689 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:29.177526  3189 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:29.177636  3227 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:29.249759  3227 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.185511  3108 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.251888  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.215006  3105 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.225795  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.252965  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.253074  1688 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:29.253558  1622 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.186561  3206 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:29.277225  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.278072  1538 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:29.195298  1614 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.233083  1615 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.241457  2262 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:29.219307  3137 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3.
W20260709 13:00:29.223677  3081 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.934s	user 0.011s	sys 0.002s
I20260709 13:00:29.216379  3190 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:29.252540  1543 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:29.227476  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:29.312579  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 85214.2us
I20260709 13:00:29.180251  3209 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.223023  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.218811  3141 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.142289  3260 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.280133  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.324627  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.232463  3254 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.239974  3104 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.329941  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:29.330090  1621 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:29.316819  3082 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:29.326951  3141 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:29.331100  3082 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.333153  3082 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.288051  3210 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.334893  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.153565  3251 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.282509  3207 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.120712  3249 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.291103  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.220346  3111 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.248067  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:29.321082  3167 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:29.285508  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:29.325703  1692 raft_consensus.cc:2368] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:29.326045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:29.327297  1539 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:29.275606  3188 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.274969  3038 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.335578  1691 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.334949  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:29.290131  3253 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:00:29.247687  3182 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.004s
I20260709 13:00:29.317766  3081 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:29.358459  1547 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 2: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:29.319101  3190 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:29.322152  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:29.323012  3140 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:29.286789  3206 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.371951  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.374413  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:29.312813  3105 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:29.316815  3259 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:00:29.369593  3179 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:29.389490  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 67447.9us
I20260709 13:00:30.150970  3179 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.151742  3179 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.154016  3179 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.059019  3111 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:30.143093  3231 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.331s	user 0.010s	sys 0.004s
I20260709 13:00:30.174134  3231 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.174607  3111 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:30.067866  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.013s	sys 0.009s
W20260709 13:00:30.183924  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.015s	sys 0.010s
I20260709 13:00:29.676290  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 198) took 1379 ms. Trace:
W20260709 13:00:30.052001  1622 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.680s	user 0.004s	sys 0.010s
I20260709 13:00:30.184921  1622 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:30.185513  3155 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:30.184664  1616 rpcz_store.cc:276] 0709 13:00:28.203757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.203908 (+   151us) service_pool.cc:224] Handling call
0709 13:00:28.204332 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.339779 (+135447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.339810 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.343470 (+  3660us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.858166 (+514696us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:28.858205 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.858272 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.545291 (+687019us) raft_consensus.cc:1685] finished
0709 13:00:29.583056 (+ 37765us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.583260 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12948,"raft.queue_time_us":105903,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":27574,"thread_start_us":547641,"threads_started":2,"wal-append.queue_time_us":645569}
I20260709 13:00:30.185916  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:29.707100  3266 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:00:30.186545  1622 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
W20260709 13:00:30.096175  3236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.000s	sys 0.019s
I20260709 13:00:30.158766  1615 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:29.433878  3188 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:30.160385  3206 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.672363  3254 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:29.439451  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:29.544593  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.602237  3233 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.003s
I20260709 13:00:30.161844  1689 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:29.384140  3167 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.152850  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.163183  3105 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.368875  3207 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.192178  3207 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.192621  3167 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:30.187206  3236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.000s	sys 0.021s
I20260709 13:00:30.187722  1692 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:30.194134  3207 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.372999  1540 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:30.121557  3251 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:30.194988  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1417) took 1044 ms. Trace:
I20260709 13:00:30.164170  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.188000  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:30.196202  3105 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.196532  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.196744  3105 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.197176  3105 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.197811  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.188710  3254 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.200853  3254 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:30.201921  3178 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:30.166698  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.000s	sys 0.013s
W20260709 13:00:29.728698  2265 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.577s	user 0.005s	sys 0.004s
I20260709 13:00:30.204747  3105 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.205382  2265 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:30.205926  1692 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:30.205993  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 620) took 1207 ms. Trace:
I20260709 13:00:30.206449  2265 rpcz_store.cc:276] 0709 13:00:28.999027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.999309 (+   282us) service_pool.cc:224] Handling call
0709 13:00:29.029711 (+ 30402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.205754 (+1176043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.205943 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:29.681382  3270 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:30.207415  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.187798  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.189875  3206 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.208284  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.208999  1620 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:29.681504  3244 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.926599  3161 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:29.437359  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:29.768400  3172 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.209430  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1055) took 1170 ms. Trace:
I20260709 13:00:30.209738  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1870) took 1180 ms. Trace:
I20260709 13:00:30.210134  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.210938  1691 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:30.190718  3233 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.211730  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.212301  1691 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:30.212379  3205 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:30.212735  3233 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.213119  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.213796  1691 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:30.214474  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.195359  1540 rpcz_store.cc:276] 0709 13:00:29.151027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.205086 (+ 54059us) service_pool.cc:224] Handling call
0709 13:00:30.194916 (+989830us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.215317  1691 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
W20260709 13:00:30.189790  1687 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.007s
I20260709 13:00:30.216140  1687 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:30.216235  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.216655  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1869) took 1187 ms. Trace:
I20260709 13:00:30.217018  1687 rpcz_store.cc:276] 0709 13:00:29.028768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.028931 (+   163us) service_pool.cc:224] Handling call
0709 13:00:30.216574 (+1187643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650752}
I20260709 13:00:30.217317  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.168524  3140 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.680176  3265 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260709 13:00:30.209738  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1416) took 1071 ms. Trace:
W20260709 13:00:29.929517  3138 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.001s
I20260709 13:00:30.219743  3138 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:30.219092  1543 rpcz_store.cc:276] 0709 13:00:29.138786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.373716 (+234930us) service_pool.cc:224] Handling call
0709 13:00:29.404268 (+ 30552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.404515 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:29.442461 (+ 37946us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.209028 (+766567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.209075 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.209117 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.209178 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.209682 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39054,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":4056,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":48,"thread_start_us":766115,"threads_started":2,"wal-append.queue_time_us":625525}
I20260709 13:00:30.220562  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 211) took 1251 ms. Trace:
I20260709 13:00:30.190516  3280 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:29.381062  3127 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:30.221465  3280 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.222146  3127 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.223448  3106 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.223742  3280 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.792394  3230 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:30.220954  1617 rpcz_store.cc:276] 0709 13:00:28.968887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.969000 (+   113us) service_pool.cc:224] Handling call
0709 13:00:28.978423 (+  9423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.027192 (+ 48769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.027253 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.039881 (+ 12628us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.135205 (+ 95324us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.135258 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.135347 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.220357 (+1085010us) raft_consensus.cc:1685] finished
0709 13:00:30.220376 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.220506 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12873,"raft.queue_time_us":23760,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14113,"thread_start_us":19614,"threads_started":1,"wal-append.queue_time_us":117745}
I20260709 13:00:30.225466  3230 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.226152  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.375124  3243 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:29.929910  3081 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.209784  1620 rpcz_store.cc:276] 0709 13:00:29.039080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.039198 (+   118us) service_pool.cc:224] Handling call
0709 13:00:30.208135 (+1168937us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b58001f1498. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:30.209351 (+  1216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2023296}
I20260709 13:00:30.227530  1617 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.227881  3140 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:30.228297  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.228837  1620 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
I20260709 13:00:30.228888  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.229482  1617 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.229657  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.190092  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:29.383358  3114 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:29.658810  3245 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:30.169960  3258 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.316s	user 0.015s	sys 0.005s
I20260709 13:00:29.478506  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.169255  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:29.998878  3141 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.002s
I20260709 13:00:30.172753  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 235) took 1558 ms. Trace:
I20260709 13:00:30.269483  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:29.959295  3225 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.844s	user 0.014s	sys 0.004s
I20260709 13:00:29.706295  3209 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:29.929538  3268 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:30.030788  2257 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.815s	user 0.010s	sys 0.014s
I20260709 13:00:29.950696  3249 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:30.010169  3190 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.575s	user 0.001s	sys 0.007s
I20260709 13:00:30.176517  3231 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:29.681227  3264 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:00:29.852077  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.003s	sys 0.007s
W20260709 13:00:29.849519  3104 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.508s	user 0.014s	sys 0.001s
W20260709 13:00:30.177630  2258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.001s	sys 0.013s
I20260709 13:00:29.841029  3260 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.177989  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:29.591583  3168 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:30.179504  3094 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.203s	user 0.013s	sys 0.003s
I20260709 13:00:30.179986  3227 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.180045  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.180742  3192 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:29.480562  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 480020us
I20260709 13:00:30.181699  3037 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.116778  3279 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:29.440737  1544 raft_consensus.cc:2368] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4.
I20260709 13:00:30.186582  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.183938  3111 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.208552  3206 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:29.464643  3135 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.209095  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:30.229632  1538 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.008s
I20260709 13:00:29.410365  3182 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.191509  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:30.191013  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 140397us
I20260709 13:00:30.232712  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.189195  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 164) took 1197 ms. Trace:
I20260709 13:00:30.238067  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 162) took 1247 ms. Trace:
I20260709 13:00:30.251173  1542 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:30.233981  3245 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.262427  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:30.265326  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 1939) took 1111 ms. Trace:
W20260709 13:00:30.189213  3187 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.933s	user 0.006s	sys 0.005s
I20260709 13:00:30.276410  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.277118  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:30.277981  3239 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:30.278555  3236 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.232470  3161 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.231388  3188 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.062987   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:30.573208  1622 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:30.571142  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 1937) took 1453 ms. Trace:
I20260709 13:00:30.210197  1695 rpcz_store.cc:276] 0709 13:00:29.029095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.030887 (+  1792us) service_pool.cc:224] Handling call
0709 13:00:29.115487 (+ 84600us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.154175 (+ 38688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.158257 (+  4082us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.192946 (+ 34689us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.390539 (+197593us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:29.432420 (+ 41881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.437762 (+  5342us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.209515 (+771753us) raft_consensus.cc:1685] finished
0709 13:00:30.209544 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.209677 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":973,"raft.queue_time_us":16284,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":30815,"thread_start_us":153407,"threads_started":1,"wal-append.queue_time_us":228599}
I20260709 13:00:30.569952  1547 rpcz_store.cc:276] 0709 13:00:29.123516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.127807 (+  4291us) service_pool.cc:224] Handling call
0709 13:00:30.234635 (+1106828us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000843d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:30.234750 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414083456}
I20260709 13:00:30.571480  1541 rpcz_store.cc:276] 0709 13:00:28.990745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.990887 (+   142us) service_pool.cc:224] Handling call
0709 13:00:29.005911 (+ 15024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.187065 (+181154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.187084 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.187110 (+    26us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.187127 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.233040 (+1045913us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400256f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:30.233101 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.233259 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416227072}
I20260709 13:00:30.568228  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 1.
W20260709 13:00:30.204988  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.000s	sys 0.014s
I20260709 13:00:30.399794  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.522241  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.510044  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 290) took 3598 ms. Trace:
I20260709 13:00:30.524230  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.569965  1538 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:30.571194  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.443877  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:30.354470  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:30.398739  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.574854  1542 rpcz_store.cc:276] 0709 13:00:29.117999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.240866 (+122867us) service_pool.cc:224] Handling call
0709 13:00:29.478327 (+237461us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b5800002a98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:30.571087 (+1092760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053888}
W20260709 13:00:30.592612  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 315620us
I20260709 13:00:30.590063  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1363) took 1209 ms. Trace:
I20260709 13:00:30.589427  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1065) took 1396 ms. Trace:
I20260709 13:00:30.523165  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1060) took 1443 ms. Trace:
I20260709 13:00:30.603525  1616 rpcz_store.cc:276] 0709 13:00:29.380347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.186335 (+805988us) service_pool.cc:224] Handling call
0709 13:00:30.589991 (+403656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.603746  1622 rpcz_store.cc:276] 0709 13:00:29.178309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.191276 (+1012967us) service_pool.cc:224] Handling call
0709 13:00:30.574372 (+383096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.604120  1619 rpcz_store.cc:276] 0709 13:00:29.080050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.083899 (+  3849us) service_pool.cc:224] Handling call
0709 13:00:29.114186 (+ 30287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.434074 (+319888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.436630 (+  2556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.438058 (+  1428us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:29.446579 (+  8521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.522849 (+1076270us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002c83d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:30.522921 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.523094 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611814784}
W20260709 13:00:30.592998  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 330703us
I20260709 13:00:30.378563  3105 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.603207  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:30.606979  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:30.607924  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1412) took 1483 ms. Trace:
I20260709 13:00:30.327147  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.576306  1688 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:30.614913  1545 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.363395  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1138) took 1045 ms. Trace:
W20260709 13:00:30.619005  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 175280us
W20260709 13:00:30.638412  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 1.47702e+06us
I20260709 13:00:30.659261  1617 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.576998  1546 rpcz_store.cc:276] 0709 13:00:28.991325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.991478 (+   153us) service_pool.cc:224] Handling call
0709 13:00:28.991754 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.275830 (+284076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.275875 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.275934 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.275977 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.188937 (+912960us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540013f1d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:30.188992 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.189117 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652834560}
I20260709 13:00:30.627472  1511 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:30.602756  1442 rpcz_store.cc:276] 0709 13:00:26.911821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.913394 (+  1573us) service_pool.cc:224] Handling call
0709 13:00:30.509930 (+3596536us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:27.540523 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:27.621721 (+ 81198us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:27.621756 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:00:27.621773 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:27.622132 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:27.622194 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:27.622225 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:27.622410 (+   185us) tablet.cc:701] Row locks acquired
0709 13:00:27.622424 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:00:27.622559 (+   135us) write_op.cc:270] Start()
0709 13:00:27.622676 (+   117us) write_op.cc:276] Timestamp: P: 1783602027622517 usec, L: 0
0709 13:00:27.622697 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:27.623320 (+   623us) log.cc:844] Serialized 536 byte log entry
0709 13:00:28.356580 (+733260us) op_driver.cc:464] REPLICATION: finished
0709 13:00:29.098237 (+741657us) write_op.cc:301] APPLY: starting
0709 13:00:29.119956 (+ 21719us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:29.127141 (+  7185us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:29.183655 (+ 56514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:29.210232 (+ 26577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:29.236518 (+ 26286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:29.244742 (+  8224us) write_op.cc:312] APPLY: finished
0709 13:00:29.316098 (+ 71356us) log.cc:844] Serialized 23 byte log entry
0709 13:00:30.097985 (+781887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.098097 (+   112us) write_op.cc:454] Released schema lock
0709 13:00:30.098151 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:30.099235 (+  1084us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.099277 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61147,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":713114,"apply.run_cpu_time_us":13114,"apply.run_wall_time_us":1012697,"num_ops":1,"prepare.queue_time_us":241565,"prepare.run_cpu_time_us":7023,"prepare.run_wall_time_us":97245,"replication_time_us":696798,"thread_start_us":1391050,"threads_started":3,"wal-append.queue_time_us":745959}]]}
I20260709 13:00:30.608381  1538 rpcz_store.cc:276] 0709 13:00:29.124922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.278837 (+153915us) service_pool.cc:224] Handling call
0709 13:00:30.607861 (+1329024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.623457  1689 rpcz_store.cc:276] 0709 13:00:29.317810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.318807 (+   997us) service_pool.cc:224] Handling call
0709 13:00:30.363123 (+1044316us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400451854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:30.363316 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794635648}
I20260709 13:00:30.279134  3138 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.692734  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.239097  3095 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:30.712970  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 85648.5us
I20260709 13:00:30.609644  2263 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:30.724649  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:30.513422  1444 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 3, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:30.577700  2258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.331s	user 0.001s	sys 0.021s
I20260709 13:00:30.706365  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.264324  3244 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:30.567799  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.008s	sys 0.012s
I20260709 13:00:30.528378  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1064) took 1390 ms. Trace:
I20260709 13:00:30.576233  3188 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.279838  3167 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:30.401654  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.376350  3276 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.729343  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.554039  3243 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:30.324293  3230 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.566989  3283 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:30.730006  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 160780us
I20260709 13:00:30.748481  3105 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.719314  1547 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.516652  3213 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:30.716336  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1156) took 1233 ms (client timeout 1523 ms). Trace:
I20260709 13:00:30.554682  3172 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:30.730096  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 213) took 1486 ms. Trace:
I20260709 13:00:30.734160  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:30.736042  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 129172us
I20260709 13:00:30.714816  3268 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:30.741089  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.733084  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:30.279597  3081 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:30.691637  3279 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.711568  3192 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:30.756063  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.691864  1614 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.718042  3232 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.756448  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:30.829741  1688 rpcz_store.cc:269] 0709 13:00:29.483241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.177651 (+694410us) service_pool.cc:224] Handling call
0709 13:00:30.716277 (+538626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.693259  3236 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:30.891994  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 135666us
I20260709 13:00:30.275182  3141 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.721931  3260 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:30.734212  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.570s (SENT) [suppressed 7 similar messages]
I20260709 13:00:30.723872  3127 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.707726  3249 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:30.759369  1693 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.535s	user 0.005s	sys 0.005s
I20260709 13:00:30.722234  3179 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.718935  3138 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:30.906405  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1409) took 2544 ms (client timeout 1923 ms). Trace:
I20260709 13:00:30.324813  3225 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.578150  3104 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:30.730700  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 127600us
I20260709 13:00:30.911911  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:30.912493  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 189405us
I20260709 13:00:30.590227  3190 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.913198  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:30.913432  1618 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:30.748270  3095 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.748631  3227 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:30.590327  3187 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.578279  3094 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.712620  3168 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.592199  3239 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.567974  2257 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:30.958403  3094 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:30.840394  3283 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:30.958961  2257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 619) took 1961 ms (client timeout 2209 ms). Trace:
I20260709 13:00:30.829929  1615 rpcz_store.cc:276] 0709 13:00:29.243498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.600400 (+1356902us) service_pool.cc:224] Handling call
0709 13:00:30.729625 (+129225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.729793 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.729817 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.729858 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.729886 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.729938 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.730042 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.886646  1545 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.762758  3231 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:30.892964  1539 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:30.893882  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:31.009781  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 116000us
I20260709 13:00:31.010043  3239 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:30.748790  1621 rpcz_store.cc:276] 0709 13:00:29.138322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.527352 (+1389030us) service_pool.cc:224] Handling call
0709 13:00:30.527731 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.527963 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.527999 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.528055 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:30.528100 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.528169 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.528315 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:30.767431  2260 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.006s
I20260709 13:00:30.902928  1693 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:30.766090  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1364) took 1318 ms. Trace:
I20260709 13:00:31.011443  2260 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:30.768784  1540 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:30.811249  3105 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.899741  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.893865  3081 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.807998  3182 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.808362  3230 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:30.869172  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 441) took 2054 ms. Trace:
I20260709 13:00:30.748584  3244 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:30.906922  1544 rpcz_store.cc:269] 0709 13:00:28.360905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.361041 (+   136us) service_pool.cc:224] Handling call
0709 13:00:30.905117 (+2544076us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540013ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:30.905283 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963844864}
I20260709 13:00:30.915479  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.766978  3276 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:30.891793  3213 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.891724  3232 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.893811  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1356) took 1884 ms. Trace:
I20260709 13:00:30.940953  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:30.900143  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1357) took 1664 ms (client timeout 2026 ms). Trace:
I20260709 13:00:30.902482  3127 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.903920  3281 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.901162  3260 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:30.922253  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:31.120771  1510 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 459063895bc847b9a15dc71e10b36267. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:31.132515  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 85303.6us
I20260709 13:00:31.132633  1694 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:30.954057  1692 raft_consensus.cc:2368] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:31.062819  3094 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.048282  3282 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:30.901348  3209 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:30.918125  3037 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:30.956678  3161 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:30.957628  2266 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:30.958051  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:31.156549  2264 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:30.886680  3172 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.809039  3243 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:30.919797  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:30.910744  3138 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:30.959340  2257 rpcz_store.cc:269] 0709 13:00:28.998721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.998836 (+   115us) service_pool.cc:224] Handling call
0709 13:00:30.958877 (+1960041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.010727  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.011734  1619 rpcz_store.cc:276] 0709 13:00:29.443264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.606056 (+1162792us) service_pool.cc:224] Handling call
0709 13:00:30.606478 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.706187 (+ 99709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.722004 (+ 15817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.728731 (+  6727us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.747250 (+ 18519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.753465 (+  6215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.761954 (+  8489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.169664  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1154) took 1705 ms. Trace:
I20260709 13:00:31.046886  1690 raft_consensus.cc:2368] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:30.915491  3294 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:31.088428  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:30.939942  3227 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:31.170199  1691 rpcz_store.cc:276] 0709 13:00:29.464348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.218106 (+753758us) service_pool.cc:224] Handling call
0709 13:00:30.218374 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.218555 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:30.754073 (+535518us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.169255 (+415182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.169323 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.169373 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.169461 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.169600 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":680900,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"thread_start_us":901826,"threads_started":2}
I20260709 13:00:31.007179  3231 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.124469  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1365) took 1661 ms. Trace:
I20260709 13:00:31.181061  1617 rpcz_store.cc:276] 0709 13:00:29.463121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.661738 (+1198617us) service_pool.cc:224] Handling call
0709 13:00:30.723609 (+ 61871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.961833 (+238224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.961875 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.961929 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:30.961972 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.124252 (+162280us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54000f9bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.124293 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.124418 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547450240}
I20260709 13:00:30.916123  3179 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.117836  1613 rpcz_store.cc:276] 0709 13:00:29.007723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.008227 (+   504us) service_pool.cc:224] Handling call
0709 13:00:29.045358 (+ 37131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.129889 (+ 84531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.132662 (+  2773us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.193676 (+ 61014us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.761385 (+1567709us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.763143 (+  1758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.775139 (+ 11996us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.829299 (+ 54160us) raft_consensus.cc:1685] finished
0709 13:00:30.829311 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.892555 (+ 63244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19472,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8677,"thread_start_us":1494531,"threads_started":1,"wal-append.queue_time_us":869534,"wal-append.run_cpu_time_us":1757,"wal-append.run_wall_time_us":1024744}
I20260709 13:00:31.128808  3111 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.048569  3105 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:30.268802  2259 rpcz_store.cc:276] 0709 13:00:28.613968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.628987 (+ 15019us) service_pool.cc:224] Handling call
0709 13:00:28.778741 (+149754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.887914 (+109173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.887964 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.888496 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:00:29.022978 (+134482us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:29.023058 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.023185 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.172510 (+1149325us) raft_consensus.cc:1685] finished
0709 13:00:30.172529 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.172674 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64973,"raft.queue_time_us":67458,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":125341,"threads_started":1,"wal-append.queue_time_us":238144}
I20260709 13:00:30.769920  3167 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.148963  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.118027  3232 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.150373  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:31.149991  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 341254us
I20260709 13:00:31.149852  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:31.029044  3289 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:00:31.113574  3292 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.130908  3127 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.089272  3230 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.130326  3135 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:31.146019  3260 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.910422  3249 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.150956  3282 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.151186  3209 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.158536  1695 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:31.154870  3182 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.157056  3245 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.118870  3213 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.188196  1694 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
W20260709 13:00:31.188978  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 178379us
I20260709 13:00:31.266000  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:31.184901  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 273093us
I20260709 13:00:31.267391  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.193193  1687 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.162308  3206 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:31.120615  1614 rpcz_store.cc:269] 0709 13:00:29.228428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.179788 (+951360us) service_pool.cc:224] Handling call
0709 13:00:30.893217 (+713429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.146813  3281 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:31.187080  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1141) took 1856 ms (client timeout 1835 ms). Trace:
W20260709 13:00:31.197674  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 463511us
I20260709 13:00:31.182915  3227 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.177464  3178 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.330829  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1359) took 2015 ms. Trace:
W20260709 13:00:31.218829  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68568.7us
I20260709 13:00:31.331212  3276 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.331434  1622 rpcz_store.cc:276] 0709 13:00:29.315397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.605209 (+1289812us) service_pool.cc:224] Handling call
0709 13:00:30.605590 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.692483 (+ 86893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.692509 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.692968 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.144384 (+451416us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:31.144446 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.144551 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.330546 (+185995us) raft_consensus.cc:1685] finished
0709 13:00:31.330572 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.330761 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86343,"raft.queue_time_us":420449,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":58293,"thread_start_us":334902,"threads_started":1,"wal-append.queue_time_us":486354}
I20260709 13:00:31.334054  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:31.184993  3231 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.154307  3094 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:31.225126  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 99260.4us
I20260709 13:00:31.187547  3283 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:31.194128  3303 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.197454  3192 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.239517  3291 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:31.250897  3282 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.317597  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 214) took 2073 ms. Trace:
I20260709 13:00:31.350597  1616 rpcz_store.cc:276] 0709 13:00:29.243674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.604457 (+1360783us) service_pool.cc:224] Handling call
0709 13:00:30.604767 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.960106 (+355339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.960148 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.960203 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.960246 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.317276 (+357030us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54000f91d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.317340 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.317520 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816843520}
I20260709 13:00:31.319361  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1371) took 1112 ms. Trace:
I20260709 13:00:31.237691  3297 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.253443  3239 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.322472  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55175.3us
I20260709 13:00:31.323835  1512 leader_election.cc:400] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:31.364189  1512 leader_election.cc:403] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:31.364871  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48473.4us
I20260709 13:00:31.310549  3190 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:31.255101  3209 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.333565  3095 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.264914  3182 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.331182  3178 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.329491  3298 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:00:31.330343  3268 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.330703  3281 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:31.268198  3104 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:31.185559  3294 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.344583  1687 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:31.302138  3236 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.301249  3111 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.348796  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:31.352119  1618 rpcz_store.cc:276] 0709 13:00:30.206511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.732847 (+526336us) service_pool.cc:224] Handling call
0709 13:00:30.755797 (+ 22950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.913904 (+158107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.319056 (+405152us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002ed454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.319292 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361493376}
I20260709 13:00:31.237320  3135 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:31.363173  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 171186us
I20260709 13:00:31.259253  3141 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.220238  3292 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.372095  1512 leader_election.cc:400] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
W20260709 13:00:31.381937  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.315481  1693 rpcz_store.cc:269] 0709 13:00:29.323853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.329252 (+  5399us) service_pool.cc:224] Handling call
0709 13:00:31.180251 (+1850999us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54002f4ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:31.180403 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2054974208}
W20260709 13:00:31.465433  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 98904.6us
I20260709 13:00:31.308529  3279 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:31.395159  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 203738us
I20260709 13:00:31.346827  3081 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.344724  3192 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.352769  2257 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:31.344519  3303 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:31.382506  3155 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:00:31.350417  3291 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.345012  3187 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:31.357141  3226 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.028s	sys 0.032s
W20260709 13:00:31.393240  3188 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:00:31.387538  3168 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.365826  3225 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:31.459860  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 111176us
I20260709 13:00:31.391938  3283 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:31.468268  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:31.466380  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.387282  3306 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:31.474754  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 130696us
I20260709 13:00:31.405280  3244 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.406880  3178 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.477195  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:31.514676  3300 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:31.515072  1693 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:31.515691  3308 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:00:31.497849  3291 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.516129  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:31.516764  1693 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.478067  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.517954  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:31.478901  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.519064  1688 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:31.482162  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:31.447655  3206 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:31.522055  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.522286  3206 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:31.409860  3095 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:31.387156  3239 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.552933  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.463883  3268 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:31.386106  3297 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.470995  3190 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.468650  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:31.506791  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 240904us
I20260709 13:00:31.061295  2258 rpcz_store.cc:276] 0709 13:00:28.814343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.899459 (+ 85116us) service_pool.cc:224] Handling call
0709 13:00:28.989829 (+ 90370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.042673 (+ 52844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.045264 (+  2591us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.142237 (+ 96973us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.753817 (+1611580us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:30.761457 (+  7640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.768100 (+  6643us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.788393 (+ 20293us) raft_consensus.cc:1685] finished
0709 13:00:30.829206 (+ 40813us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.869103 (+ 39897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5069,"raft.queue_time_us":24176,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":31251,"thread_start_us":1498053,"threads_started":1,"wal-append.queue_time_us":890049,"wal-append.run_cpu_time_us":10739,"wal-append.run_wall_time_us":1013382}
I20260709 13:00:31.493062  3289 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:00:31.476330  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.517186  3081 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.524355  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.480762  3111 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.529482  3294 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.531239  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.492669  3303 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.646888  1616 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.535658  3094 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.536554  3179 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.497681  3279 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.492622  3245 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:31.493167  3315 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.487524  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:31.497354  3226 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.028s	sys 0.032s
I20260709 13:00:31.508498  1585 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:31.556742  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 440) took 2971 ms (client timeout 2810 ms). Trace:
I20260709 13:00:31.556936  2265 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:31.557886  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 217) took 1288 ms. Trace:
I20260709 13:00:31.574680  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1367) took 1369 ms. Trace:
I20260709 13:00:31.674360  1620 rpcz_store.cc:276] 0709 13:00:30.205495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.715913 (+510418us) service_pool.cc:224] Handling call
0709 13:00:30.716217 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.125037 (+408820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.125069 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.125108 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:31.125134 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.574361 (+449227us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002c79d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.574421 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.574589 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939864832}
I20260709 13:00:31.579494  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.582551  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.584206  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:31.584880  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1873) took 2532 ms (client timeout 2187 ms). Trace:
I20260709 13:00:31.585529  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 222) took 1187 ms. Trace:
I20260709 13:00:31.680245  1617 rpcz_store.cc:276] 0709 13:00:30.398091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.196235 (+798144us) service_pool.cc:224] Handling call
0709 13:00:31.226672 (+ 30437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.265755 (+ 39083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.265799 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.265857 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:31.265900 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.585265 (+319365us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54001608d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.585319 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.585466 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89358208}
I20260709 13:00:31.674317  1615 rpcz_store.cc:276] 0709 13:00:30.269993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.061893 (+791900us) service_pool.cc:224] Handling call
0709 13:00:31.120838 (+ 58945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.227854 (+107016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.227893 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.227950 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:31.227992 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.557617 (+329625us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54004182d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:31.557668 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.557820 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245666688}
I20260709 13:00:31.594772  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:31.596028  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:31.679589  1690 rpcz_store.cc:269] 0709 13:00:29.052482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.114567 (+ 62085us) service_pool.cc:224] Handling call
0709 13:00:31.584582 (+2470015us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540012d9d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:31.584739 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4375504640}
I20260709 13:00:31.596920  3230 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.655972  3249 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.655848  3243 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:31.636099  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 241) took 2688 ms (client timeout 1987 ms). Trace:
I20260709 13:00:31.523033  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.487089  3192 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.508440  3283 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.639520  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:31.708348  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 68915.6us
I20260709 13:00:31.709597  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:31.643602  1691 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:31.524503  3135 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:31.636966  3140 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.407s	user 0.013s	sys 0.000s
I20260709 13:00:31.654409  1693 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:31.509790  3188 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.639210  3190 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.644227  3172 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:31.673332  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 191273us
W20260709 13:00:31.676126  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 449952us
I20260709 13:00:31.681928  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.695986  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.661332  3318 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.699409  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 116989us
I20260709 13:00:31.637935  3095 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.639187  3105 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:31.697502  2266 rpcz_store.cc:269] 0709 13:00:28.947748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.947921 (+   173us) service_pool.cc:224] Handling call
0709 13:00:31.632615 (+2684694us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54004a9a54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:31.636022 (+  3407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4516026752}
W20260709 13:00:31.712296  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 124110us
I20260709 13:00:31.542827  3306 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:31.720216  1616 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:31.675891  3213 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.675397  3137 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:31.719671  3081 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:31.722365  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.722999  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.678390  3314 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:31.683349  1614 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.726789  1618 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:31.666463  3279 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.747016  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.740834  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:31.747685  1687 raft_consensus.cc:2368] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:31.663985  3182 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.715654  3283 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.700502  1613 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.672726  3245 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.749585  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:31.753055  3095 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.754170  3155 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:31.760908  3306 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:31.761143  3127 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 13:00:31.761368  3328 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.725704  3190 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.732542  3311 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.765650  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.720327  1695 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:31.759636  1691 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:31.719867  3140 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.788277  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.788609  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:31.782416  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 56586.6us
I20260709 13:00:31.755429  3081 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.672070  3315 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.796326  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.770251  3225 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.786798  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.794816  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:31.801134  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:31.801964  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:31.802066  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:31.756208  3314 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.797621  1539 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:31.787496  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.797844  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.727190  3206 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.815414  1691 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
W20260709 13:00:31.673888  2260 rpcz_store.cc:269] 0709 13:00:28.585257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.615250 (+ 29993us) service_pool.cc:224] Handling call
0709 13:00:28.964893 (+349643us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:31.556459 (+2591566us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54005d0554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:31.556636 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2836823168}
I20260709 13:00:31.811923  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:31.783860  3328 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.740005  3318 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:31.815088  1696 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:31.815385  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:31.784235  3311 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.815551  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.814081  3314 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:31.822209  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1146) took 2442 ms (client timeout 2004 ms). Trace:
I20260709 13:00:31.822504  1615 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.797958  3081 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:31.824745  2264 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:31.821560  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.835808  1621 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:31.835919  1692 rpcz_store.cc:269] 0709 13:00:29.379582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.207148 (+827566us) service_pool.cc:224] Handling call
0709 13:00:31.817762 (+1610614us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540040f454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:31.822128 (+  4366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715304320}
I20260709 13:00:31.783651  3127 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.812402  3172 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:31.851604  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.835363  2266 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:31.854533  1616 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.821326  3292 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.832733  3155 tablet_bootstrap.cc:492] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:31.785359  3304 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:31.810686  3243 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:31.852559  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 63976.6us
I20260709 13:00:31.889933  1547 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.893580  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:31.903754  3283 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.853121  3225 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:31.834298  3328 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.902427  1616 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:31.912230  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:31.910650  3138 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.004s
I20260709 13:00:31.838258  3213 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:00:31.920183  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.920536  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.855504  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:31.839213  3311 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:31.916846  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:31.909987  3297 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.858017  3239 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.839576  3334 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.922336  1539 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:31.931495  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:31.910209  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:31.911059  3172 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:31.937309  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:31.926967  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:31.939803  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:31.940641  1539 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:31.932857  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
W20260709 13:00:31.925501  3332 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:00:31.920789  3105 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:31.920384  3225 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.930286  3155 ts_tablet_manager.cc:1403] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 1.745s	user 0.070s	sys 0.071s
W20260709 13:00:31.967741  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74208.4us
W20260709 13:00:31.934402  3282 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:00:31.973013  1541 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:31.973290  1615 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:31.973452  3339 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:31.973776  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:31.966430  3338 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:31.975839  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:31.976365  3245 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.976706  3315 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:31.980724  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:31.988179  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:31.988564  1543 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:31.985387  3190 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:31.967674  3322 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:00:31.936690  3279 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:31.987380  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:31.986544  1547 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:31.992537  1541 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:31.932811  3333 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:31.928761  3138 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.993589  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:31.995637  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 213562us
I20260709 13:00:31.996299  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:31.977649  3225 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:31.999156  1692 raft_consensus.cc:2368] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.001644  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.003626  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:31.993551  3326 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:00:31.993780  2258 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.004742  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:31.986840  3282 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.010054  1694 raft_consensus.cc:2368] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:31.993397  3268 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:31.979635  3243 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.016690  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.016010  3268 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:32.022686  3260 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.007s
I20260709 13:00:32.025777  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:32.025381  3323 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:00:32.026535  2264 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:32.025928  3260 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.014935  3140 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:32.021561  3231 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.010s
I20260709 13:00:32.004506  3333 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:31.993839  3339 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.038419  3283 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.025421  3268 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.029917  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.030273  3213 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.052601  1621 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
W20260709 13:00:32.056865  3329 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:00:32.061002  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:32.063982  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60449.7us
I20260709 13:00:32.064870  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.066378  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.067757  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.068120  1616 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:32.072111  3155 raft_consensus.cc:359] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:32.072690  3333 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.072865  3155 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:00:32.036442  3231 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:31.938067  3334 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.080873  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 621) took 1159 ms. Trace:
I20260709 13:00:32.081888  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.078648  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:32.081250  2262 rpcz_store.cc:276] 0709 13:00:30.921833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.921975 (+   142us) service_pool.cc:224] Handling call
0709 13:00:30.922361 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.008569 (+ 86208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.008617 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.566305 (+557688us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b2c00047a38. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:00:31.566966 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.664440 (+ 97474us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:31.664479 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.674045 (+  9566us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.058410 (+384365us) raft_consensus.cc:1685] finished
0709 13:00:32.058433 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.080814 (+ 22381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89942,"raft.queue_time_us":83388,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":60615,"spinlock_wait_cycles":10792320,"thread_start_us":97065,"threads_started":1,"wal-append.queue_time_us":206494}
I20260709 13:00:32.088191  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.088958  1621 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:32.089104  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 211) took 1167 ms. Trace:
I20260709 13:00:32.089645  1689 rpcz_store.cc:276] 0709 13:00:30.921399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.921950 (+   551us) service_pool.cc:224] Handling call
0709 13:00:30.960303 (+ 38353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.363854 (+403551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.363895 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.386311 (+ 22416us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.673708 (+287397us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:31.673763 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.673850 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.088824 (+414974us) raft_consensus.cc:1685] finished
0709 13:00:32.088856 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.089028 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":164405,"raft.run_cpu_time_us":3386,"raft.run_wall_time_us":30097,"thread_start_us":505237,"threads_started":2,"wal-append.queue_time_us":402952}
I20260709 13:00:32.035881  3172 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.074360  3338 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:32.074096  3325 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.094568  1538 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:32.069597  3213 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.086146  3333 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.095083  1541 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
W20260709 13:00:32.098667  3327 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:00:32.111928  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 623) took 1155 ms. Trace:
I20260709 13:00:32.099596  3282 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.101414  3340 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.059890  3243 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.102445  3338 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.087440  3318 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.113433  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.100287  3190 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.108403  1543 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:32.112324  2261 rpcz_store.cc:276] 0709 13:00:30.956273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.164143 (+207870us) service_pool.cc:224] Handling call
0709 13:00:31.217112 (+ 52969us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.309907 (+ 92795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.320896 (+ 10989us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.470906 (+150010us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.738736 (+267830us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:31.741286 (+  2550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.757181 (+ 15895us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.111683 (+354502us) raft_consensus.cc:1685] finished
0709 13:00:32.111709 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.111867 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22992,"raft.run_cpu_time_us":542,"raft.run_wall_time_us":9105,"thread_start_us":200808,"threads_started":1,"wal-append.queue_time_us":286825}
W20260709 13:00:32.124951  3232 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.900s	user 0.006s	sys 0.005s
I20260709 13:00:32.125733  1661 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:32.128057  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.128619  1621 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:32.129714  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.126206  3232 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:32.127622  3227 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.004s
I20260709 13:00:32.130944  3227 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.131985  1688 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.117004  3325 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:32.133386  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.135839  3343 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:32.136421  3343 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.124019  3338 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.119577  1613 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:32.133086  3187 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:32.141360  3209 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.001s
W20260709 13:00:32.139895  3178 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 13:00:32.142133  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.138554  3334 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:32.141816  3299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.009s	sys 0.004s
I20260709 13:00:32.148916  1621 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.102792  3155 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:32.149977  3227 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.149374  3187 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:32.154466  3299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.009s	sys 0.005s
I20260709 13:00:32.149703  3178 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.165361  3187 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.166442  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 449) took 1903 ms. Trace:
I20260709 13:00:32.168965  2265 rpcz_store.cc:276] 0709 13:00:30.266045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.273920 (+  7875us) service_pool.cc:224] Handling call
0709 13:00:31.556606 (+1282686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.674048 (+117442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.166237 (+492189us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54005d0550. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:32.166386 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949154560}
I20260709 13:00:32.170336  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.153327  3231 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.161285  3325 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.172564  1618 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:32.148272  3209 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.174554  3167 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.177675  1695 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.161866  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.182327  1613 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.182365  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.178139  3178 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.191004  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:32.191346  3291 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.004s
I20260709 13:00:32.192241  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.191843  3291 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.193456  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.194044  3111 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.195191  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.178920  1690 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.193621  2263 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:32.180723  3232 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.185702  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.179849  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:32.179312  3303 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:00:32.189265  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:32.198309  1615 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:32.205880  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.216455  1546 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.205120  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.218828  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.223079  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:32.227053  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.167860  3192 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.231236  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.232076  2261 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:32.231947  3081 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.233950  1542 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.234301  2260 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:32.187990  1614 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:32.235806  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.235961  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 221) took 1964 ms. Trace:
I20260709 13:00:32.236338  1619 rpcz_store.cc:276] 0709 13:00:30.271526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.193171 (+921645us) service_pool.cc:224] Handling call
0709 13:00:31.193533 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.193762 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:31.398802 (+205040us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.235530 (+836728us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b18001d55a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:00:32.235669 (+   139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.235716 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.235752 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.235812 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.235911 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87481,"prepare.queue_time_us":310312,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":26196,"spinlock_wait_cycles":13946624,"thread_start_us":301983,"threads_started":2,"wal-append.queue_time_us":314763}
I20260709 13:00:32.237938  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.236358  1614 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
W20260709 13:00:32.239296  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 763082us
I20260709 13:00:32.238327  1546 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:32.240049  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.240624  1619 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.223672  2262 raft_consensus.cc:2376] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3. Re-sending same reply.
I20260709 13:00:32.232884  3192 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.233028  1691 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:32.240218  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.243409  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.244653  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.245641  1617 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.214799  3232 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:00:32.239718  3338 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:32.249130  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 740710us
I20260709 13:00:32.249369  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.250454  1542 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:32.250608  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.252357  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.255595  1510 leader_election.cc:400] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.259553  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.248155  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:32.339457  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 84046.7us
I20260709 13:00:32.341025  3192 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:32.341198  3081 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.340812  3230 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.344806  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:32.345423  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:32.334131  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.257496  3335 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.334692  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:32.229708  3303 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.337102  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.243127  3334 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:32.338600  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 98456us
I20260709 13:00:32.347046  3294 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:32.357666  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.347357  3155 ts_tablet_manager.cc:1434] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.371s	user 0.006s	sys 0.005s
I20260709 13:00:32.346683  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.361069  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.361821  1615 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.348483  1546 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.341471  3192 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.366672  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.347574  3225 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.355872  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.335764  3311 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.357612  1617 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:32.262835  3319 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:32.363955  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.378880  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.379707  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.381366  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.360828  3294 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.355526  3335 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.367632  1619 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:32.371428  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.354738  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:32.359555  3334 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.390159  3334 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.376447  1546 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:32.367552  3291 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.372362  3232 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.350178  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.377381  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:32.357781  1613 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:32.372606  1621 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.389379  3342 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:32.389525  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:32.390372  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.395450  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.371379  3192 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.398504  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.399452  3309 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:00:32.400743  3314 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.542s	user 0.000s	sys 0.016s
I20260709 13:00:32.397892  3249 raft_consensus.cc:2764] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:32.382786  3338 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.402590  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.386396  3236 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.386241  3294 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.388558  3227 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.388085  3340 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:32.386904  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.391557  3281 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.412139  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.377610  3081 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:00:32.387038  3319 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:32.392885  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.422986  1587 leader_election.cc:400] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:32.423419  1587 leader_election.cc:403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.398701  3230 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:32.408466  3291 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:32.428339  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.428570  3291 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:32.428660  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:32.429160  3291 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.429554  2261 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.408553  2260 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:32.435022  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:32.427037  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.436499  2264 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:32.416509  3236 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.437490  1615 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:32.430413  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.452543  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.454434  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.457142  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.437536  1510 leader_election.cc:400] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.460235  1510 leader_election.cc:403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.460597  1690 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.421777  3319 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.462005  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.463023  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.467327  3335 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.435843  3315 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:32.469517  1688 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.420895  3227 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.426036  3281 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.452796  3168 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:32.410351  3314 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.456758  3241 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.438660  3190 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:32.479889  3337 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:32.473421  3311 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.459594  3303 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.475966  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.478242  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.481755  3337 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.481935  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.482544  3225 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.483471  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.487393  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.469403  3338 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.505920  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.488708  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.507436  1689 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:32.480795  2261 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:32.472429  3315 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:32.502066  1587 connection.cc:256] RPC call timeout handler was delayed by -1.9909490059999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:00:32.513043  1587 connection.cc:256] RPC call timeout handler was delayed by -1.7227490059999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 13:00:32.513464  1587 connection.cc:256] RPC call timeout handler was delayed by -1.6327490059999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:00:32.513825  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5949490059999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:00:32.514181  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5157490059999645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
I20260709 13:00:32.509594  1621 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:32.475636  3283 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:32.514542  1587 connection.cc:256] RPC call timeout handler was delayed by -1.46534900599994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:00:32.514943  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4545490059999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2255s for a response
W20260709 13:00:32.515650  1587 connection.cc:256] RPC call timeout handler was delayed by -1.3591490059999387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23610000000000003s for a response
I20260709 13:00:32.516638  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.522112  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.506472  3297 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:32.520624  3315 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:32.522578  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.550979  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.506152  3230 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.485924  3268 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.523557  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:32.550556  3283 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.561527  3227 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.563881  3334 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.564842  3188 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.565572  3291 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.566649  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.598083  1692 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:32.568773  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.520346  3276 raft_consensus.cc:2764] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:32.505204  3337 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:32.606976  3347 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:00:32.524434  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.554702  3321 raft_consensus.cc:2764] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:00:32.590086  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 66614.7us
I20260709 13:00:32.588428  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:32.602658  3293 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.482692  3241 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.598905  3331 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.614714  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.616163  1546 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:32.616273  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.613430  3140 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:32.621212  3140 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:32.622131  3140 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.627023  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.627455  3319 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:32.628513  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.629978  3319 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.590708  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.576994  3297 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.659132  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.659955  1544 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:32.660213  3297 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.661511  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.660796  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.668412  3331 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:32.619578  2258 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:32.672006  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:32.667207  1544 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:32.580574  3281 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:32.660912  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.004s	sys 0.019s
I20260709 13:00:32.661082  3293 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:32.675454  3225 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:32.685750  3314 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.680442  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.676059  3081 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:32.687542  1544 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:32.690629  3341 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:32.695401  3127 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.684010  3293 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:32.682052  3334 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:32.709041  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.673949  3192 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.720067  3241 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.687927  3225 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:32.751171  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1168) took 1270 ms (client timeout 1549 ms). Trace:
I20260709 13:00:32.751535  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.754251  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:32.751696  1694 rpcz_store.cc:269] 0709 13:00:31.480500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.517643 (+ 37143us) service_pool.cc:224] Handling call
0709 13:00:32.721645 (+1204002us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54001f72d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:32.751094 (+ 29449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1129615616}
I20260709 13:00:32.769730  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:32.785403  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.786442  1544 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:32.770514  1694 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:32.760008  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.691220  3081 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:32.853013  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 93143.3us
I20260709 13:00:32.937469  1511 leader_election.cc:400] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:32.937899  1511 leader_election.cc:403] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.854693  1546 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:32.855340  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:32.941257  1690 raft_consensus.cc:2368] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:32.857059  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 171) took 1056 ms. Trace:
I20260709 13:00:32.939715  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:32.941751  1542 rpcz_store.cc:276] 0709 13:00:31.801024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.801761 (+   737us) service_pool.cc:224] Handling call
0709 13:00:32.856814 (+1055053us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000848d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:32.856974 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992277248}
I20260709 13:00:32.942519  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.943264  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.944129  1542 raft_consensus.cc:2368] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:32.944444  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.944986  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:32.945873  1542 raft_consensus.cc:2368] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:32.697074  3138 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:32.670089  3331 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:32.949117  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:32.947540  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:32.952451  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:32.961480  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.962906  3206 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.964951  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.965912  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.966341  1546 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:32.966522  1544 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 1.
I20260709 13:00:32.969283  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.961602  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.971184  1620 raft_consensus.cc:2368] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4.
I20260709 13:00:32.750736  3225 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:32.963594  3321 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:32.976855  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 226) took 1387 ms (client timeout 1598 ms). Trace:
I20260709 13:00:32.978443  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
W20260709 13:00:32.997571  1620 rpcz_store.cc:269] 0709 13:00:31.589282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.675579 (+ 86297us) service_pool.cc:224] Handling call
0709 13:00:32.961403 (+1285824us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b58001f1498. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:32.976780 (+ 15377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15136640}
I20260709 13:00:32.998338  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:32.999135  1694 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:32.995983  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:33.000195  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.000906  1694 raft_consensus.cc:2376] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4. Re-sending same reply.
I20260709 13:00:33.001019  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.971478  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:32.852643  3268 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:32.995214  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:32.948987  3328 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.016s	user 0.004s	sys 0.009s
I20260709 13:00:32.942886  3334 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:33.013247  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:32.949210  3314 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:33.015131  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.025305  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:32.963349  3206 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:32.995110  2257 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.033s
I20260709 13:00:32.689250  3283 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.023586  1542 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:33.040086  1542 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:33.042187  3192 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.042943  3236 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.021075  3242 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:33.012835  2260 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.005s
I20260709 13:00:32.969383  3303 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:33.017225  3179 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.009s	sys 0.033s
I20260709 13:00:32.973783  3241 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:32.970185  3339 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.029765  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.034180  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.076125  1694 raft_consensus.cc:2368] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:33.027977  3328 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.034631  3206 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.031324  3291 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.038120  3268 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:33.035989  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:33.059561  2260 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:33.076267  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 223) took 1680 ms. Trace:
I20260709 13:00:33.077144  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.016058  3321 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.059518  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1178) took 1134 ms. Trace:
I20260709 13:00:33.105074  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.105885  1694 raft_consensus.cc:2368] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:33.106331  1690 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.103808  1622 rpcz_store.cc:276] 0709 13:00:31.404512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.404872 (+   360us) service_pool.cc:224] Handling call
0709 13:00:31.458583 (+ 53711us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.491710 (+ 33127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.491738 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:31.491779 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:31.491827 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.076049 (+1584222us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54000eea54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:33.076091 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.076219 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67988736}
I20260709 13:00:33.108613  1691 rpcz_store.cc:276] 0709 13:00:31.925253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.931165 (+  5912us) service_pool.cc:224] Handling call
0709 13:00:32.232864 (+301699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.244217 (+ 11353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.059240 (+815023us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54000b4ad0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.059443 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693258624}
I20260709 13:00:33.110095  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.110749  1691 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:33.102509  1512 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.570s (SENT)
I20260709 13:00:33.069461  3242 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:33.114742  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.076366  3241 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:33.093791  3268 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:33.078953  3179 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.010s	sys 0.034s
I20260709 13:00:33.113829  1539 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:33.118635  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:33.119592  1696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1151) took 3682 ms (client timeout 1555 ms). Trace:
I20260709 13:00:33.122442  3242 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.104589  3106 raft_consensus.cc:2764] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
W20260709 13:00:33.156206  1696 rpcz_store.cc:269] 0709 13:00:29.437467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.168989 (+731522us) service_pool.cc:224] Handling call
0709 13:00:33.119364 (+2950375us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002f49d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.119515 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3575462784}
W20260709 13:00:33.146737  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61056.6us
W20260709 13:00:33.039084  2257 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.007s	sys 0.034s
I20260709 13:00:33.161849  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.170979  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.177690  1694 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.118767  3241 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:33.133849  3325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.024s	sys 0.021s
I20260709 13:00:33.147245  3268 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:33.165925  3172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.037s	sys 0.041s
W20260709 13:00:33.181250  3315 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260709 13:00:33.200068  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:33.217923  2265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.012s	sys 0.052s
W20260709 13:00:33.242578  2265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.013s	sys 0.052s
I20260709 13:00:33.243238  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1430) took 1326 ms. Trace:
W20260709 13:00:33.181875  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1166) took 1702 ms (client timeout 2243 ms). Trace:
W20260709 13:00:33.211663  3172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.038s	sys 0.042s
I20260709 13:00:33.254225  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.530440  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.254019  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.531354  1614 raft_consensus.cc:2368] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:33.254171  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.536139  1538 rpcz_store.cc:276] 0709 13:00:31.916498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.916612 (+   114us) service_pool.cc:224] Handling call
0709 13:00:33.218667 (+1302055us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400257954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.243164 (+ 24497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381386112}
I20260709 13:00:33.451853  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 223) took 1097 ms. Trace:
W20260709 13:00:33.419793  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1440) took 1500 ms (client timeout 1585 ms). Trace:
I20260709 13:00:33.545287  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.546126  1615 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:33.449672  3341 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.553401  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.554294  1620 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:33.531694  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.555395  1694 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.252321  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:33.556875  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 458) took 1558 ms. Trace:
I20260709 13:00:33.557411  2266 rpcz_store.cc:276] 0709 13:00:31.998257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.021718 (+ 23461us) service_pool.cc:224] Handling call
0709 13:00:33.252117 (+1230399us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:33.556800 (+304683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4691712}
I20260709 13:00:33.452275  1688 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:33.420348  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1437) took 1502 ms (client timeout 1804 ms). Trace:
W20260709 13:00:33.560966  1541 rpcz_store.cc:269] 0709 13:00:31.918339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.993411 (+ 75072us) service_pool.cc:224] Handling call
0709 13:00:33.420158 (+1426747us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b54000479d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.420289 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189982080}
I20260709 13:00:33.570340  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:33.253772  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 451) took 1679 ms (client timeout 2219 ms). Trace:
I20260709 13:00:33.565109  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.553680  3341 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.254873  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.605006  1690 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:33.270701  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 170) took 1470 ms (client timeout 1886 ms). Trace:
W20260709 13:00:33.602114  2263 rpcz_store.cc:269] 0709 13:00:31.573996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.594393 (+ 20397us) service_pool.cc:224] Handling call
0709 13:00:33.253565 (+1659172us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b5400634cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.253707 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177160576}
I20260709 13:00:33.256135  3328 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.608739  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:33.384807  3294 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.964s	user 0.014s	sys 0.000s
W20260709 13:00:33.541622  1539 rpcz_store.cc:269] 0709 13:00:31.919284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.970293 (+ 51009us) service_pool.cc:224] Handling call
0709 13:00:33.419507 (+1449214us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400210054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.419710 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599727360}
I20260709 13:00:33.216300  3081 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.531965  3314 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:33.605489  1547 rpcz_store.cc:269] 0709 13:00:31.800601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.800912 (+   311us) service_pool.cc:224] Handling call
0709 13:00:33.270458 (+1469546us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b540038b654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.270607 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202758400}
I20260709 13:00:33.367630  3209 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:33.185592  3325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.025s	sys 0.021s
W20260709 13:00:33.210795  3187 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.034s	sys 0.014s
I20260709 13:00:33.573616  1620 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:33.588047  1615 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:33.589265  1660 leader_election.cc:400] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:33.626663  1660 leader_election.cc:403] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.629624  3178 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:33.578253  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1900) took 1009 ms. Trace:
I20260709 13:00:33.593742  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:33.631646  1688 rpcz_store.cc:276] 0709 13:00:32.568448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.675753 (+107305us) service_pool.cc:224] Handling call
0709 13:00:33.452039 (+776286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.561912 (+109873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.577993 (+ 16081us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b5400433850. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.578174 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770104576}
I20260709 13:00:33.217011  3315 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.571424  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:33.567380  3293 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.818s	user 0.004s	sys 0.007s
I20260709 13:00:33.250550  3260 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:33.352595  1691 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:33.456156  3137 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:33.540735  1687 rpcz_store.cc:276] 0709 13:00:32.354252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.354419 (+   167us) service_pool.cc:224] Handling call
0709 13:00:33.451619 (+1097200us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400433854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.451779 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96211712}
I20260709 13:00:33.334901  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:33.372442  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:33.627463  3187 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.430s	user 0.034s	sys 0.014s
I20260709 13:00:33.617502  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:33.574633  3167 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.620293  3314 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.623202  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.649539  1621 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.416249  3343 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.219532  3321 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.607246  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:33.654002  2263 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:33.608167  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:33.547322  1695 rpcz_store.cc:269] 0709 13:00:31.479871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.820741 (+340870us) service_pool.cc:224] Handling call
0709 13:00:33.159724 (+1338983us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001f77d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.174749 (+ 15025us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548889344}
I20260709 13:00:33.645707  3292 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:33.643738  1512 leader_election.cc:400] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:33.648519  1616 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.652868  2266 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:33.633874  1693 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.616632  3294 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.635097  3209 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:33.655689  3206 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.003s
W20260709 13:00:33.656849  1617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.280s	user 0.028s	sys 0.086s
W20260709 13:00:33.675743  1617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.028s	sys 0.086s
I20260709 13:00:33.646642  3325 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:33.658397  1512 leader_election.cc:403] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.639357  3293 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.658357  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.672255  1659 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:33.640946  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 70688.4us
I20260709 13:00:33.679185  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:33.679917  1621 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:33.646917  3137 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.690083  3137 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:33.690358  3209 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.657747  1614 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:33.686873  3306 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.688041  3268 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:33.691684  1618 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:33.688233  3315 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.696440  1587 leader_election.cc:400] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:33.714871  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.038s	sys 0.034s
I20260709 13:00:33.694922  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:33.716079  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:33.716837  1620 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:33.716928  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.038s	sys 0.034s
I20260709 13:00:33.715039  1587 leader_election.cc:403] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:00:33.676829  3243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.030s	sys 0.105s
I20260709 13:00:33.713148  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:33.653543  3167 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:33.693871  3140 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.019s	sys 0.058s
W20260709 13:00:33.736663  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1089) took 1618 ms (client timeout 2017 ms). Trace:
I20260709 13:00:33.690984  3321 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:33.740106  2262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.381s	user 0.002s	sys 0.015s
W20260709 13:00:33.740444  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44192.7us
I20260709 13:00:33.691100  3328 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
W20260709 13:00:33.744199  1618 rpcz_store.cc:269] 0709 13:00:32.118117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.229331 (+111214us) service_pool.cc:224] Handling call
0709 13:00:33.736479 (+1507148us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002a7bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:33.736607 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3078397312}
W20260709 13:00:33.744714  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.014s	sys 0.030s
I20260709 13:00:33.736692  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:33.692574  3325 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:33.739807  3243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.031s	sys 0.106s
W20260709 13:00:33.750494  1689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.120s	user 0.030s	sys 0.060s
W20260709 13:00:33.748869  2262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.390s	user 0.002s	sys 0.015s
W20260709 13:00:33.706645  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.032s	sys 0.048s
W20260709 13:00:33.704670  3349 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.075s	user 0.041s	sys 0.086s
I20260709 13:00:33.768405  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.753072  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.684834  3206 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:33.773135  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.015s	sys 0.030s
W20260709 13:00:33.766664  1689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.031s	sys 0.060s
W20260709 13:00:33.773640  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 821274us
I20260709 13:00:33.766323  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.750564  3354 ts_tablet_manager.cc:933] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
I20260709 13:00:33.741449  3292 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:33.747496  3321 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:33.706349  3081 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:00:33.746780  3187 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.704162  3209 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.844923  3209 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:33.744980  3140 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.019s	sys 0.059s
I20260709 13:00:33.747599  3342 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:33.848842  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.435s	user 0.034s	sys 0.043s
W20260709 13:00:33.849257  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.436s	user 0.034s	sys 0.043s
I20260709 13:00:33.808790  3328 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:33.816156  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:33.775972  3349 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.042s	sys 0.087s
I20260709 13:00:33.784780  3343 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:33.824419  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49971.9us
I20260709 13:00:33.876960  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:33.877735  1616 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
W20260709 13:00:33.849637  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 1.43651e+06us
W20260709 13:00:33.775722  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.033s	sys 0.048s
I20260709 13:00:33.890071  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:33.924892  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:33.816988  3321 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.810197  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.937615  3206 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.846184  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:33.938211  3206 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.938868  3302 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.939435  3302 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.850970  3137 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:33.850770  3187 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.936262  3167 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.934494  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.937188  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.948381  1616 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:33.926465  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:33.943269  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.932804  3168 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:33.937397  3292 raft_consensus.cc:2764] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:00:33.942643  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:33.942950  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.942582  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.952666  1622 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.952440  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.950927  1618 raft_consensus.cc:2368] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:33.954752  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.954814  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:33.955520  1620 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:33.871734  3209 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.963857  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.952469  1621 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.964644  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:33.949517  1615 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:33.966269  1693 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.953600  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.967785  1622 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:33.941427  3081 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.966204   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:33.849555  3225 consensus_meta.cc:287] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.005s
W20260709 13:00:33.972690  2231 connection.cc:256] RPC call timeout handler was delayed by -1.3413457679999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 13:00:33.963857  3209 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:33.952422  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:33.965276  1618 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:33.986438  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:33.941061  3325 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.941424  3302 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.990469  2263 raft_consensus.cc:1217] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:00:33.991093  2264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.313s	user 0.030s	sys 0.034s
W20260709 13:00:33.970892  3230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.013s	sys 0.020s
I20260709 13:00:34.001995  3293 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:34.002439  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:34.002439  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.007874  3294 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:33.956110  3137 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.009598  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:33.940479  3206 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:33.993544  1616 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:33.994402  3314 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:33.985759  3292 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:33.998577  2264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.030s	sys 0.034s
W20260709 13:00:33.966204  3227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.004s	sys 0.027s
I20260709 13:00:33.970665  3278 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:33.970132  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:33.957324  3328 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:34.010107  2258 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:33.992601  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:33.871939  3342 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:34.034191  3241 consensus_meta.cc:287] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.838s	user 0.014s	sys 0.000s
W20260709 13:00:34.015671  3230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.013s	sys 0.020s
I20260709 13:00:33.984964  3081 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.040410  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:34.048370  3241 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:34.028283  3227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.353s	user 0.004s	sys 0.028s
I20260709 13:00:34.045420  2260 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:34.038642  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:34.056059  2230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.027s	sys 0.035s
W20260709 13:00:34.057152  2230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.027s	sys 0.035s
W20260709 13:00:34.057715  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 1.04136e+06us
I20260709 13:00:34.045925  3328 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.993700  3225 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.045081  3278 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:34.065588  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:34.050189  3268 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:34.027429  3206 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:34.083849  1692 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.402s	user 0.017s	sys 0.045s
W20260709 13:00:34.084342  1692 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.017s	sys 0.045s
I20260709 13:00:34.096733  1691 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:34.097970  2230 leader_election.cc:400] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4.
W20260709 13:00:34.090269  3281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.387s	user 0.013s	sys 0.025s
W20260709 13:00:34.100351  3281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.014s	sys 0.025s
I20260709 13:00:34.070236  3137 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:34.110930  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:34.103271  3334 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.017s	sys 0.013s
I20260709 13:00:34.106899  3187 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:34.184741  3334 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.017s	sys 0.014s
I20260709 13:00:34.185170  3334 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:34.186188  3334 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:34.187108  3209 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:34.103056  3342 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:34.168510  3281 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:34.176863  3278 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.096225  2261 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:34.127246  3337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.012s	sys 0.021s
W20260709 13:00:34.109342  3283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.005s	sys 0.026s
W20260709 13:00:34.243755  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.006s	sys 0.019s
W20260709 13:00:34.244175  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.006s	sys 0.019s
W20260709 13:00:34.242756  3283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.168s	user 0.006s	sys 0.028s
W20260709 13:00:34.241204  3337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.013s	sys 0.021s
W20260709 13:00:34.245645  3305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.012s	sys 0.012s
I20260709 13:00:34.272365  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:34.245766  3179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.001s	sys 0.023s
W20260709 13:00:34.265746  3331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.008s	sys 0.017s
W20260709 13:00:34.245865  3141 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.002s	sys 0.024s
I20260709 13:00:34.274828  1696 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:34.266745  3338 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:34.278013  3141 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.002s	sys 0.024s
W20260709 13:00:34.274675  3305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.012s	sys 0.013s
I20260709 13:00:34.242364  3281 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.293304  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1198) took 1218 ms. Trace:
I20260709 13:00:34.296904  1696 rpcz_store.cc:276] 0709 13:00:33.075158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.619771 (+544613us) service_pool.cc:224] Handling call
0709 13:00:33.639445 (+ 19674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.277131 (+637686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.293046 (+ 15915us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400451854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:34.293239 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455195520}
W20260709 13:00:34.281567  3351 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 13:00:34.296090  3306 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.004s
I20260709 13:00:34.292390  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1390) took 1947 ms. Trace:
I20260709 13:00:34.273924  3241 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:34.276752  3331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.217s	user 0.008s	sys 0.018s
I20260709 13:00:34.289841  3225 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:34.295706  3206 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:34.277618  3179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.001s	sys 0.023s
I20260709 13:00:34.299928  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.316193  3081 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:34.318063  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:34.311224  3361 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:00:34.304842  3306 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.304246  1613 rpcz_store.cc:276] 0709 13:00:32.344604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.522533 (+177929us) service_pool.cc:224] Handling call
0709 13:00:32.567047 (+ 44514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.567433 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.567469 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.567976 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.936443 (+1368467us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:33.936489 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.936563 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.292089 (+355526us) raft_consensus.cc:1685] finished
0709 13:00:34.292117 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.292315 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":1355391,"threads_started":1,"wal-append.queue_time_us":1600462}
W20260709 13:00:34.330111  3341 consensus_meta.cc:287] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.002s
I20260709 13:00:34.330742  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 633) took 1944 ms. Trace:
I20260709 13:00:34.332995  2264 rpcz_store.cc:276] 0709 13:00:32.386714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.551411 (+164697us) service_pool.cc:224] Handling call
0709 13:00:32.589893 (+ 38482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.601515 (+ 11622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.601555 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.617687 (+ 16132us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.019644 (+1401957us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.019722 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.019898 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.330454 (+310556us) raft_consensus.cc:1685] finished
0709 13:00:34.330477 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.330687 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10649,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":1340971,"threads_started":1,"wal-append.queue_time_us":1654896}
W20260709 13:00:34.325783  3242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.019s	sys 0.019s
W20260709 13:00:34.339356  1544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.011s	sys 0.020s
W20260709 13:00:34.344076  1544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.011s	sys 0.020s
W20260709 13:00:34.344882  2265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.006s	sys 0.018s
W20260709 13:00:34.345258  2265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.006s	sys 0.018s
I20260709 13:00:34.346138  3335 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:34.346782  3335 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.347970  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 262) took 2131 ms. Trace:
I20260709 13:00:34.348400  2265 rpcz_store.cc:276] 0709 13:00:32.216805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.218875 (+  2070us) service_pool.cc:224] Handling call
0709 13:00:32.239086 (+ 20211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.239281 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:33.538868 (+1299587us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.345918 (+807050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.345975 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.346019 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.347750 (+  1731us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.347885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1759570,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":90,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":2105662,"threads_started":2}
W20260709 13:00:34.361899  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.007s	sys 0.018s
W20260709 13:00:34.343416  3242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.019s	sys 0.019s
W20260709 13:00:34.416491  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.019s	sys 0.015s
W20260709 13:00:34.416684  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.007s	sys 0.018s
W20260709 13:00:34.363094  2259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.011s	sys 0.029s
W20260709 13:00:34.417081  1585 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.015s	sys 0.018s
W20260709 13:00:34.362419  3358 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:00:34.381784  1619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.005s	sys 0.017s
I20260709 13:00:34.331153  3321 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:34.417932  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1386) took 2616 ms. Trace:
W20260709 13:00:34.425203  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 325174us
I20260709 13:00:34.343753  3341 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.410101  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:34.411716  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.008s	sys 0.017s
W20260709 13:00:34.416231  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.008s	sys 0.030s
W20260709 13:00:34.416838  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.019s	sys 0.015s
W20260709 13:00:34.423826  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.004s	sys 0.004s
I20260709 13:00:34.404942  3335 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:34.417393  1585 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.015s	sys 0.018s
W20260709 13:00:34.423641  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.014s
W20260709 13:00:34.380573  2257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.020s	sys 0.004s
W20260709 13:00:34.432677  1619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.017s
W20260709 13:00:34.417330  2259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.011s	sys 0.029s
I20260709 13:00:34.458534  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-01e623ba813c4c3a8152a1de588cda91 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:00:34.459146  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-01e623ba813c4c3a8152a1de588cda91 on tablet 01e623ba813c4c3a8152a1de588cda91 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.460825  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 464) took 2112 ms. Trace:
W20260709 13:00:34.461067  3364 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:00:34.461277  2262 rpcz_store.cc:276] 0709 13:00:32.348674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.348800 (+   126us) service_pool.cc:224] Handling call
0709 13:00:32.349090 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.349412 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.349437 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.349850 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.767385 (+1417535us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:33.767446 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.767559 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.460598 (+693039us) raft_consensus.cc:1685] finished
0709 13:00:34.460620 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.460755 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":624,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":8219,"thread_start_us":1408140,"threads_started":1,"wal-append.queue_time_us":1748052}
W20260709 13:00:34.432886  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.003s	sys 0.019s
W20260709 13:00:34.463943  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.003s	sys 0.019s
I20260709 13:00:34.425110  2260 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:34.435433  3321 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:34.384608  1694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.006s	sys 0.020s
W20260709 13:00:34.471889  1694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.006s	sys 0.020s
W20260709 13:00:34.435904  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.021s	sys 0.027s
I20260709 13:00:34.440544  3302 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:34.445315  3168 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.478768  1443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 304) took 5961 ms. Trace:
I20260709 13:00:34.480717  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 200) took 6811 ms. Trace:
W20260709 13:00:34.456099  2257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.021s	sys 0.004s
W20260709 13:00:34.448457  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.008s	sys 0.030s
W20260709 13:00:34.448632  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.004s	sys 0.007s
W20260709 13:00:34.454856  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.010s	sys 0.014s
W20260709 13:00:34.454344  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 661088us
W20260709 13:00:34.483727  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 747110us
I20260709 13:00:34.456780  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 229) took 2535 ms. Trace:
I20260709 13:00:34.468792  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:34.433434  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 507041us
I20260709 13:00:34.486159  1512 leader_election.cc:400] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:34.486451  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:34.487215  1512 leader_election.cc:400] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:34.487491  1512 leader_election.cc:403] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:34.472347  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:34.472968  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.021s	sys 0.027s
I20260709 13:00:34.485638  1619 rpcz_store.cc:276] 0709 13:00:31.921904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.388693 (+466789us) service_pool.cc:224] Handling call
0709 13:00:32.396149 (+  7456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.396399 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:33.717699 (+1321300us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.456457 (+738758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.456505 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.456556 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.456617 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.456726 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1652417,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":2715,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":2040817,"threads_started":2}
I20260709 13:00:34.434480  3343 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:34.510582  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:34.490685  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.452221  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.479223  1443 rpcz_store.cc:276] 0709 13:00:28.514664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.514798 (+   134us) service_pool.cc:224] Handling call
0709 13:00:30.503616 (+1988818us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54003c8554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a844090 00007f7f1a8e2f3a 00007f7f206991cc 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc 00007f7f1ec57392 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:34.476429 (+3972813us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48261,"reported_tablets":1,"spinlock_wait_cycles":1542565760}
I20260709 13:00:34.429766  1617 rpcz_store.cc:276] 0709 13:00:31.801928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.376419 (+574491us) service_pool.cc:224] Handling call
0709 13:00:32.376681 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.376865 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:33.676129 (+1299264us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.417594 (+741465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.417645 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.417685 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.417753 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.417874 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1671717,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":133,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":80,"thread_start_us":2039590,"threads_started":2}
I20260709 13:00:34.495441  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.495029  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:34.448333  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.008s	sys 0.017s
I20260709 13:00:34.492213  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.550418  3354 tablet_copy_client.cc:323] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34175
I20260709 13:00:34.484293  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1892) took 1979 ms. Trace:
I20260709 13:00:34.491046  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.487920  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:34.553361  1689 rpcz_store.cc:276] 0709 13:00:32.505199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.629371 (+124172us) service_pool.cc:224] Handling call
0709 13:00:32.629678 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.630040 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:33.773783 (+1143743us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.483968 (+710185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.484018 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:34.484070 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.484136 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.484244 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1179802,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":15493,"thread_start_us":1853295,"threads_started":2}
I20260709 13:00:34.601438  1445 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:34.656726  3369 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:00:34.601776  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.605113  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.481238  1444 rpcz_store.cc:276] 0709 13:00:27.663239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.663380 (+   141us) service_pool.cc:224] Handling call
0709 13:00:34.474954 (+6811574us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:31.344465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:31.361052 (+ 16587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:31.361103 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:00:31.361129 (+    26us) tablet.cc:662] Decoding operations
0709 13:00:31.361552 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:31.361629 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:31.361670 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:31.361914 (+   244us) tablet.cc:701] Row locks acquired
0709 13:00:31.361939 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:00:31.362117 (+   178us) write_op.cc:270] Start()
0709 13:00:31.362256 (+   139us) write_op.cc:276] Timestamp: P: 1783602031362059 usec, L: 0
0709 13:00:31.362285 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:31.363147 (+   862us) log.cc:844] Serialized 536 byte log entry
0709 13:00:32.041811 (+678664us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b
0709 13:00:32.629500 (+587689us) op_driver.cc:464] REPLICATION: finished
0709 13:00:34.063526 (+1434026us) write_op.cc:301] APPLY: starting
0709 13:00:34.063647 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:34.063773 (+   126us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:34.063806 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:34.064133 (+   327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:34.064340 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:34.064408 (+    68us) write_op.cc:312] APPLY: finished
0709 13:00:34.101590 (+ 37182us) log.cc:844] Serialized 23 byte log entry
0709 13:00:34.423954 (+322364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.424065 (+   111us) write_op.cc:454] Released schema lock
0709 13:00:34.424117 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:34.424477 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.424513 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":241397,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":1433729,"apply.run_cpu_time_us":31480,"apply.run_wall_time_us":360943,"num_ops":1,"prepare.queue_time_us":517075,"prepare.run_cpu_time_us":17580,"prepare.run_wall_time_us":856071,"raft.queue_time_us":487383,"raft.run_cpu_time_us":139243,"raft.run_wall_time_us":1293926,"replication_time_us":1267036,"spinlock_wait_cycles":12201216,"thread_start_us":3225321,"threads_started":5,"wal-append.queue_time_us":771197,"wal-append.run_cpu_time_us":28444,"wal-append.run_wall_time_us":1531251}]]}
I20260709 13:00:34.658257  1538 raft_consensus.cc:2376] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4. Re-sending same reply.
I20260709 13:00:34.658634  1541 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:34.574316  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.591992  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.605898  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:34.667842  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 76766us
W20260709 13:00:34.600569  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 101359us
I20260709 13:00:34.574425  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:34.473997  3291 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:34.605118  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.482504  3281 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:34.574738  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:34.474813  3302 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:34.602458  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1899) took 2034 ms. Trace:
I20260709 13:00:34.616756  1618 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:34.483199  3168 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:34.482318  3225 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.307s
I20260709 13:00:34.626888  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:34.613101  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.601076  1543 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:34.599929  1620 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:34.657159  1445 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.739945  1616 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:34.740428  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 255484us
I20260709 13:00:34.740617  1542 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3. Re-sending same reply.
W20260709 13:00:34.478832  3375 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:34.745985  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:34.903621  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 415784us
I20260709 13:00:34.590332  3338 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:34.601446  3167 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.904376  1546 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:34.904443  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:34.903213  1621 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:34.818193  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:34.905723  1691 raft_consensus.cc:2368] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:34.907804  1587 leader_election.cc:400] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:34.910588  1543 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:34.911044  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.765313  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.878412  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.911726  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.911656  1542 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.908109  1587 leader_election.cc:403] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:34.836192  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 1949) took 2376 ms. Trace:
I20260709 13:00:34.902205  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:34.806373  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.868383  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:34.764379  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.919308  1538 raft_consensus.cc:2368] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:34.829835  1695 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:34.913229  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.797260  1585 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.913208  1445 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:34.920972  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 283918us
I20260709 13:00:34.903193  1619 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:34.922094  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 124937us
I20260709 13:00:34.922030  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.923364  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.913318  1546 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:34.613409  3334 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:34.903040  1692 rpcz_store.cc:276] 0709 13:00:32.568182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.674514 (+106332us) service_pool.cc:224] Handling call
0709 13:00:32.676567 (+  2053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.676816 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:34.084781 (+1407965us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.602116 (+517335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.602176 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:34.602218 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.602282 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.602396 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26564,"prepare.queue_time_us":1198854,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":280684,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":1802428,"threads_started":2,"wal-append.queue_time_us":733975}
I20260709 13:00:34.614192  3321 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:34.896153  3374 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
I20260709 13:00:34.660998  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 261) took 2400 ms. Trace:
I20260709 13:00:34.935524  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:34.857450  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.924328  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:34.601784  3081 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.323s
I20260709 13:00:34.924788  3395 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.924726  3408 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.925052  3337 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:34.925137  3314 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:34.925830  3398 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.932220  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 267) took 1656 ms. Trace:
I20260709 13:00:34.908478  3141 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.934674  1585 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.934756  1538 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:34.859613  3377 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
I20260709 13:00:34.935930  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1185) took 2083 ms. Trace:
I20260709 13:00:34.807906  3305 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.927294  3397 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:34.937958  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.836405  3339 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:34.942589  1542 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:34.765079  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:34.918114  1544 rpcz_store.cc:276] 0709 13:00:32.459844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.021897 (+562053us) service_pool.cc:224] Handling call
0709 13:00:33.420512 (+398615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.420788 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:34.344528 (+923740us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.810134 (+465606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.810203 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:34.810260 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.810361 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.835962 (+ 25601us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000479d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:34.836116 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265265,"prepare.queue_time_us":1001759,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":280159,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":25837,"spinlock_wait_cycles":915813248,"thread_start_us":1133625,"threads_started":2,"wal-append.queue_time_us":447648}
I20260709 13:00:34.924989  3167 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:34.946368  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:34.941268  3334 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:34.999603  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53575.4us
I20260709 13:00:35.000478  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:35.001880  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.919976  1541 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:34.946830  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:34.933007  3396 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:34.961925  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:34.986749  1694 rpcz_store.cc:276] 0709 13:00:32.853047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.579162 (+726115us) service_pool.cc:224] Handling call
0709 13:00:33.579492 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.579708 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.579732 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.580225 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.472362 (+892137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.472416 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.472519 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.935730 (+463211us) raft_consensus.cc:1685] finished
0709 13:00:34.935748 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.935872 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":891748,"threads_started":1,"wal-append.queue_time_us":995062}
W20260709 13:00:34.988436  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 53863us
I20260709 13:00:35.003401  1616 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:34.986847  3370 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:35.004454  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:34.923641  1587 leader_election.cc:400] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:34.937361  3321 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:34.956246  3209 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.956648  3172 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:34.992799  1539 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:34.992817  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.992301  3341 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:34.993603  3400 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:00:34.993675  3384 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:00:34.994311  3404 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:00:34.996307  3378 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.575s	user 0.002s	sys 0.011s
I20260709 13:00:34.788424  3343 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:34.997960  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.998085  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.923604  1445 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 3, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:34.960064  3337 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:34.929811  1543 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:34.989738  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.002604  1538 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.005237  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:35.001129  1614 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.263s	user 0.013s	sys 0.000s
W20260709 13:00:35.003913  3376 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.581s	user 0.003s	sys 0.000s
I20260709 13:00:34.989687  3293 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.004926  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:35.006433  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.021099  1541 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.021744  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:35.005620  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 82101.7us
I20260709 13:00:35.014916  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 224) took 1057 ms. Trace:
I20260709 13:00:35.023705  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:35.014786  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.024827  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.023960  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.015329  1445 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 4, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:35.006037  3395 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.025946  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.026386  1541 raft_consensus.cc:2368] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:35.006117  3225 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:35.026780  3305 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.010115  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 168) took 3225 ms. Trace:
I20260709 13:00:35.027338  3225 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.017289  3187 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:35.028493  3187 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.027223  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.028313  3225 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.029640  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.017812  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 229) took 1012 ms. Trace:
I20260709 13:00:35.007758  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:34.959345  3302 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.014269  3167 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.005775  3394 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:00:35.044047  1539 raft_consensus.cc:2376] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4. Re-sending same reply.
I20260709 13:00:35.045095  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:34.988935  2257 rpcz_store.cc:276] 0709 13:00:33.276219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.333460 (+ 57241us) service_pool.cc:224] Handling call
0709 13:00:33.333964 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.334450 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.334494 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.637104 (+302610us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.639845 (+1002741us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.658003 (+ 18158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.788578 (+130575us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.932016 (+143438us) raft_consensus.cc:1685] finished
0709 13:00:34.932041 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.932162 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3792,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":9101,"thread_start_us":809334,"threads_started":1,"wal-append.queue_time_us":1268548}
I20260709 13:00:35.045629  1539 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:35.035028  3396 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.046927  3396 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.038872  3260 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:00:35.030403  1690 rpcz_store.cc:276] 0709 13:00:34.005658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.011372 (+  5714us) service_pool.cc:224] Handling call
0709 13:00:34.037019 (+ 25647us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.037973 (+   954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.038023 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.041598 (+  3575us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.462231 (+420633us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:34.462267 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.462330 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.017602 (+555272us) raft_consensus.cc:1685] finished
0709 13:00:35.017621 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.017755 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1174,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":2142,"thread_start_us":401958,"threads_started":1,"wal-append.queue_time_us":890445}
W20260709 13:00:35.007812  3401 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:35.018922  3370 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:35.036248  3293 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.048924  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.035157  1613 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:35.049540  3370 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.050145  1540 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:35.050791  3370 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.035281  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.054005  3260 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.017989  3281 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:35.054883  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.055114  3281 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.005966  3081 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.055945  3281 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.037427  3168 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.058506  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.013496  1544 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:35.059689  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.059820  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.060132  3408 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.060369  1544 raft_consensus.cc:2376] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3. Re-sending same reply.
I20260709 13:00:35.060532  3398 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.060629  3408 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.023988  1695 rpcz_store.cc:276] 0709 13:00:33.958019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.964127 (+  6108us) service_pool.cc:224] Handling call
0709 13:00:35.014783 (+1050656us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540040e054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:35.014868 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716857216}
W20260709 13:00:35.014989  3328 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.945s	user 0.005s	sys 0.006s
I20260709 13:00:35.062808  3328 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:35.064296  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.064863  1615 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:35.064973  3328 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.027369  3141 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:35.065734  3408 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.066037  3141 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:35.066476  3141 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.066767  3302 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.066956  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:35.054924  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.067677  1547 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 2: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.067718  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.013232  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.060393  1618 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:35.068960  1542 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:35.008587  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.070470  1546 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.044121  3394 consensus_queue.cc:1243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:35.029315  3187 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.047852  3396 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.027904  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.046449  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.071681  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.211651  3302 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.067164  2261 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:35.212725  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 184893us
I20260709 13:00:34.943156  2259 rpcz_store.cc:276] 0709 13:00:32.216530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.241810 (+ 25280us) service_pool.cc:224] Handling call
0709 13:00:33.365353 (+1123543us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5eee 0000000000375939 00007f7f1f8291e0 00007f7f1f8f20c4 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:33.365584 (+   231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.567567 (+201983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.576417 (+  8850us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.644315 (+ 67898us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.458881 (+814566us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:34.458924 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.458995 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.462060 (+  3065us) raft_consensus.cc:1685] finished
0709 13:00:34.467996 (+  5936us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.617011 (+149015us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24653,"raft.queue_time_us":12650,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":2373,"spinlock_wait_cycles":96438144,"thread_start_us":788354,"threads_started":1,"wal-append.queue_time_us":812182}
I20260709 13:00:35.135779  3291 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.213973  3225 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:35.119861  3293 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:35.215167  3293 consensus_queue.cc:1243] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:35.213950  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.215806  3293 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.216176  3293 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.216339  3167 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.217082  3293 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.218019  3293 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.135082  1541 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:35.124046  3334 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.106458  1511 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:35.215193  3225 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:35.219416  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 113074us
I20260709 13:00:35.219638  3225 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:35.183121  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 362220us
W20260709 13:00:35.104213  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49863.3us
I20260709 13:00:35.220482  3225 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.221076  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.220485  1511 leader_election.cc:400] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:35.221740  3225 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.222455  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.223058  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.018321  1614 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:35.223534  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.224015  3315 raft_consensus.cc:2764] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:00:35.224877  3417 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.111794  3342 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.014245  3337 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.005851  3388 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 13:00:35.154302  3260 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.226434  3260 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.226461  3337 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.223058  3187 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.228492  3187 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:35.189145  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 300825us
W20260709 13:00:35.179268  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 291923us
I20260709 13:00:35.228863  3187 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:35.178838  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 173050us
I20260709 13:00:35.231356  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:35.232456  2230 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:35.130007  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.204437  1546 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:35.015862  3172 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.169457  3141 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:35.233507  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 103589us
I20260709 13:00:35.113564  3397 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:00:35.235087  3141 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.235641  3141 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.236075  3417 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.236320  1696 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:35.236594  3343 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.237100  3343 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.237605  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:35.223903  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1397) took 1689 ms (client timeout 2090 ms). Trace:
I20260709 13:00:35.238440  1541 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:35.239012  3343 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.236604  3417 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.241384  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.242566  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.242887  3417 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.236266  3141 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.243845  3141 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.244107  3397 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:35.244652  3397 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.244757  3141 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.245898  3141 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.246728  1615 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:35.247219  1619 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:35.228796  3260 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.248644  3291 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:35.249063  3291 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:35.249436  3291 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.250391  3393 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.252544  3393 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.252880  3393 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:35.253209  3393 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.178237  3209 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:35.254361  3209 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.256806  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.105562  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.257933  3106 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.258277  1538 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.122385  1544 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:35.258767  3137 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:35.259147  1544 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:35.259425  1511 leader_election.cc:400] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:35.275771  1511 leader_election.cc:403] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.276728  3343 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:35.277069  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.218348  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:35.220314  3418 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:35.278512  3418 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:35.278939  3418 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.279750  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.280208  1538 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:35.280414  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62944.7us
I20260709 13:00:35.281234  3315 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.281713  3315 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.113431  3328 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.282670  3417 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.282861  3328 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.283761  3315 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.284556  3315 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.284479  3291 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:35.226518  3390 consensus_queue.cc:1175] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:00:35.285864  3328 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.101361  3338 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:35.111693  1445 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 2, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:00:35.287093  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.288166  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.291378  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.292124  3417 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.292909  3417 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.293524  3417 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.294734  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.295346  1547 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.295449  3417 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.296604  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.126780  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.297472  3417 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.139428  1542 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:35.280959  3393 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.015969  3321 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.259286  3137 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.299120  1692 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:35.299175  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.300024  3338 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.300416  3338 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:35.300681  3137 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.300772  3338 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.259975  1544 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.301625  1544 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.302825  3393 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.303339  3393 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.303385  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:35.314651  3393 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.317137  1540 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:35.317344  3393 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.223861  3370 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.258443  3106 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.266526  1546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "459063895bc847b9a15dc71e10b36267"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:00:35.261255  3172 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.027642  1545 rpcz_store.cc:276] 0709 13:00:31.785687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.785943 (+   256us) service_pool.cc:224] Handling call
0709 13:00:31.798674 (+ 12731us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.810570 (+ 11896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.810631 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.336439 (+1525808us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b2c00000658. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:00:33.336912 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.244577 (+907665us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:34.244610 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.245474 (+   864us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.883479 (+638005us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:35.009895 (+126416us) raft_consensus.cc:1685] finished
0709 13:00:35.009930 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.010041 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11555,"raft.queue_time_us":56418,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12138,"spinlock_wait_cycles":53241472,"thread_start_us":907237,"threads_started":1,"wal-append.queue_time_us":1083436}
I20260709 13:00:35.270262  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.259876  3223 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:35.260535  3388 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:35.271550  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48562.2us
W20260709 13:00:35.322686  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 52517us
I20260709 13:00:35.325227  3388 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:35.307055  3417 consensus_queue.cc:1175] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:35.272157  3397 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.273213  1539 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:35.327690  3137 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:35.326076  3388 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:35.328540  3339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:00:35.328675  3388 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.274995  1557 tablet_copy_service.cc:140] P 9fbc4df0bb934bba941cfa20c0afead2: Received BeginTabletCopySession request for tablet 459063895bc847b9a15dc71e10b36267 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:35956)
I20260709 13:00:35.330132  1557 tablet_copy_service.cc:161] P 9fbc4df0bb934bba941cfa20c0afead2: Beginning new tablet copy session on tablet 459063895bc847b9a15dc71e10b36267 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:35956: session id = e51b0b5dc04b4f5aaf6a3a870f291345-459063895bc847b9a15dc71e10b36267
I20260709 13:00:35.331291  1618 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:00:35.238179  1614 rpcz_store.cc:269] 0709 13:00:33.535008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.547444 (+ 12436us) service_pool.cc:224] Handling call
0709 13:00:35.223841 (+1676397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.285341  3315 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.344347  3315 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.287788  1445 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 2, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:00:35.255105  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.241492  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.281900  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.288769  3396 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:35.298811  3415 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.263965  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.318912  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.319828  1546 raft_consensus.cc:606] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.327934  3106 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.248235  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:35.336815  3223 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.337141  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.338510  3225 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.374373  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.374658  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.331843  3190 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:35.375089  1614 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:35.342164  1615 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:35.375481  3190 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:35.360832  3393 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:35.376441  3190 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.377360  1615 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:35.353315  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 71531.9us
I20260709 13:00:35.378189  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:35.379127  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:35.380796  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:35.381537  1690 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.355842  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:35.356976  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 108835us
I20260709 13:00:35.358566  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.360735  1618 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:35.367022  3242 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:35.368172  3415 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:35.368302  3370 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.370373  3366 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:35.371645  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.372080  3223 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.318135  3321 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.340910  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.384066  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:35.384097  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.381107  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:35.385267  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.317638  3338 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.377206  3393 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.392409  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:35.393088  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:35.393368  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:35.411330  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.412559  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.398991   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:00:35.354876  3397 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.400758  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.422695  1545 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:35.424489  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.399629  3390 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.402462  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.360672  3281 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:35.414511   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:35.393770  3260 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:35.393671  3328 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.439764  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.415414  1546 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.405839  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:35.444407  1696 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.398774  3415 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.401710  1695 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:35.427397  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.428352  3389 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.429081  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.430042  1587 leader_election.cc:400] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:35.447513  1587 leader_election.cc:403] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.400900  3337 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:00:35.400719  3227 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.437795  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.439543  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.449944  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.434535  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.458141  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.458565  1544 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.430008  3390 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.375326  3187 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.452128  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.405037  3418 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.431828  3283 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.408481  3209 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.429622  3343 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:00:35.467268  1587 leader_election.cc:400] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:35.489076  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.435751  3388 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:35.448302  3242 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.463107  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.445425  3328 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:35.480919  3283 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.436563  3331 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:00:35.483033  3291 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.485504  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.491828  3167 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.470343  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.521574  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.523000  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.523572  1616 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:35.489724  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:35.455180  3225 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:35.494246  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 122703us
I20260709 13:00:35.527688  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:35.493000  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.493695  1692 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:35.497717  3398 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.451790  3396 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:35.478102  1694 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:35.445479  3141 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:00:35.454392  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58705.4us
I20260709 13:00:35.468711  3390 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.468191  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:35.446333  3241 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:35.443645  3281 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.490762  1542 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:35.499965  3328 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.529541  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.496330  1696 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:35.531924  3172 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.509116  3168 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:35.510524  3283 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.537215  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:35.595268  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 58132.7us
I20260709 13:00:35.540323  3187 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:35.544637  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.572690  3223 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:35.574765  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:35.586128  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56792us
I20260709 13:00:35.544564  3291 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.522289  3397 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:00:35.575351  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:35.616297  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.561486  3230 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:35.618026  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.628577  1619 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:35.581084  3209 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.533030  3167 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.581281  3293 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:35.579974  3106 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:35.630062  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:35.616583  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.594568  3168 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:35.591763  3172 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.588945  3343 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.631783  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:35.618026  3281 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.574546  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:35.617830  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.616982  3441 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:35.709887  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 68185.8us
I20260709 13:00:35.597695  2261 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:00:35.711061  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 211402us
I20260709 13:00:35.627859  3230 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.625192  3223 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:35.717689  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 102245us
W20260709 13:00:35.709569  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.636368  3209 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:35.631726  3321 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.597361  3315 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:35.723800  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 321610us
I20260709 13:00:35.619053  3405 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:00:35.640169  3293 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.709213  3168 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.709390  3260 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:35.713876  3371 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.736621  3278 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:35.716307  3106 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.767596  1621 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:35.713626  3334 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:35.726253  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.767683  3223 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.768923  3209 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:35.780150  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:35.787559  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 61380.9us
I20260709 13:00:35.789042  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.789582  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.711730  3366 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:35.794591  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.796161  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.796772  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.797561  3397 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.805749  1661 leader_election.cc:400] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
I20260709 13:00:35.806107  1661 leader_election.cc:403] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:35.809916  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:35.788546  3334 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:35.811812  3334 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.812057  2260 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:35.791410  3278 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.786368  3418 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.785145  3371 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:35.818874  3371 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:35.821270  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:35.820894  3227 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3.
W20260709 13:00:35.844208  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 122050us
W20260709 13:00:35.848588  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.849556  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:35.793155  3452 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:35.802309  3241 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.872337  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:35.872706  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:35.786513  3441 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:00:35.875252  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:35.848919  3444 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.890722  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:35.771051  3230 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.771082  3293 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:35.832614  3306 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:00:35.859378  3179 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:00:35.789129  3172 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:35.921280  3453 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:35.876799  3443 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:35.876016  3241 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.917382  3454 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:35.977901  3167 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:35.935566  3230 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:35.936643  3342 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:35.979604  3439 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:00:36.017604  3241 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.015486  3373 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:36.018913  3446 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:00:36.019520  3453 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:36.020162  3454 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:36.021384  3106 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:35.979833  3278 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.028681  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.039079  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:36.036454  3415 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.002s
I20260709 13:00:36.048142  1542 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 2: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:35.916738  3260 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.081461  3454 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:35.919850  3366 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.047916  3283 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:36.100677  3242 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.600s	user 0.004s	sys 0.008s
I20260709 13:00:36.101576  3242 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.052011  3415 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.047207  3453 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:36.105161  3453 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.028771  3390 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.040597  3373 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.121361  3390 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:36.060432  3168 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.122442  1691 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:36.061897  1617 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:36.097311  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.123754  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:36.073890  3334 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.064375  3328 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.106973  3315 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.107687  2257 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:36.106317  3415 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.056494  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.110999  3283 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.115028  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:36.116364  1696 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:00:36.132982  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 76610.7us
I20260709 13:00:36.124923  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.062664  1616 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:36.131595  1694 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.137400  1619 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.137926  3291 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:36.138322  3291 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.138398  3168 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.139593  3373 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.142827  3338 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.144634  3328 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.145448  1542 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.084297  3454 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.139292  3291 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.150125  3190 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:36.153697  3190 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:36.154117  3190 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.152328  1540 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:00:36.157966  3291 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.150207  3242 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.164311  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:36.163686  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:36.166028  3137 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:36.166911  1692 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:36.169448  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 296822us
I20260709 13:00:36.170123  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:36.174503  3137 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:36.175027  3137 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.176074  3137 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.177254  1621 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
W20260709 13:00:36.178315  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 303147us
W20260709 13:00:36.180856  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.181427  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:36.183271  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.183610  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.184163  1547 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:36.170135  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.184360  1545 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.184880  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:36.185459  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:36.189141  1541 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:36.186270  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.190831  1617 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:36.200153  3137 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.177800  3371 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.202241  3283 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.203223  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.202039  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.212877  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.215161  3179 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.216104  3172 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.201802  3278 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.217849  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.222890  3293 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.223887  3393 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.224670  3443 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.225049  3443 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:36.228745  3334 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.204849  3448 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:00:36.229880  3448 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:36.212397  3283 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:36.230535  3283 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.230904  3321 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.231380  3321 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:36.232402  3321 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:36.202538  3190 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.236245  3190 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.239806  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.241315  3371 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:36.218160  3337 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.230213  3448 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.230167  3223 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.245718  3448 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.263376  3448 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.263752  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.250468  2231 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.267397  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:36.268677  3291 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.270118  3225 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:36.270565  3225 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:36.276630  3225 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.252158  3209 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.253036  3278 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:36.252988  3241 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.280958  3241 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:36.282866  2266 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:36.253768  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:36.225818  3443 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.287238  3443 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.287910  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:36.234485  3321 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.278347  3225 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.304637  3283 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.307483  3283 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.312660  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.315169  3179 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.350910  3179 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:36.351472  3179 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.368554  2259 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:36.331784  3337 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.376475  3179 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.379463  3179 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:36.424415  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.428157  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.433395  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:36.433521  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.444216  1557 tablet_copy_source_session.cc:215] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:36.446605  1557 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:35956 (request call id 193) took 1172 ms. Trace:
W20260709 13:00:36.448546  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.452472  1545 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:36.316533  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.490819  1557 rpcz_store.cc:276] 0709 13:00:35.274388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.274664 (+   276us) service_pool.cc:224] Handling call
0709 13:00:36.442702 (+1168038us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b5400046ad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8e43f7 00007f7f1f87a036 00007f7f1f883a3e 00007f7f1714727b 00007f7f1f8839ba 00007f7f1f87eacc 00007f7f1f879c7b 00007f7f1f86e8d1 00007f7f1e9224b4 00007f7f1e922442
0709 13:00:36.446449 (+  3747us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576832768}
W20260709 13:00:36.317512  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 99728.1us
I20260709 13:00:36.325129  1691 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.324370  1696 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:00:36.453605  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 272107us
I20260709 13:00:36.531265  3343 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:36.531930  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:36.527104  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.535355  3343 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:36.536137  3343 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:36.529359  3339 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.529248  3338 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:36.536819  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 220280us
I20260709 13:00:36.543272  3343 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.544413  3179 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.545799  3370 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:36.547289  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.543406  3081 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:00:36.557371  3370 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.558861  3081 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:36.559922  3081 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:36.562945  3448 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:36.565022  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.562961  3230 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.567109  3225 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.568037  3225 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.568449  3190 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:00:36.569456  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.545888  3337 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:36.566344  3137 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:36.547312  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.583344  3443 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:36.582748  3081 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.583900  3443 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:36.584517  3443 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:36.585052  3081 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:36.588150  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.588614  3337 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:36.590500  3281 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:36.590298  3179 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.591099  3281 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:36.592221  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:36.592720  3281 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.593369  3179 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.595353  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.595964  1622 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:36.599172  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:36.600169  1622 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:36.602810  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:36.603946  3190 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.604387  3190 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:36.604816  3190 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.606032  3225 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.602914  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.573256  3137 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.623512  3223 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:36.624500  3223 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:36.637214  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.641402  3291 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.642576  3291 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:36.643028  3291 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.644405  3291 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.648217  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:36.672849  3291 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.689345  1545 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:36.690645  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 156042us
I20260709 13:00:36.695082  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:36.657086  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:36.692276  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:36.711522  3137 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.717059  3137 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.717217  1617 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:00:36.727643  3223 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:36.727893  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 163697us
I20260709 13:00:36.728868  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:36.735069  2257 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:36.747915  3281 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.751988  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:36.761155  3370 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.726346  3190 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.797551  3190 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:36.765663  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 81262.2us
W20260709 13:00:36.771565  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.791569  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.792333  3081 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.793701  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:36.800271  3081 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.802938  1542 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:36.804458  3260 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.033s
W20260709 13:00:36.804900  3260 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.010s	sys 0.033s
I20260709 13:00:36.806964  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:36.811064  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.802405  3081 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:36.812731  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:36.813627  1545 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:36.813621  2257 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:36.815513  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:36.816370  3081 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:36.817226  3081 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.817706  3081 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.817778  3354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 459063895bc847b9a15dc71e10b36267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:36.817529  3241 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:36.825112  1613 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:36.828913  3190 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:36.830302  3370 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:36.832929  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:36.839037  3443 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.841382  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:36.843341  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.011s
I20260709 13:00:36.844311  3463 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:36.847879  3241 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:36.850325  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:36.858052  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:36.859858  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:36.862757  1542 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:36.863173  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.006s	sys 0.015s
W20260709 13:00:36.863476  1620 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.005s	sys 0.027s
W20260709 13:00:36.863739  2263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.033s	sys 0.066s
W20260709 13:00:36.879022  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.002s	sys 0.012s
W20260709 13:00:36.879149  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 127279us
W20260709 13:00:36.879504  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.006s	sys 0.016s
W20260709 13:00:36.883152  1620 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.005s	sys 0.027s
I20260709 13:00:36.869051  3190 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:36.883714  2263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.034s	sys 0.066s
I20260709 13:00:36.902777  3260 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.904795  1695 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:36.905431  3339 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:36.906028  3179 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:36.906203  3339 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:36.906651  3179 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:36.907271  3179 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:36.905180  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.908860  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:36.910936  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:36.906981  3339 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:36.912963  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 62724.3us
W20260709 13:00:36.914865  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 219984us
I20260709 13:00:36.904831  3260 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:36.920043  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 191383us
I20260709 13:00:36.921461  3339 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.922091  3260 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:36.925252  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.928040  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.926813  3230 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:36.926307  3339 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.938453  3291 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:36.939381  3291 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:36.938867  3339 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.940727  3291 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.944734  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.946242  3463 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:36.946516  3081 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.947096  3463 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.949749  3463 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.951043  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:36.933911  3230 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.942394  3339 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.918902  3370 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.933707  3137 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.966756  3398 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:36.966672  3137 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:36.967592  3398 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:36.958809  2257 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:36.954861  3081 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:36.975365  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.976500  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.965104  3230 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:36.970455  3398 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:36.977385  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:36.988826  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:36.982007  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.574s (SENT) [suppressed 39 similar messages]
I20260709 13:00:36.992897  1694 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:36.990437  1546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.026s	sys 0.036s
I20260709 13:00:36.991888  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:36.994186  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70831.1us
I20260709 13:00:36.980028  3455 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:36.998176  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.007s	sys 0.029s
W20260709 13:00:36.998606  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.007s	sys 0.029s
W20260709 13:00:36.993592  1543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.004s	sys 0.019s
I20260709 13:00:36.999670  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1435) took 1436 ms. Trace:
W20260709 13:00:37.003866  1546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.027s	sys 0.036s
W20260709 13:00:37.006146  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.010093  1543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.004s	sys 0.019s
W20260709 13:00:36.997126  3366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.042s	sys 0.033s
I20260709 13:00:37.015633  1616 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:36.988461  3190 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.015146  3398 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.007115  3465 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.043670  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:37.034225  3366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.042s	sys 0.034s
I20260709 13:00:37.048998  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:37.016443  3463 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.054155  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 82594.6us
I20260709 13:00:37.045214  3416 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.062589  3281 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.061726  3448 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:37.083067  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.071559  3436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.014s	sys 0.061s
I20260709 13:00:37.085520  3448 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:37.071581  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.017s	sys 0.027s
I20260709 13:00:37.096752  3225 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.102389  3209 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.103534  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:37.103289  3209 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.091190  3190 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:37.086403  3453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.015s	sys 0.024s
I20260709 13:00:37.070663  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:37.111100  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.017s	sys 0.029s
I20260709 13:00:37.088886  3443 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:37.101159  3436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.015s	sys 0.062s
I20260709 13:00:37.086158  3463 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.120939  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 111863us
I20260709 13:00:37.105129  3448 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.002173  1620 rpcz_store.cc:276] 0709 13:00:35.559272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.832488 (+273216us) service_pool.cc:224] Handling call
0709 13:00:35.875521 (+ 43033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.875840 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:35.919876 (+ 44036us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.936015 (+1016139us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.957582 (+ 21567us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:36.972249 (+ 14667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.978846 (+  6597us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.995825 (+ 16979us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44503,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3043,"raft.queue_time_us":102841,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":963543,"threads_started":1}
W20260709 13:00:37.116161  3453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.016s	sys 0.024s
I20260709 13:00:37.140772  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.102523  3225 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.157477  3225 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:37.163192  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54165.3us
W20260709 13:00:37.165062  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 128454us
W20260709 13:00:37.128362  3227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.051s	sys 0.078s
I20260709 13:00:37.170512  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:37.071851  3465 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.166181  3366 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:37.181825  3227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.051s	sys 0.080s
I20260709 13:00:37.200938  3444 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:37.201812  3444 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.177438  3450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.194s	user 0.011s	sys 0.051s
W20260709 13:00:37.177142  3373 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.025s	sys 0.062s
I20260709 13:00:37.210770  3370 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:37.213375  3373 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.026s	sys 0.062s
W20260709 13:00:37.218314  3450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.011s	sys 0.052s
I20260709 13:00:37.230089  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:37.231899  3462 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.232439  3462 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.234750  3469 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:37.235458  3469 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:37.236631  3469 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.238741  3371 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.239156  3454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.023s	sys 0.040s
W20260709 13:00:37.239620  3454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.023s	sys 0.041s
I20260709 13:00:37.239297  3371 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.240844  1619 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:37.241565  3371 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:37.242094  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.255205  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.258092  2257 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:37.265503  1617 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:37.254119  3448 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.276224  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:37.281338  1616 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:37.283834  1620 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:37.249658  3462 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:37.270424  3187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.009s	sys 0.110s
W20260709 13:00:37.286116  3187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.010s	sys 0.111s
I20260709 13:00:37.286146  3465 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.266522  3370 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.287616  3370 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:37.289386  3354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42620 (request call id 260) took 5073 ms. Trace:
I20260709 13:00:37.289989  3370 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:37.290270  1696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.016s	sys 0.016s
W20260709 13:00:37.290642  1696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.017s	sys 0.016s
I20260709 13:00:37.290988  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:37.291544  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:37.292166  1616 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:37.242568  3452 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:37.294984  3452 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:37.295459  3343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.004s	sys 0.035s
W20260709 13:00:37.307282  3343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.004s	sys 0.035s
I20260709 13:00:37.307471  1545 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:37.302539  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 74020.1us
I20260709 13:00:37.309981  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:37.314486  3463 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.318462  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.319502  1542 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:37.320086  3462 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:37.320218  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:37.323064  3444 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.320866  3462 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.323645  3480 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:00:37.323904  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:37.324512  1620 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.325418  3462 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:37.326205  3474 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:00:37.327181  3471 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:37.327896  3471 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.329030  3187 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:37.330060  3187 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:37.330484  3471 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:37.333274  3443 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:37.332994  3471 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:00:37.341324  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 256) took 1758 ms. Trace:
I20260709 13:00:37.302551  3452 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.341884  1615 rpcz_store.cc:276] 0709 13:00:35.583229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.835257 (+252028us) service_pool.cc:224] Handling call
0709 13:00:35.835674 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.917405 (+ 81731us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.917439 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.920533 (+  3094us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.177707 (+1257174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.188669 (+ 10962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.192762 (+  4093us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.341007 (+148245us) raft_consensus.cc:1685] finished
0709 13:00:37.341032 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.341247 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147538,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":16388,"thread_start_us":1271998,"threads_started":2,"wal-append.queue_time_us":1328661}
I20260709 13:00:37.347121  3462 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.347774  3462 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:37.350239  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.275228  3338 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.318076  1585 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:37.289822  3354 rpcz_store.cc:276] 0709 13:00:32.216233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.241662 (+ 25429us) service_pool.cc:224] Handling call
0709 13:00:33.817154 (+1575492us) ts_tablet_manager.cc:934] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
0709 13:00:34.932163 (+1115009us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b4c0013eb80. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f18ba6a20 00007f7f18bb7a29 00007f7f18bb813f 00007f7f18b7c2ab 00007f7f18ba9f3c 00007f7f18baa461 00007f7f18baa768 00007f7f1e9302eb 00007f7f1f855d3b 00007f7f1f850008 00007f7f1f84f405
0709 13:00:36.815458 (+1883295us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:37.223508 (+408050us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:37.227779 (+  4271us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:37.288304 (+ 60525us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:37.288723 (+   419us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:37.289083 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:37.289285 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":66943,"spinlock_wait_cycles":98448256,"tablet-copy.queue_time_us":1323592,"thread_start_us":1304362,"threads_started":2}
I20260709 13:00:37.355691  3453 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.356328  3453 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.358426  3468 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.359162  3443 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.359016  3468 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.359902  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.359774  3443 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.363438  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 259) took 1722 ms. Trace:
I20260709 13:00:37.360621  2257 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:37.300647  3370 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:37.354676  3473 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
W20260709 13:00:37.397614  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.304862  3448 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:37.354524  3338 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:37.425871  1621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.017s	sys 0.040s
I20260709 13:00:37.365123  3225 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.429069  1621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.017s	sys 0.040s
W20260709 13:00:37.430691  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80712us
I20260709 13:00:37.391621  3398 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.354089  3209 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.363879  1618 rpcz_store.cc:276] 0709 13:00:35.641341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.012572 (+371231us) service_pool.cc:224] Handling call
0709 13:00:36.013047 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.013470 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.013511 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.014069 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.957430 (+943361us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:36.963704 (+  6274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.972033 (+  8329us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.349883 (+377850us) raft_consensus.cc:1685] finished
0709 13:00:37.349901 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.363379 (+ 13478us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9692,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":844518,"threads_started":1,"wal-append.queue_time_us":1066686}
I20260709 13:00:37.356340  3354 tablet_copy_client.cc:806] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:37.392182  3465 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:37.434437  3370 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:37.449077  3370 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.451475  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 133577us
I20260709 13:00:37.452507  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:37.454048  3465 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:37.454768  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 88561.3us
I20260709 13:00:37.456130  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:37.458204  3209 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:37.463009  3209 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:37.463359  3179 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.555s	user 0.015s	sys 0.000s
I20260709 13:00:37.463604  3209 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.463948  3179 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.489108  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.489845  1542 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:37.466564  3179 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:37.489524  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.482383  3137 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:37.529498  3354 tablet_copy_client.cc:670] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:00:37.543638  1545 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:37.544044  3281 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:37.543900  3398 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.443697  3225 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.546784  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.027s
W20260709 13:00:37.564612  1546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.014s
W20260709 13:00:37.564953  1546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.011s	sys 0.014s
W20260709 13:00:37.555773  3260 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.633s	user 0.013s	sys 0.000s
I20260709 13:00:37.583690  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:37.562399  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.012s	sys 0.027s
I20260709 13:00:37.551775  3179 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.595444  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.508476  3452 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.589681  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.026s	sys 0.042s
I20260709 13:00:37.598040  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 200) took 1569 ms. Trace:
I20260709 13:00:37.598351  1545 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:37.600657  3452 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.606144  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.607573  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:37.608496  3467 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.482s	user 0.003s	sys 0.003s
I20260709 13:00:37.608855  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:37.609534  1545 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.609843  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 650) took 1812 ms. Trace:
I20260709 13:00:37.610216  2263 rpcz_store.cc:276] 0709 13:00:35.797789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.797897 (+   108us) service_pool.cc:224] Handling call
0709 13:00:35.798224 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.831677 (+ 33453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.831722 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.866872 (+ 35150us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.964874 (+1098002us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:36.973810 (+  8936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.134411 (+160601us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b540012e654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:37.134511 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.522893 (+388382us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:37.609609 (+ 86716us) raft_consensus.cc:1685] finished
0709 13:00:37.609629 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.609766 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53803648,"thread_start_us":980950,"threads_started":1,"wal-append.queue_time_us":1176078}
I20260709 13:00:37.612286  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.612941  2257 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:37.603166  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.615814  3209 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.616480  3478 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.617053  3478 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.617910  1547 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:37.603781  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.620214  1541 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:37.604694  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.624915  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1127) took 1437 ms. Trace:
I20260709 13:00:37.625026  3455 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:37.625927  3455 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:37.626235  3455 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:37.627113  3455 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.627931  3468 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.628376  3455 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.605285  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.631618  1538 raft_consensus.cc:2376] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3. Re-sending same reply.
I20260709 13:00:37.625512  1619 rpcz_store.cc:276] 0709 13:00:36.187686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.187852 (+   166us) service_pool.cc:224] Handling call
0709 13:00:36.188466 (+   614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.241273 (+1052807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.624575 (+383302us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002c83d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:37.624853 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418853120}
I20260709 13:00:37.595444  3338 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.637571  3338 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.637653  3453 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:37.597476  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.027s	sys 0.042s
I20260709 13:00:37.595808  3443 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.644634  3398 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.645263  3398 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.645772  3398 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.647965  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.649295  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:37.645793   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.655642  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.657933  3468 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:37.657967  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.658761  1547 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:37.668656  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.015s	sys 0.011s
W20260709 13:00:37.668989  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.015s	sys 0.011s
I20260709 13:00:37.704294  1620 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:37.714103  1512 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.007s	sys 0.019s
I20260709 13:00:37.658499  3468 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.719067  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:37.723918  1512 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.008s	sys 0.019s
W20260709 13:00:37.667506  3337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.018s
W20260709 13:00:37.705335  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.728149  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 751006us
I20260709 13:00:37.667115  3443 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:37.735754  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.032s
I20260709 13:00:37.589126  3260 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.672503  3453 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:37.743870  3337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.014s	sys 0.018s
W20260709 13:00:37.747610  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.018s	sys 0.032s
I20260709 13:00:37.736065  1542 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:37.763628  1545 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:37.735194  3373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.014s	sys 0.030s
I20260709 13:00:37.618520  3209 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:37.738545  3366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.016s	sys 0.033s
I20260709 13:00:37.743036  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.753824  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:37.735378  3468 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.763729  1541 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:37.750641  3443 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.785353  1539 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:37.794945  3443 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.786257  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.796901  3398 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.797461  3398 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:37.787587  3225 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.788844  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:37.789546  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.789754  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.791085  1694 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:37.791285  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.791548  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.781476  3450 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.781750  3366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.016s	sys 0.036s
I20260709 13:00:37.798908  3462 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:37.783120  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.799844  2265 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:37.777846  3373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.016s	sys 0.033s
I20260709 13:00:37.804163  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.714897  3179 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.761080  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:37.820468  1538 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:37.747826  1613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.034s
I20260709 13:00:37.761565  3453 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.775735  3281 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.821429  2262 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:37.825500  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:37.817845  3291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.031s	sys 0.034s
W20260709 13:00:37.834401  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.838397  1620 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:37.833568  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 201) took 1794 ms. Trace:
I20260709 13:00:37.783986  3478 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:37.828287  1613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.035s
I20260709 13:00:37.818607  3366 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:37.833173  3453 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:37.833168  2257 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:37.846765  3291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.032s	sys 0.034s
I20260709 13:00:37.855568  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:37.846081  3469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.020s	sys 0.013s
I20260709 13:00:37.871356  1538 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:37.863663  2258 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:37.840106  3462 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:37.880641  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 223614us
I20260709 13:00:37.847179  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 209) took 1073 ms. Trace:
I20260709 13:00:37.891889  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.887832  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:37.894179  3462 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.894872  1691 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:00:37.894240  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:37.896369  1538 pending_rounds.cc:85] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 1
I20260709 13:00:37.897209  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:37.898207  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1136) took 1034 ms. Trace:
I20260709 13:00:37.899080  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.826170  3450 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:37.873589  3469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.020s	sys 0.014s
I20260709 13:00:37.851773  3137 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:37.848119  1543 rpcz_store.cc:276] 0709 13:00:36.039171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.039576 (+   405us) service_pool.cc:224] Handling call
0709 13:00:36.039889 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.040079 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:37.033396 (+993317us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.749321 (+715925us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.754284 (+  4963us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:37.764333 (+ 10049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.811521 (+ 47188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.833510 (+ 21989us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1553,"prepare.queue_time_us":1155659,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":7263,"raft.queue_time_us":13942,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":15521,"thread_start_us":1569449,"threads_started":2,"wal-append.queue_time_us":786298}
I20260709 13:00:37.917537  1619 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:37.917989  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.908635  1620 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.917347  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.907866  1622 rpcz_store.cc:276] 0709 13:00:36.863647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.863767 (+   120us) service_pool.cc:224] Handling call
0709 13:00:36.874974 (+ 11207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.957799 (+ 82825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.957842 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.986739 (+ 28897us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.638590 (+651851us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:37.638654 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.638734 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.897941 (+259207us) raft_consensus.cc:1685] finished
0709 13:00:37.897967 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.898119 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25806,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6102,"thread_start_us":644547,"threads_started":1,"wal-append.queue_time_us":900356}
I20260709 13:00:37.910795  1538 pending_rounds.cc:107] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:37.922631  1538 raft_consensus.cc:2889] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:37.931267  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.933710  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:37.912227  3465 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:37.933086  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.938882  1696 raft_consensus.cc:2368] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:37.918555  3291 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.900398  3281 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.946151  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:37.947247  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:37.941442  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:37.939126  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:37.937145  3499 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:37.953562  3230 consensus_meta.cc:287] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.004s
W20260709 13:00:37.972867  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.980660  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.979221  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1135) took 1380 ms. Trace:
I20260709 13:00:37.991036  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:37.982069  3366 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.991638  2266 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:37.991868  2261 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:37.992604  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.992750  3499 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:37.995105  3499 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.968891  3465 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:37.962167  3373 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:38.000274  1696 raft_consensus.cc:2393] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:37.982251  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:38.000742  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.003980  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.962605  3463 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:37.973067  3260 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.034876  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.032274  1690 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:37.980042  3511 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.034466  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:37.998147  3370 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.001310  3209 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.039911  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.998946  3469 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.042722  3416 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.043640  3490 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:00:38.029546  3179 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:38.023236  3499 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:37.974056  3291 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.050431  1620 raft_consensus.cc:2410] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:38.047737  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:37.982689  3230 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.058145  1687 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:38.028424  3472 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:38.054718  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.064548  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.051364  3469 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.037377  3511 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:38.075505  3494 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:00:38.090866  3462 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.092995  3515 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:38.093384  3505 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:00:38.094878  3489 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:00:38.095098  3454 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.065924  3416 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.080106  1693 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:38.096503  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.102903  1690 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:38.092252  1696 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:38.053038  3463 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.114872  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.048008  3373 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.076015  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.101887  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.106048  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.108472  1544 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:00:38.054045  3209 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.060801  3499 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.110040  3497 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:00:38.109491  3501 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:38.136626  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.133100  1544 pending_rounds.cc:85] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 1
I20260709 13:00:38.064062  3338 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:38.138504  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.069907  3465 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.139605  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.096745  3469 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.098129  3511 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.141325  1544 pending_rounds.cc:107] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:00:38.141746  1690 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:38.142120  1544 raft_consensus.cc:2889] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.103739  3515 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.155980  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.156833  3515 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.110860  3450 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.107086  3281 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.159821  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:38.107350  3230 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.108269  3291 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.163556  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.131918  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1137) took 1257 ms. Trace:
I20260709 13:00:38.138890  3499 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.172719  1541 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:38.182106  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.182811  1620 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:38.183480  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:38.172168  3455 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.001s
I20260709 13:00:38.132210  3443 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.076186  3370 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.187835  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.141654  3338 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.190876  3520 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.191435  3520 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.192142  3338 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.193614  3520 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:38.195218  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 160840us
I20260709 13:00:38.196251  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.196568  1691 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:38.206928  1694 raft_consensus.cc:2368] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:38.203193  1539 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:38.201618  1585 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.211416  2257 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:38.212558  3209 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.213670  3370 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:37.909066  1540 rpcz_store.cc:276] 0709 13:00:36.773461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.773619 (+   158us) service_pool.cc:224] Handling call
0709 13:00:36.774246 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.774898 (+   652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.774929 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.775473 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.650147 (+874674us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.650510 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.667537 (+ 17027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.705280 (+ 37743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.796436 (+ 91156us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b540030e920. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a84fdbe 00007f7f1a85a930 00007f7f1a85a8d8 00007f7f1a85a858 00007f7f1a85a813 00007f7f1a859a9c 00007f7f20745626 00007f7f2073fdd8 00007f7f1a8967cb 00007f7f1a8992c0
0709 13:00:37.799250 (+  2814us) raft_consensus.cc:1685] finished
0709 13:00:37.830131 (+ 30881us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.844418 (+ 14287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":5791,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":175,"spinlock_wait_cycles":135095424,"thread_start_us":814803,"threads_started":1,"wal-append.queue_time_us":809360}
I20260709 13:00:38.219771  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.221611  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.222733  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.223976  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.224522  1693 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:38.225312  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.227072  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.229080  3373 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.229426  3452 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:38.231382  1688 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:38.226368  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:38.232359  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.233253  3405 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:38.233423  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.235802  3416 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.236572  3524 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.237064  3524 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.237919  3469 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.202468  3455 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:38.242806  3444 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.239288  3524 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.234488  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.246558  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.280160  1688 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:38.241742  3443 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.289407  1687 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:38.291882  1689 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:38.187055  3511 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.238351  3453 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.306732  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.265700  3338 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.310523  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:38.308382  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 260183us
I20260709 13:00:38.263446  3455 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.268174  3444 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.335551  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.311971  2266 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:38.339190  1547 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:00:38.339767  1547 pending_rounds.cc:85] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 1
I20260709 13:00:38.247540  3468 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.337319  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.340969  1688 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:38.341959  1619 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:38.342999  1691 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:38.308408  3137 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.334800  3230 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.334926  3455 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.332906  3472 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.346819  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.371304  1622 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:38.337790  3444 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.350132  3511 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.340056  1547 pending_rounds.cc:107] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:00:38.338414  3338 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.377708  1547 raft_consensus.cc:2917] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:00:38.378780  3495 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.379568  3453 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.379309  3495 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.380056  3338 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.381523  3495 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:38.382680  3469 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.386670  3278 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.350764  3137 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.387207  3278 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.388568  3137 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:38.389155  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.389678  3530 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.389814  1691 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:38.171947  1613 rpcz_store.cc:276] 0709 13:00:36.875776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.881939 (+  6163us) service_pool.cc:224] Handling call
0709 13:00:36.935027 (+ 53088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.014512 (+ 79485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.016953 (+  2441us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.070076 (+ 53123us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.868994 (+798918us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:37.873386 (+  4392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.901329 (+ 27943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:38.116232 (+214903us) raft_consensus.cc:1685] finished
0709 13:00:38.121403 (+  5171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:38.121584 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14382,"raft.queue_time_us":26822,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":31887,"thread_start_us":743972,"threads_started":1,"wal-append.queue_time_us":840327}
I20260709 13:00:38.392532  3468 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.395048  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.395876  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.396363  1689 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.396397  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:37.598424  1546 rpcz_store.cc:276] 0709 13:00:36.028928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.029270 (+   342us) service_pool.cc:224] Handling call
0709 13:00:36.029610 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.029861 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:37.012692 (+982831us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.586809 (+574117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.586894 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:37.586961 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.587051 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.597972 (+ 10921us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1128930,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2703,"raft.queue_time_us":2916,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3547,"thread_start_us":1473333,"threads_started":2}
I20260709 13:00:38.398523  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.398972  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.399533  1687 raft_consensus.cc:2376] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3. Re-sending same reply.
I20260709 13:00:38.401527  3398 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:38.402094  3398 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.403913  3511 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:38.404495  3511 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.406982  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.407584  1691 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:38.408265  1538 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:38.389231  3278 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.390822  2259 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:38.410074  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.410223  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.410714  1691 raft_consensus.cc:2376] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5. Re-sending same reply.
I20260709 13:00:38.410876  1547 raft_consensus.cc:2889] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.410998  1693 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:38.414805  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.416283  1542 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:38.417132  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.418241  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.419312  3448 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.419708  3448 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:38.421993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.422753  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.422958  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.423301  1546 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.406538  3511 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.390239  3530 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.423483  1545 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.443272  3469 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.444743  3469 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:38.445240  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:38.443902  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.446377  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.446645  3472 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.447080  3472 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.447361  3469 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.447422  3472 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:38.431274  3529 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:38.440269  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.435061  3468 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:38.448736  1542 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:38.448800  3468 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.450973  3530 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.420588  3448 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.451709  3468 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.411715  3398 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.452199  3448 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.439998  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.455394  1693 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:37.982218  1621 rpcz_store.cc:276] 0709 13:00:36.614484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.616770 (+  2286us) service_pool.cc:224] Handling call
0709 13:00:36.657748 (+ 40978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.670942 (+ 13194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:37.430528 (+759586us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.968793 (+538265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.968846 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:37.978949 (+ 10103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.979023 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.979162 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8814,"prepare.queue_time_us":1072536,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":1750,"raft.queue_time_us":71051,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4986,"thread_start_us":1212357,"threads_started":3,"wal-append.queue_time_us":536589}
I20260709 13:00:38.456925  3472 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.457635  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.457729  1689 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:38.466966  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:38.458570  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.459854  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.459532  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.468561  1615 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:38.469372  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.469547  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.470182  1620 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:38.471392  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.475442  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:38.476854  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.477663  1622 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
I20260709 13:00:38.478866  3496 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.479252  3496 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.479414  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.479966  3405 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.480433  2266 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:38.480350  3405 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.480847  3495 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:38.481282  3405 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.481609  3495 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:38.481752  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.483227  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.482925  3495 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.483822  1618 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 1.
I20260709 13:00:38.484886  3463 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.486326  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.479264  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.487250  1613 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:38.487475  1622 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:38.485488  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.488631  1690 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:38.489401  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.415114  3499 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.504602  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.466741  1545 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:38.495985  3405 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.501159  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.500627  3511 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:00:38.507920  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.509018  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.509707  1539 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:38.509779  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.507939  3463 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.510772  3354 tablet_copy_client.cc:538] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:00:38.512146  3405 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.479748  3496 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.515028  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:38.520282  1445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 336) took 8402 ms. Trace:
I20260709 13:00:38.510805  3463 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:38.523880  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35950 (request call id 8) took 11162 ms. Trace:
I20260709 13:00:38.528942  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.510383  1543 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.526511  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.378386  3230 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.530983  1615 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:38.506709  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.536525  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:38.563510  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:38.572331  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.537142  3511 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.532272  3463 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.536722  3343 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:38.529873  3291 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.567054  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.558926  3398 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:00:38.583081  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 479708us
I20260709 13:00:38.585932  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.586898  3478 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.589058  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.529285  1547 rpcz_store.cc:276] 0709 13:00:27.300700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.303181 (+  2481us) service_pool.cc:224] Handling call
0709 13:00:28.039737 (+736556us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c00000658. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e2a0a 00007f7f191e2693 00007f7f191e2631 00007f7f1a915902 00007f7f1a9156dd 00007f7f1a8e0f3f 00007f7f1a8e06b3 00007f7f1f8a0d29 00007f7f18e1f1d4 00007f7f18e1f162
0709 13:00:28.661346 (+621609us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b58000e09d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8360aa 00007f7f1a8b8447 00007f7f1a8d570a 00007f7f1a8d676a 00007f7f1a8d591b 00007f7f1a8e103c 00007f7f1a8e06b3 00007f7f1f8a0d29 00007f7f18e1f1d4 00007f7f18e1f162
0709 13:00:29.076461 (+415115us) log.cc:844] Serialized 506 byte log entry
0709 13:00:30.214026 (+1137565us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b54003fd2a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a85ab26 00007f7f1a85449a 00007f7f1a853714 00007f7f1a833eaa 00007f7f1a83ad53 00007f7f1a83acd9 00007f7f1a83ac69 00007f7f1a83ac31 00007f7f1a839dfd 000000000038f354
0709 13:00:38.428405 (+8214379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9801,"raft.queue_time_us":37606,"raft.run_cpu_time_us":29143,"raft.run_wall_time_us":1233318,"spinlock_wait_cycles":1339006464,"thread_start_us":17917,"threads_started":1,"wal-append.queue_time_us":272162,"wal-append.run_cpu_time_us":2018,"wal-append.run_wall_time_us":1002039}
I20260709 13:00:38.593820  1542 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:38.527348  1445 rpcz_store.cc:276] 0709 13:00:30.118075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.134821 (+ 16746us) service_pool.cc:224] Handling call
0709 13:00:38.520087 (+8385266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:35.423847 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:35.545269 (+121422us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:35.549269 (+  4000us) write_op.cc:435] Acquired schema lock
0709 13:00:35.559189 (+  9920us) tablet.cc:662] Decoding operations
0709 13:00:35.789337 (+230148us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:35.793040 (+  3703us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:35.801959 (+  8919us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:00:35.984188 (+182229us) tablet.cc:701] Row locks acquired
0709 13:00:35.993631 (+  9443us) write_op.cc:260] PREPARE: finished
0709 13:00:36.013413 (+ 19782us) write_op.cc:270] Start()
0709 13:00:36.013534 (+   121us) write_op.cc:276] Timestamp: P: 1783602036013369 usec, L: 0
0709 13:00:36.013556 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:00:36.015594 (+  2038us) log.cc:844] Serialized 2923 byte log entry
0709 13:00:38.095351 (+2079757us) op_driver.cc:464] REPLICATION: finished
0709 13:00:38.210736 (+115385us) write_op.cc:301] APPLY: starting
0709 13:00:38.210874 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:38.211208 (+   334us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:38.211371 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:38.212492 (+  1121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:38.212773 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:00:38.212819 (+    46us) write_op.cc:312] APPLY: finished
0709 13:00:38.213216 (+   397us) log.cc:844] Serialized 59 byte log entry
0709 13:00:38.213397 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:38.213624 (+   227us) write_op.cc:454] Released schema lock
0709 13:00:38.213684 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:38.344820 (+131136us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:38.345855 (+  1035us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":408059,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":86388,"apply.run_cpu_time_us":3766,"apply.run_wall_time_us":113928,"num_ops":7,"prepare.queue_time_us":48931,"prepare.run_cpu_time_us":84931,"prepare.run_wall_time_us":1813596,"raft.queue_time_us":438882,"raft.run_cpu_time_us":17044,"raft.run_wall_time_us":81690,"replication_time_us":2062790,"thread_start_us":1439721,"threads_started":4,"wal-append.queue_time_us":1187227}]]}
I20260709 13:00:38.615204  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:38.616256  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 51161us
I20260709 13:00:38.614530  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.575119  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.620100  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:38.592653  3366 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:38.592427  3511 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:38.621354  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:38.622325  1692 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:38.622754  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.629194  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.623675  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:38.631522  1694 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.618511  1695 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:38.617501  2230 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.625449  1543 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:38.595232  3452 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.633876  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.596634  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.639425  1542 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:38.613691  3398 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:38.645859  3398 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.632387  1444 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.647131  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:38.648785  3227 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.648613  1444 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.653931  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.620332  3337 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:38.655467  3227 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:38.655880  3227 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:38.643072  3452 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.656824  3227 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.657886  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:38.657972  3283 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.658581  2263 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.659020  3452 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:38.658715  3283 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.660807  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.661433  3283 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:38.644055  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 58207.9us
I20260709 13:00:38.662092  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.635953  3511 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.658200  3227 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:38.664227  2262 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:38.665282  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.662432  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:38.630949  3526 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:38.644614  3450 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:38.614019  3343 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:38.676052  3450 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.672922  1694 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:38.674108  2265 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:38.687808  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.666915  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.674948  1444 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:38.676159  3499 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.676395  3532 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:38.683205  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 459063895bc847b9a15dc71e10b36267: Aborted: Op aborted by new leader
I20260709 13:00:38.683423  3472 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.683835  1614 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:38.684070  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:38.684983  3230 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.684880  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:38.676615  3453 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:38.707839  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:38.642036  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.613657  3291 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.639108  3495 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.666925  3526 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.697273  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.681301  3515 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:38.623346  3478 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:38.699405  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44521.1us
I20260709 13:00:38.693972  1444 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:38.703982  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:38.728193  1547 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:38.688913  3450 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:38.685622  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:38.708843  1542 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.679225  2263 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:38.678387  2261 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:38.714488  1543 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:38.721312  2264 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:38.676232  3373 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:38.699126  3370 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.728819  2231 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.686507  3444 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:38.731572  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47621us
I20260709 13:00:38.728559  1444 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:38.704903  3187 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:00:38.819906  3538 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 13:00:38.820351  3187 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:38.820780  3187 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:38.821233  3354 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:00:38.821547  3527 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.821707  3187 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.701265  3524 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:00:38.722343  3453 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.715781  3495 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.723934  3526 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:38.824783  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 96060.5us
W20260709 13:00:38.825512  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139974us
I20260709 13:00:38.823734  1444 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:00:38.828837  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 98855.2us
W20260709 13:00:38.742125  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.839414  3464 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:00:38.839970  3444 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.729622  3337 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.841760  3472 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:38.730324  3366 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:38.884799  3291 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.819911  3478 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.767055  1540 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:38.738719  3515 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:38.736521  3452 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:38.918298  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:38.860050  1444 catalog_manager.cc:5697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:38.843438  3443 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:38.873514  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:38.885210  3366 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.846977  1542 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:38.885624  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:38.876308  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 238825us
I20260709 13:00:38.875995  3468 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:38.888082  3187 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.859542  3495 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:38.861946  3137 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:38.953084  3137 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.953595  3137 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.847805  3527 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:00:38.876179  3337 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:38.959331  3541 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:00:38.959488  3337 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:38.866417  3343 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.967533  3453 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:38.975508  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.976850  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:38.978390  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 104995us
I20260709 13:00:38.845214  3230 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.842506  3511 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:38.913784  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54474us
I20260709 13:00:38.875044  3471 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:00:38.869055  3496 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.848492  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:38.988936  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 140549us
I20260709 13:00:38.990272  1512 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:38.877758  3455 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:38.931298  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.891469  3472 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:38.998853  3455 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:38.999919  3373 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:39.001318  3511 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.001518  2266 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:39.001976  3260 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:39.002223  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.003504  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.004405  3081 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:38.999963  3496 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.004899  3520 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.933351  3443 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.004865  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.006453  3398 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.008579  3398 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.009130  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:39.009363  3373 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:38.929306  3478 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:00:38.932613  3283 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:38.977947  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:38.983856  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:38.986847  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:38.921793  1444 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.020040  1444 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:39.010736  3443 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:39.000213  3452 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.042856  3452 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.986442  3444 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:38.945997  3468 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.011272  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:38.943238  3515 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:39.011948  1546 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.588s	user 0.004s	sys 0.002s
I20260709 13:00:39.053650  1546 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:38.996573  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:39.019940  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:39.021414  1444 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:38.986825  3453 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:39.037437  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 50923.4us
I20260709 13:00:39.038591  3549 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:38.995548  3530 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.041427  3450 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.041733  3137 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:39.022754  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 91567.1us
I20260709 13:00:39.047796  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:39.071159  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 92058.5us
I20260709 13:00:38.999963  3472 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:39.061427  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 124345us
W20260709 13:00:39.062695  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.050920  3444 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.064332  1444 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:39.063812  3453 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.021147  3370 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:00:39.045461  3081 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.092850  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:39.062739  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.061333  3532 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.045298  3291 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:39.094478  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.056824  3443 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:39.073495  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.064481  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:39.015358  3230 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.088809  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.088919  1622 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:39.100194  1622 pending_rounds.cc:85] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
I20260709 13:00:39.100441  1622 pending_rounds.cc:107] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:39.100664  1622 raft_consensus.cc:2889] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.089690  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.101467  1694 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:39.090421  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:39.088469  3453 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.036754  3511 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:39.075898  3283 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.068692  3524 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:39.085741  3444 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:39.167076  3560 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:39.167644  3468 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.158977  3179 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.169761  3137 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.156400  3227 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:39.170342  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 75960us
I20260709 13:00:39.171062  3531 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:39.171447  3531 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:39.172571  3081 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:39.173040  3081 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:39.175276  3553 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:00:39.176420  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 103009us
I20260709 13:00:39.177111  1618 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:39.078542  3478 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:00:39.157588  1693 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:39.094415  3291 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.091580  3549 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:39.165436  3337 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:39.166018  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 112730us
I20260709 13:00:39.088464  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:39.172202  3531 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.102896  1616 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:39.198935  3558 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:00:39.189047  3179 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:00:39.130790  3343 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:39.208309  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:39.103039  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.242612  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.244163  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.257010  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:39.271924  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.283761  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:39.285632  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 262394us
I20260709 13:00:39.210474  3511 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:39.298516  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.301762  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.201439  3227 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:00:39.228760  3137 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:00:39.165437  3495 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.306871  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.211997  3448 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:00:39.320322  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:39.299062  3209 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:39.299176  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:39.303095  3260 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:39.205672  3526 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.288940  3291 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.307519  1614 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:39.298826  3179 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.203694  3524 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.319169  3530 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:39.349376  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.313155  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.299427  3343 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:39.323495  3472 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:39.328740  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:39.329563  3549 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.358479  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.330883  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:39.310607  3281 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:39.291085  1613 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:39.308770  3398 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.345147  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.321586  3531 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.317220  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:39.322727  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:39.331898  3444 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.323776  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:39.350076  1618 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:39.355207  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.355501  1622 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:39.358930  3530 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:39.325982  3209 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:39.312573  3559 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:00:39.313927  3468 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:00:39.357827  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.370852  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.370719  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.333220  3260 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:39.468348  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:39.355144  3472 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:39.414436  3511 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.342692  3455 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:39.458118  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.479219  3281 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:39.376938  1695 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:39.415486  3478 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:39.467506  1687 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:00:39.474164  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 230126us
I20260709 13:00:39.513360  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.304643  3443 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.457743  3354 tablet_bootstrap.cc:700] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent opening tablet: real 0.130s	user 0.002s	sys 0.001s
I20260709 13:00:39.357165  3450 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.528122  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.355607  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.501365  1696 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:39.422834  1541 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:39.503072  1692 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:39.479718  3556 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:00:39.493036  3503 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:39.503468  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.505837  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.536761  1690 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:39.506693  3472 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.506690  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.412760  3179 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.500689  2259 raft_consensus.cc:2368] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:39.600639  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.498407  3209 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:39.499591  3137 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:39.492096  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 169467us
I20260709 13:00:39.535912  1622 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:39.540514  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:39.580540  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 67264.8us
I20260709 13:00:39.596370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.599356  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.599817  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:39.601608  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 279090us
I20260709 13:00:39.512799  3478 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:39.601267  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.521732  3455 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:39.605795  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.608424  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.611374  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.615160  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.620565  1695 raft_consensus.cc:2368] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:39.603500  3463 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.000s
I20260709 13:00:39.620946  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.624630  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.625000  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.625813  1696 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:39.536548  3337 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.614457  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:39.622215  1687 raft_consensus.cc:2393] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:39.619820  1691 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
W20260709 13:00:39.635874  3562 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:00:39.636253  3567 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:39.628118  3463 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.601897  3230 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.638993  3495 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.635900  3478 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.646821  3455 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.601744  3527 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:39.610195  3569 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:39.635155  3464 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.634341  1622 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:39.639483  3281 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.681901  1616 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:39.612498  3137 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.686906  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.687249  1585 leader_election.cc:400] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:39.627344  3283 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:39.696848  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.649959  3571 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.648381  3179 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.683571  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:39.696838  3230 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:39.707535  1585 leader_election.cc:403] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.649819  3526 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:39.717636  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 103227us
I20260709 13:00:39.579336  3343 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.701241  3464 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.724180  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1158) took 1050 ms. Trace:
I20260709 13:00:39.684520  3337 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:00:39.685192  1614 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:39.726049  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 442405us
I20260709 13:00:39.623193  3260 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.714557  3137 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:39.759616  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 109995us
I20260709 13:00:39.772627  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:39.773495  1545 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:39.775615  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:39.736532  3559 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:39.764456  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:39.725103  3524 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:39.758862  3464 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.683820  3530 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:39.736658  3230 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:39.798848  3568 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:00:39.800819  1543 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:39.801939  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.739332  1619 rpcz_store.cc:276] 0709 13:00:38.673506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.673664 (+   158us) service_pool.cc:224] Handling call
0709 13:00:38.684944 (+ 11280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.685152 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.685177 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:38.685657 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.012913 (+327256us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:39.051184 (+ 38271us) log.cc:844] Serialized 14 byte log entry
0709 13:00:39.051389 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.051457 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.723886 (+672429us) raft_consensus.cc:1685] finished
0709 13:00:39.723916 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.724099 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38499,"prepare.run_wall_time_us":4470,"raft.queue_time_us":312,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2796,"spinlock_wait_cycles":5229440,"thread_start_us":326822,"threads_started":1,"wal-append.queue_time_us":391480}
I20260709 13:00:39.705595  3527 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.841090  3468 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.752121  1540 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:39.777034  3444 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:39.841401  3515 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.858780  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 176913us
I20260709 13:00:39.799269  3370 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.861987  1619 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:39.876200  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:39.856128  3532 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
I20260709 13:00:39.883920  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.845589  3524 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:39.887763  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85923.1us
I20260709 13:00:39.888459  1545 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:39.858424  3278 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.892838  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:39.860679  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:39.926406  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:39.927125  1619 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:39.906371  1547 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:39.937024  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:39.905575  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:39.915959  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:39.859160  3468 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:39.963380  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.885840  3450 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:39.897159  3337 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.084249  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:39.888614  3532 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.064246  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:40.085897  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.087060   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:40.093357  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:39.926672  3370 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:39.945361  3452 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.003s
I20260709 13:00:39.927384  3526 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.929613  3081 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.756s	user 0.013s	sys 0.000s
I20260709 13:00:40.090107  1692 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:00:39.942049  3187 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.995s	user 0.013s	sys 0.000s
I20260709 13:00:39.925711  3179 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:40.099645  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:40.099925  3577 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.101554  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:40.139056  1691 raft_consensus.cc:2376] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2. Re-sending same reply.
I20260709 13:00:40.102166  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:39.947781  3453 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.001s
I20260709 13:00:40.103806  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.138892  1690 raft_consensus.cc:2376] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2. Re-sending same reply.
I20260709 13:00:39.886799  3515 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.117292  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.119884  1542 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:40.088479  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:40.132469  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.146710  1622 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:40.130519  3455 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.089591  3584 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.142326  1693 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:39.943435  3230 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.165838  1543 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:39.929320  3571 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.213s
I20260709 13:00:40.131635  3559 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:40.140578  3179 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.178869  3577 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:40.180024  1693 pending_rounds.cc:85] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 2
I20260709 13:00:40.194501  1693 pending_rounds.cc:107] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:40.194921  1693 raft_consensus.cc:2889] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.925819  3278 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.117063  3452 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.145433  3587 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:40.136649  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 243485us
I20260709 13:00:40.131100  3526 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.136015  3081 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.140205  3370 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.173305  3579 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:40.224443  1692 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:40.227895  3587 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:40.228713  3582 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:00:40.230759  3278 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.231087  3559 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.232693  3495 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:40.232950  3452 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:40.234016  2261 raft_consensus.cc:2368] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3.
I20260709 13:00:40.239665  1619 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:40.193749  3179 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.290373  3370 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.263962  3579 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:40.292770  3531 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.000s
I20260709 13:00:40.144837  3453 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:40.294286  3472 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:00:40.294831  3472 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.295460  3453 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.193064  3542 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.296443  3542 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.297297  3472 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.298022  1621 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.193228  3520 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.298200  3464 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.292795  3579 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.302791  3464 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:40.287886  3209 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.001s
I20260709 13:00:40.298417  3542 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.275120  1540 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:40.315536  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.285526  3527 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.211617  3577 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:40.325312  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 284009us
W20260709 13:00:40.327929  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 433318us
I20260709 13:00:40.314654  3472 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.332171  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:40.334233  1512 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.596s (SENT)
I20260709 13:00:40.335356  1619 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:40.338496  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:40.340118  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115210us
I20260709 13:00:40.328639  3499 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.309191  3520 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.324028  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:40.346482  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:40.353549  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.324054  3209 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.369400  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.338289  3571 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:40.375605  1512 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.805s (SENT)
I20260709 13:00:40.352618  3281 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:00:40.372704  3576 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:00:40.370704  3588 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.379366  3281 consensus_queue.cc:1243] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:40.366161  3531 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:40.379633  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:40.379973  3281 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:40.366745  3187 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:40.380336  1620 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:40.380748  3187 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:40.391105  3515 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.391952  3187 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.393437  3209 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.395381  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:40.372109  2258 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.007s	user 0.012s	sys 0.000s
W20260709 13:00:40.373407  3137 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:00:40.366493  3468 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.374696  3511 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.401726  3499 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:40.429545  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 53991.5us
I20260709 13:00:40.431298  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:40.432507  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:00:40.403251  3291 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.051s	user 0.012s	sys 0.000s
I20260709 13:00:40.406539  3526 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.348682  3464 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:00:40.380370  3281 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:40.410682  3137 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.342515  3585 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:00:40.339886  3472 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.418783  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.421244  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.397505  2258 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:40.422920  1547 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:40.423840  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:40.423972  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.424180  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.424307  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:40.424461  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.424738  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:40.398977  3209 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.425019  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:40.461112  3343 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.455950  3499 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.461616  3343 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.463801  3343 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.464079  3520 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.425736  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:40.464478  1621 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:40.464613  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 665) took 1268 ms. Trace:
I20260709 13:00:40.465020  2263 raft_consensus.cc:2368] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5.
I20260709 13:00:40.453521  3370 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:40.465121  2258 rpcz_store.cc:276] 0709 13:00:39.189148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.201306 (+ 12158us) service_pool.cc:224] Handling call
0709 13:00:40.455456 (+1254150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:40.465890  3370 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.448024  3546 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:40.467128  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 304) took 1940 ms. Trace:
I20260709 13:00:40.467403  3546 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.467841  3546 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.467643  2257 rpcz_store.cc:276] 0709 13:00:38.526262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.529690 (+  3428us) service_pool.cc:224] Handling call
0709 13:00:40.466910 (+1937220us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:40.467055 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427213184}
I20260709 13:00:40.464282  3526 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:40.469327  3526 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.470695  3587 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.471410  3526 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.450521  3495 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:40.472353  3495 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:40.468195  3370 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.473114  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 299) took 1396 ms. Trace:
I20260709 13:00:40.473348  3495 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.473580  1617 rpcz_store.cc:276] 0709 13:00:39.076339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.076701 (+   362us) service_pool.cc:224] Handling call
0709 13:00:39.210304 (+133603us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b58001f1498. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:39.243797 (+ 33493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.459048 (+215251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.459079 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:39.459128 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:39.459166 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.472884 (+1013718us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000f91d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:40.472930 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.473044 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303678976}
I20260709 13:00:40.447568  3291 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.476760  3291 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:40.477085  3179 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.465922  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.434002  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:40.479221  1585 leader_election.cc:400] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5.
I20260709 13:00:40.479457  1585 leader_election.cc:403] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:00:40.435288  3563 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.076s	user 0.005s	sys 0.005s
I20260709 13:00:40.372838  3579 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:00:40.482849  3472 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.483492  3471 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:40.483932  3471 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:40.484447  3260 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.484689  3471 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.485536  1622 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:40.485898  3471 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.487378  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:40.488184  3137 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.488615  3179 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:40.489552  3577 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:40.487392  3594 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:40.490522  3594 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:40.491446  3281 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.492664  3281 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.452440  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.451882  1696 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:40.454845  1690 raft_consensus.cc:2368] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:40.497298  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44933.1us
I20260709 13:00:40.498183  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.500272  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.464344  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1468) took 1108 ms. Trace:
I20260709 13:00:40.503103  1619 rpcz_store.cc:276] 0709 13:00:39.356064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.308970 (+952906us) service_pool.cc:224] Handling call
0709 13:00:40.309308 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.338035 (+ 28727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.464063 (+126028us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5400116a54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:40.464270 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59353856}
W20260709 13:00:40.505101  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58361.8us
I20260709 13:00:40.505431  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.506038  1622 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:40.505770  1585 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:40.505152  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.509110  1621 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 3: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:40.504946  3472 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.511693  3588 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5.
I20260709 13:00:40.514110  3354 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:00:40.515388  3354 tablet_bootstrap.cc:492] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:00:40.516100  3354 ts_tablet_manager.cc:1403] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 1.695s	user 0.022s	sys 0.024s
I20260709 13:00:40.520835  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:40.521451  1617 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:40.490080  3577 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:40.511806  3587 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:40.524159  3577 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:40.525084  3577 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.516935  3291 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:40.531730  3291 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:40.523413  3499 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:40.535434  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.540351  3588 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:40.491459  3594 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.540971  3588 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.541455  3594 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:40.542286  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1952) took 1029 ms. Trace:
I20260709 13:00:40.542708  1687 rpcz_store.cc:276] 0709 13:00:39.512473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.513348 (+   875us) service_pool.cc:224] Handling call
0709 13:00:40.542075 (+1028727us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b540031ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:40.542215 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26987392}
I20260709 13:00:40.543190  3588 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.540439  3472 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:40.544312  1688 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:40.544364  1587 leader_election.cc:400] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:40.555478  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:40.556818  1618 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:40.552713  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:40.557854  1547 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:40.555778  1617 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:40.559208  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:40.559813  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:40.560745  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:40.562134  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:40.554272  1622 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:40.520730  3581 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:40.564525  1587 leader_election.cc:400] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:40.564440  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 306) took 1090 ms. Trace:
I20260709 13:00:40.538802  3587 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.625348  1547 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:40.630132  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:40.630991  1687 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:40.580907  1618 rpcz_store.cc:276] 0709 13:00:39.474144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.546229 (+1072085us) service_pool.cc:224] Handling call
0709 13:00:40.546567 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.564086 (+ 17519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.564368 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:40.628857  1690 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:40.633633  3531 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:40.563820  3588 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:40.629473  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:40.556594  3472 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:40.634208  3531 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.576234  3499 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:40.576093  3576 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:40.550487  3546 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:40.696497  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 60769.9us
I20260709 13:00:40.768433  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 226) took 2191 ms. Trace:
I20260709 13:00:40.642978  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:40.769531  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2021) took 1005 ms. Trace:
I20260709 13:00:40.999353  1541 rpcz_store.cc:276] 0709 13:00:38.576634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.619287 (+ 42653us) service_pool.cc:224] Handling call
0709 13:00:40.768030 (+2148743us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54000523d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:40.768209 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690889472}
I20260709 13:00:40.577628  3398 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:40.647949  1696 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:41.042601  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 1.
W20260709 13:00:41.043399  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 409871us
I20260709 13:00:40.763990  1620 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:41.060874  1696 pending_rounds.cc:85] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 2
I20260709 13:00:40.639293  1544 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:41.056288  1622 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:41.049437  1542 rpcz_store.cc:276] 0709 13:00:39.764601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.764917 (+   316us) service_pool.cc:224] Handling call
0709 13:00:39.765763 (+   846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.141818 (+376055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.769257 (+627439us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400208854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:40.769461 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813821184}
I20260709 13:00:41.061565  1696 pending_rounds.cc:107] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:41.065946  1696 raft_consensus.cc:2889] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:41.065037  1539 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:41.068364  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:41.069140  1544 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.071487  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.072252  1545 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:41.068625  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:41.074673  1539 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:41.073319  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:40.871068  3291 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.090811  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:41.094750  1544 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:40.956624  3443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.004s	sys 0.004s
W20260709 13:00:40.918176  3591 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.567s	user 0.003s	sys 0.001s
I20260709 13:00:41.096012  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:40.631260  3448 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:40.631422  3581 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:41.028228  3472 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:41.099378  3443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.007s	sys 0.004s
I20260709 13:00:41.044405  3532 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:41.044283  3209 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.042296  3343 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:41.091161  3398 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.099673  3260 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.108281  3576 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.105345  3281 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.105132  3471 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.118220  3398 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.182726  3260 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.122957  3463 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:40.943686  3607 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:41.119705  3448 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:41.189092  3187 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.194607  3443 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:41.223066  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 176811us
I20260709 13:00:41.212867  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 304) took 1869 ms. Trace:
I20260709 13:00:41.213974  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1162) took 1110 ms. Trace:
I20260709 13:00:41.237636  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.121007  3209 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.193722  1539 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:41.238377  1547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.010s	sys 0.022s
I20260709 13:00:41.133493  3343 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.238001  1618 rpcz_store.cc:276] 0709 13:00:40.103368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.635702 (+532334us) service_pool.cc:224] Handling call
0709 13:00:41.043919 (+408217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.100573 (+ 56654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.100619 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.100674 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:41.100723 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.213685 (+112962us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54002b6bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:41.213745 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.213907 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129684864}
I20260709 13:00:41.242020  3586 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.203202  3281 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.244724  3586 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.245172  3586 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.121265  3532 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.213475  3463 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:41.239075  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.206492  3260 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:41.260126  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 217687us
I20260709 13:00:41.203902  3555 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:00:41.202140  3576 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.216228  3495 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:41.279765  1547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.010s	sys 0.023s
I20260709 13:00:41.236804  3443 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.320998  3443 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.321303  3495 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.212541  3354 raft_consensus.cc:359] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.318202  1542 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:00:41.212698  3606 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.327536  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.328260  1541 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:41.200487  3471 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.236136  3187 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.335747  1541 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:41.334563  3606 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.337162  1542 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:00:41.338378  3594 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.004s
I20260709 13:00:41.341387  1539 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:41.225870  3607 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.284650  3587 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.283175  3463 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.317759  3524 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:41.378682  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 331939us
I20260709 13:00:41.380532  1541 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:41.340787  3531 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.379575  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:41.383980  1542 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:41.348814  3546 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:41.384876  1512 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.991s (SENT)
I20260709 13:00:41.388165  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:41.390547  1512 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.073s (SENT)
I20260709 13:00:41.260128  3581 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.403607  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:41.378895  3499 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.404714  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.325755  3448 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:41.420280  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1945) took 2067 ms (client timeout 2129 ms). Trace:
W20260709 13:00:41.420750  1688 rpcz_store.cc:269] 0709 13:00:39.352612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.504102 (+151490us) service_pool.cc:224] Handling call
0709 13:00:41.420091 (+1915989us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b540040f454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:41.420195 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104745728}
I20260709 13:00:41.237753  1614 rpcz_store.cc:276] 0709 13:00:39.343242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.847600 (+504358us) service_pool.cc:224] Handling call
0709 13:00:39.887594 (+ 39994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.169617 (+282023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.173224 (+  3607us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.269860 (+ 96636us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.365436 (+ 95576us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:40.365503 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.212272 (+846769us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002ca454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:41.212363 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.212439 (+    76us) raft_consensus.cc:1685] finished
0709 13:00:41.212462 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.212772 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3789,"raft.queue_time_us":39940,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":7568,"spinlock_wait_cycles":518330112,"thread_start_us":87971,"threads_started":1,"wal-append.queue_time_us":176347}
I20260709 13:00:41.422000  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1261) took 1456 ms. Trace:
I20260709 13:00:41.422397  1692 rpcz_store.cc:276] 0709 13:00:39.965259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.140630 (+175371us) service_pool.cc:224] Handling call
0709 13:00:40.142330 (+  1700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.243966 (+101636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.421750 (+1177784us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b540040f954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:41.421942 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167316736}
I20260709 13:00:41.422837  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.423641  2257 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:41.424690  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.425835  3469 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:41.427457  3187 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.413480  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1953) took 1897 ms. Trace:
I20260709 13:00:41.428148  1693 rpcz_store.cc:276] 0709 13:00:39.516200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.623637 (+107437us) service_pool.cc:224] Handling call
0709 13:00:39.623945 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.214045 (+590100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.413180 (+1199135us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b540023b4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:41.413374 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189480192}
I20260709 13:00:41.377453  3281 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.432261  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:41.433260  2265 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:41.436357  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.437819  2262 raft_consensus.cc:2393] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 2: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:41.413939  3614 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
I20260709 13:00:41.417831  3574 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:41.439801  3574 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:41.440975  3574 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:41.443720  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.444161  3580 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:41.421809  3576 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.444924  3580 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.445667  3576 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.444916  3281 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.447398  3281 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.449968  3281 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:41.444478  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.392578  3531 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.427223  3469 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:41.453884  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:41.459869  1693 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.455485  1688 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:41.386436  3619 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:00:41.461326  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:41.462980  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:41.464424  3613 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:00:41.464481  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 234) took 1566 ms (client timeout 2076 ms). Trace:
W20260709 13:00:41.464984  1540 rpcz_store.cc:269] 0709 13:00:39.898524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.903483 (+  4959us) service_pool.cc:224] Handling call
0709 13:00:41.464300 (+1560817us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400083ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:41.464408 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261393280}
I20260709 13:00:41.465332  3354 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
W20260709 13:00:41.467561  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 667) took 2168 ms (client timeout 1981 ms). Trace:
W20260709 13:00:41.468091  2261 rpcz_store.cc:269] 0709 13:00:39.299315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.301969 (+  2654us) service_pool.cc:224] Handling call
0709 13:00:41.467329 (+2165360us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54006f0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:41.467468 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697561344}
W20260709 13:00:41.455926  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.461372  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.393779  3599 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.454351  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.467435  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.442327  3574 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.479184  1618 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:41.470940  3531 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.482735  3531 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.482873  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.483562  2261 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:41.484114  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:41.485487  3463 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.486660  3463 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:41.486991  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:41.487586  1687 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:41.456235  2265 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:41.412221  3081 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.386499  3587 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.399202  3555 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.425835  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.471311  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:41.507791  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 411922us
I20260709 13:00:41.491528  1693 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:41.508574  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.489156  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.498428  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:41.509574  1688 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:41.466092  3354 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:41.459512  3281 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.503149  3343 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.503811  3587 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.504834  3607 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.458083  3572 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.475823  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:41.507961  1692 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:41.510679  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.511480  1618 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:41.446346  3576 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.535033  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:41.582273  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 71678.4us
I20260709 13:00:41.464489  3472 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.591987  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.511052  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:41.606236  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:41.611304  1692 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.602488  1618 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:41.402478  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.517581  3450 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:41.616647  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.618382  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.619131  1542 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:41.620922  1620 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:41.624153  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.625062  1618 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:41.633092  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:41.647598  1689 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:41.648722  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:41.650956  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:41.670280  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.677594  1616 raft_consensus.cc:2410] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:00:41.677683  3580 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.591609  3187 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:41.669111  3627 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:41.594892  3209 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.510363  3599 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.595989  2257 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:41.680866  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:41.681643  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1473) took 1797 ms. Trace:
I20260709 13:00:41.634001  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.674943  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.512748  3555 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.577670  3281 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.517271  3570 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:00:41.682053  1622 rpcz_store.cc:276] 0709 13:00:39.884215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.575992 (+691777us) service_pool.cc:224] Handling call
0709 13:00:40.576340 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.063515 (+487175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.681413 (+617898us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b5400231254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:41.681588 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102866688}
I20260709 13:00:41.725512  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.679790  1687 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:41.672498  1618 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:41.681846  1614 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:41.602861  3572 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.686362  1542 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:41.700150  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 309633us
I20260709 13:00:41.726260  1546 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:41.718007  3187 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:41.675980  3260 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.740334  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.685621  1613 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:41.741098  1618 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:41.684504  3606 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:41.682165  3495 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.762928  1616 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:41.733593  3580 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.715448  3471 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:41.736085  1512 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.075s (SENT)
I20260709 13:00:41.769233  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.770133  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:41.745528  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 482841us
I20260709 13:00:41.684823  3623 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:00:41.743078  3337 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.746474  3570 consensus_queue.cc:1243] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:41.777185  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:41.780787  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:41.781656  1687 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:41.764057  2229 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.000s	sys 0.014s
W20260709 13:00:41.761541  3577 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.009s
I20260709 13:00:41.772698  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.744316  3260 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.792847  1696 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:41.770877  3524 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:41.808177  1696 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:41.787853  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51823.1us
W20260709 13:00:41.790004  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 504861us
I20260709 13:00:41.810891  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.811537  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.781765  3495 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.782810  3627 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:41.791898  3577 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.009s
I20260709 13:00:41.794368  3209 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:41.815562  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:41.787611  2229 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.014s
I20260709 13:00:41.775231  3580 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:41.812400  3354 ts_tablet_manager.cc:1434] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 1.296s	user 0.028s	sys 0.032s
W20260709 13:00:41.818327  3559 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.005s	sys 0.011s
W20260709 13:00:41.827682  3559 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.006s	sys 0.011s
I20260709 13:00:41.829005  1615 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:41.822276  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.831583  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.813946  3495 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:41.787192  3337 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.834146  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 311) took 1299 ms. Trace:
I20260709 13:00:41.843482  1621 rpcz_store.cc:276] 0709 13:00:40.535052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.870783 (+335731us) service_pool.cc:224] Handling call
0709 13:00:41.047848 (+177065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.048150 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:41.120358 (+ 72208us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.377305 (+256947us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.429152 (+ 51847us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b180011f140. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:00:41.833826 (+404674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.833875 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:41.833918 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.833978 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.834092 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63146,"prepare.run_cpu_time_us":4825,"prepare.run_wall_time_us":58160,"raft.queue_time_us":67765,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"spinlock_wait_cycles":3708800,"thread_start_us":602763,"threads_started":2,"wal-append.queue_time_us":539838}
W20260709 13:00:41.851068  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.011s	sys 0.048s
W20260709 13:00:41.851684  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.048s
W20260709 13:00:41.852623  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.824261  3576 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:41.816386  3444 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:41.819000  1696 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.816363  3570 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:41.830226  1510 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:41.825371  3511 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:41.834595  1547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.044s
I20260709 13:00:41.856246  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:41.857972  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 420469us
W20260709 13:00:41.826859  3354 ts_tablet_manager.cc:1467] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Tablet startup took 1310ms
W20260709 13:00:41.839051  1512 leader_election.cc:336] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.090s (SENT)
I20260709 13:00:41.871783  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.823062  3618 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:41.831236  3472 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:41.867682  1547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.044s
W20260709 13:00:41.858454  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.874806  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.862504  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.869570  1696 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.809644  3187 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.819820  3471 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:00:41.844756  3495 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.866917  3511 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.872411  3450 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:41.871892  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:41.839258  3575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.645s	user 0.014s	sys 0.017s
W20260709 13:00:41.910346  2266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 663) took 2818 ms (client timeout 1785 ms). Trace:
W20260709 13:00:41.914160  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 235) took 2015 ms (client timeout 1846 ms). Trace:
W20260709 13:00:41.944118  1543 rpcz_store.cc:269] 0709 13:00:39.898814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.898969 (+   155us) service_pool.cc:224] Handling call
0709 13:00:41.913892 (+2014923us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54000465d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:41.914061 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522819328}
I20260709 13:00:41.914775  1692 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:41.920370  2231 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:41.860991  3405 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:41.866532  3570 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.863191  3444 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:41.879137  3624 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:00:41.936054  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.933833  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:41.861397  3637 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:41.873653  3081 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:00:41.943313  2266 rpcz_store.cc:269] 0709 13:00:39.092386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.092647 (+   261us) service_pool.cc:224] Handling call
0709 13:00:41.910113 (+2817466us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54006aead4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:41.910270 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697264000}
W20260709 13:00:41.916481  3621 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
W20260709 13:00:41.935171  3622 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 13:00:41.878291  3572 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:41.877436  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:41.878119  3260 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:41.948578  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 86192.3us
I20260709 13:00:42.007629  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:41.942170  3511 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.875499  3639 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:41.875123  3620 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:41.871574  3354 ts_tablet_manager.cc:1469] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Trace:
0709 13:00:32.216233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.241662 (+ 25429us) service_pool.cc:224] Handling call
0709 13:00:33.817154 (+1575492us) ts_tablet_manager.cc:934] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175)
0709 13:00:34.932163 (+1115009us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b4c0013eb80. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f18ba6a20 00007f7f18bb7a29 00007f7f18bb813f 00007f7f18b7c2ab 00007f7f18ba9f3c 00007f7f18baa461 00007f7f18baa768 00007f7f1e9302eb 00007f7f1f855d3b 00007f7f1f850008 00007f7f1f84f405
0709 13:00:36.815458 (+1883295us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:37.223508 (+408050us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:37.227779 (+  4271us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:37.288304 (+ 60525us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:37.288723 (+   419us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:37.289083 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:37.289285 (+   202us) inbound_call.cc:177] Queueing success response
0709 13:00:38.820813 (+1531528us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:40.516564 (+1695751us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:40.524044 (+  7480us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:40.527545 (+  3501us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":66943,"mutex_wait_us":180001,"raft.queue_time_us":63233,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":27631,"spinlock_wait_cycles":98448256,"tablet-copy.queue_time_us":1323592,"tablet-download-pool.queue_time_us":30293,"tablet-download-pool.run_cpu_time_us":1417,"tablet-download-pool.run_wall_time_us":918409,"thread_start_us":1304362,"threads_started":2}
I20260709 13:00:41.877763  3281 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:41.991693  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.927544  3633 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.942799  3575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.754s	user 0.014s	sys 0.018s
I20260709 13:00:41.977334  3549 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:41.972048  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51798.9us
I20260709 13:00:41.880419  3524 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:41.946527  3209 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:41.929481  3448 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:42.012899  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 173903us
I20260709 13:00:42.013921  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2026) took 1386 ms. Trace:
I20260709 13:00:42.001250  3599 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:41.963721  3570 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:41.963426  3444 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:41.975198  3628 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:00:42.015885  3639 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.948220  3405 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:41.961885  3499 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.008603  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:41.965304  3081 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:41.981491  3588 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:42.009936  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 135607us
I20260709 13:00:42.005676  3637 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:42.056289  3656 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:42.056643  3624 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:42.068060  1547 rpcz_store.cc:276] 0709 13:00:40.627693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.630743 (+  3050us) service_pool.cc:224] Handling call
0709 13:00:40.631026 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.631207 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:41.325096 (+693889us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.013529 (+688433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.013590 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:42.013649 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.013724 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.013853 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":744449,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2332,"raft.queue_time_us":120226,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7441,"thread_start_us":1330291,"threads_started":3,"wal-append.queue_time_us":545704}
W20260709 13:00:42.249929  1661 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:35005, user_credentials={real_user=slave}} blocked reactor thread for 46147.3us
I20260709 13:00:42.027910  3559 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:42.056696  3627 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.053807  3555 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.056943  3572 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:42.152194  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 241) took 1596 ms. Trace:
I20260709 13:00:42.068675  3343 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:42.141449  3499 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.135601  3450 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.136974  3448 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.191023  3637 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:42.147766  3588 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:42.280663  1538 rpcz_store.cc:276] 0709 13:00:40.555919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.576021 (+ 20102us) service_pool.cc:224] Handling call
0709 13:00:40.624664 (+ 48643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.624999 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.625028 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.689023 (+ 63995us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.370887 (+681864us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.370930 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.371000 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.151915 (+780915us) raft_consensus.cc:1685] finished
0709 13:00:42.151943 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.152118 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6687,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":39186,"thread_start_us":317558,"threads_started":1,"wal-append.queue_time_us":847497}
I20260709 13:00:42.144413  3081 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.194756  3337 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:42.197917  3638 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
W20260709 13:00:42.198975  3641 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
W20260709 13:00:42.199692  3645 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 13:00:42.200547  3629 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:00:42.201181  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.365455  1543 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:42.365736  3398 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.134s	user 0.008s	sys 0.003s
I20260709 13:00:42.366951  3663 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.367435  3663 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.202062  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.369649  3281 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.370137  3281 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.370564  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:42.372046  3281 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:42.372133  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.372917  1616 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:42.249540  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:42.251812  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 243282us
I20260709 13:00:42.375918  3654 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:42.255793  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1474) took 2343 ms. Trace:
I20260709 13:00:42.146003  2259 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:42.249135  3577 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:42.376721  1617 rpcz_store.cc:276] 0709 13:00:39.912003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.625149 (+713146us) service_pool.cc:224] Handling call
0709 13:00:41.047264 (+422115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.047739 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.047787 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.104651 (+ 56864us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.373735 (+269084us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:41.373773 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.373840 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.255476 (+881636us) raft_consensus.cc:1685] finished
0709 13:00:42.255507 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.255697 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":266789,"threads_started":1,"wal-append.queue_time_us":540752}
I20260709 13:00:42.377604  3577 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.138859  3639 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.145499  3632 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.379029  3632 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.381268  3632 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.275307  3570 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.279470  3580 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.383260  3570 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.383651  3577 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.176054  3618 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.242326  3575 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:42.285909  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.384558  3575 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:42.175333  3463 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:42.384966  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 135705us
I20260709 13:00:42.385350  3463 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.385541  3575 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.257820  3656 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.384588  3618 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.387485  3463 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.388417  3463 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.203192  3209 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:42.388797  3618 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:42.275671  3649 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:00:42.366153  3398 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.389312  3209 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.390086  3499 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.262571  3627 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:42.390802  3627 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.391465  3209 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.257246  3559 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.392097  3559 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:42.392795  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.129s (SENT) [suppressed 19 similar messages]
I20260709 13:00:42.058691  3633 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.202386  3642 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:42.378306  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.388453  3656 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:42.388897  3654 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.149012  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:42.393599  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.364585  3661 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:42.396145  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.396662  1696 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:42.290057  3588 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.398764  1617 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:42.385600  3443 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.064s	user 0.007s	sys 0.003s
I20260709 13:00:42.406333  1543 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:42.399363  3586 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.154s	user 0.012s	sys 0.002s
I20260709 13:00:42.624621  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.625008  3586 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.459519  3634 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
I20260709 13:00:42.625910  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.624275  3398 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.625360  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.627415  3586 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.627600  3653 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.627728  1617 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:42.447062  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.629098  2260 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:42.628990  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:42.629585  3574 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.151s	user 0.010s	sys 0.002s
I20260709 13:00:42.286199  3405 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:42.274030  3650 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:00:42.630932  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:42.418998  2266 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:42.631482  1687 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
W20260709 13:00:42.421518  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 366415us
I20260709 13:00:42.420073  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.634914  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.635816  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:42.624362  1695 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.636989  1695 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:42.640745  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 247984us
W20260709 13:00:42.472995  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.350730  3572 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.630147  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.449079  1538 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:42.440841  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.579110  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:42.440335  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.460889  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 314) took 1068 ms. Trace:
I20260709 13:00:42.641851  1617 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:42.442524  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:42.649223  1689 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.395237  3575 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.647680  2264 rpcz_store.cc:276] 0709 13:00:41.392088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.397078 (+  4990us) service_pool.cc:224] Handling call
0709 13:00:41.463379 (+ 66301us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:41.463543 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.728557 (+265014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.728589 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.728636 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:41.728675 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.458385 (+729710us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54003ae154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:42.458507 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.460713 (+  2206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642231040}
I20260709 13:00:42.656986  1696 pending_rounds.cc:85] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 3
I20260709 13:00:42.657476  1696 pending_rounds.cc:107] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:42.657912  1696 raft_consensus.cc:2889] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:42.412839  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.642346  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:42.564673  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:42.441792  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.429909  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1467) took 3067 ms. Trace:
I20260709 13:00:42.614158  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:42.642062  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 493174us
I20260709 13:00:42.661446  1615 rpcz_store.cc:276] 0709 13:00:39.344672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.847861 (+503189us) service_pool.cc:224] Handling call
0709 13:00:39.848174 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.829537 (+1981363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.411295 (+581758us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b5400417b54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:42.411581 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4555169024}
I20260709 13:00:42.441792  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:42.655323  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1258) took 2678 ms. Trace:
I20260709 13:00:42.654484  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.658885  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.664594  1543 raft_consensus.cc:2410] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:42.398391  3209 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.663691  1694 rpcz_store.cc:276] 0709 13:00:39.964420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.115049 (+150629us) service_pool.cc:224] Handling call
0709 13:00:41.911029 (+1795980us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:41.911297 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.940959 (+ 29662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.940994 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.941572 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.151233 (+209661us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:42.411968 (+260735us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.413486 (+  1518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.413609 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.413665 (+    56us) raft_consensus.cc:1685] finished
0709 13:00:42.642596 (+228931us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.642956 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94288,"prepare.queue_time_us":475547,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":139073,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":62258,"spinlock_wait_cycles":4492672,"thread_start_us":444420,"threads_started":3,"wal-append.queue_time_us":334201}
I20260709 13:00:42.669750  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1972) took 1061 ms. Trace:
W20260709 13:00:42.670090  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.666127  1541 raft_consensus.cc:2368] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:42.658110  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:42.628104  3653 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:42.672762  1616 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:42.670248  1696 rpcz_store.cc:276] 0709 13:00:41.608811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.765905 (+157094us) service_pool.cc:224] Handling call
0709 13:00:41.766252 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.669446 (+903194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.669686 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.675750  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.641001  3343 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:42.462599  3633 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.652027  3398 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.682190  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.693812  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.684783  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:42.659592  1695 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.652091  1614 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:42.688083  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.000s	sys 0.064s
I20260709 13:00:42.688474  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:42.699734  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.000s	sys 0.065s
I20260709 13:00:42.700017  1547 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
W20260709 13:00:42.700397  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.452286  3448 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:42.704406  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.691918  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.652560  3634 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:42.706477  1695 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.706607  3444 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.662051  3499 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.637302  3555 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:42.671814  3581 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.702836  1689 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:42.443158  3654 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.389027  3463 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.667178  3580 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:00:42.667639  3619 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:42.672732  3524 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:00:42.654917  3443 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.708254  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.708298  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.708057  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1967) took 1102 ms. Trace:
I20260709 13:00:42.778685  1688 rpcz_store.cc:276] 0709 13:00:41.606179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.606378 (+   199us) service_pool.cc:224] Handling call
0709 13:00:42.707872 (+1101494us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000b31d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:42.708004 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430867712}
W20260709 13:00:42.714138  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 71895.2us
I20260709 13:00:42.780510  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:42.781657  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:42.738765  3666 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:42.783221  3666 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:42.783571  3606 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.783974  3606 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.784318  3606 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.784195  3666 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:42.786006  3511 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.760s	user 0.009s	sys 0.001s
I20260709 13:00:42.677783  3209 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.788118  3209 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.788679  3664 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:42.789126  3664 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.789439  3664 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.738898  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.791687  3444 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.707613  3636 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:42.655097  3661 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.792339  3636 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:42.792765  3636 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.766883  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.794219  3463 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.793876  3661 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.742894  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:42.751470  3581 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:42.795542  3581 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:42.705302  1659 connection.cc:256] RPC call timeout handler was delayed by -1.781938212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
I20260709 13:00:42.795696  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:42.796133  1659 connection.cc:256] RPC call timeout handler was delayed by -1.6221414429999754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
I20260709 13:00:42.796298  1547 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:42.796489  1659 connection.cc:256] RPC call timeout handler was delayed by -1.2447323969999502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:00:42.797727  3443 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.740262  2264 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:42.744181  3572 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.745222  3555 consensus_queue.cc:1243] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:42.745411  2263 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:42.799816  1693 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:42.745961  3450 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.800424  3450 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.801225  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1469) took 3339 ms. Trace:
I20260709 13:00:42.801620  1619 rpcz_store.cc:276] 0709 13:00:39.461911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.511840 (+1049929us) service_pool.cc:224] Handling call
0709 13:00:40.512160 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.814970 (+1302810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.815002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.815044 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.818581 (+  3537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.801001 (+982420us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002b7fd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:42.801046 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.801172 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995984128}
I20260709 13:00:42.746639  3652 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:42.802899  3652 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:42.803767  3604 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 2.355s	user 0.021s	sys 0.012s
I20260709 13:00:42.696619  3398 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.786505  3511 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.806495  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.748384  3499 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.807354  1542 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:42.753170  3659 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:00:42.757695  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 53645.4us
I20260709 13:00:42.762535  3654 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.762727  3559 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.819245  3647 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:42.819722  3647 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:42.820393  3559 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:42.768862  3671 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:42.820526  3647 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.802367  3450 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:42.785140  3532 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.795365  3627 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.745247  3527 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:42.805343  3652 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:42.747092  3570 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.750056  1695 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:00:42.807453  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 130865us
I20260709 13:00:42.822744  3647 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:42.867014  1695 pending_rounds.cc:85] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 1
I20260709 13:00:42.867372  1695 pending_rounds.cc:107] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:42.867606  1695 raft_consensus.cc:2889] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:42.860983  3511 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.798355  3443 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.808000  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:42.869148  3443 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.873253  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1164) took 2756 ms. Trace:
I20260709 13:00:42.873703  1613 rpcz_store.cc:276] 0709 13:00:40.117084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.737735 (+620651us) service_pool.cc:224] Handling call
0709 13:00:40.738174 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.745186 (+1007012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.872972 (+1127786us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54002b70d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:42.873182 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118150400}
I20260709 13:00:42.807598  1539 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:42.877038  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.877605  1539 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:42.811473  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:42.879376  3260 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:42.812199  3675 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.815171  3617 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:42.880718  3617 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:42.781899  3495 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.820s	user 0.008s	sys 0.003s
I20260709 13:00:42.811399  1547 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:42.826835  3639 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.881632  3495 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.834491  1546 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:42.835578  3398 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.862828  3606 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.862715  3081 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.865188  3627 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.867516  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:42.828609  1542 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:42.904901  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.905942  1547 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:42.915726  3495 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:42.924821  1539 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:42.948027  3588 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.948197  3581 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:42.951284  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 143367us
W20260709 13:00:42.952694  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 141318us
W20260709 13:00:42.952445  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85015us
I20260709 13:00:42.951896  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:42.946302  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.957881  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:42.958734  1512 connection.cc:256] RPC call timeout handler was delayed by -1.1375308830000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
I20260709 13:00:42.958953  2258 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:42.946446  2261 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:42.959167  1512 connection.cc:256] RPC call timeout handler was delayed by -1.0369695679999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 13:00:42.958500  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:42.959580  1512 connection.cc:256] RPC call timeout handler was delayed by -1.0052308830000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:00:42.960444  3664 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:42.951928  3463 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:42.969550  3606 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.971089  1617 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:42.972195  3581 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.972018  3636 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.973635  3664 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.958529  1539 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:42.867010  3570 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:42.981948  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:42.954701  3499 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.988921  3443 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:42.989992  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:42.990278  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.991580  1547 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:42.989074  3260 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:42.976872  3676 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:42.991955  2262 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:42.992743  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:42.993983  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:42.982527  3588 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:42.984799  3664 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.000036  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.005837  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.000221  1539 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:43.007123  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.013010  1688 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:43.014705  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.017351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.018005  1690 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:43.016036  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.018286  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:43.018849  2264 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:43.019677  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59582.4us
I20260709 13:00:43.019894  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:42.983358  3652 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:43.026657  1691 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:43.026891  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.002231  3623 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.028314  1547 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:43.029006  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:43.030319  1539 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.031656  3592 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:43.031781  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.032253  3592 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:43.032442  1689 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:43.032998  3081 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.033150  3592 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.034886  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.035987  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.029556  3260 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.037231  3260 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:43.037644  3260 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.040338  3636 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.029752  3478 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.043635  1542 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:00:43.044966  1542 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:43.051028  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.052201  2264 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:43.031229  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:43.053490  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.049456  3260 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.058312  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.060420  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.061038  1691 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.061479  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 315) took 1394 ms. Trace:
I20260709 13:00:43.061908  1622 rpcz_store.cc:276] 0709 13:00:41.667566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.740917 (+ 73351us) service_pool.cc:224] Handling call
0709 13:00:41.741203 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.846556 (+105353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.846585 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.846738 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:41.846771 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.061254 (+1214483us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002b66d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.061304 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.061421 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241849600}
I20260709 13:00:43.067655  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:43.054381  3665 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:43.075114  3676 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.075599  3676 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:43.076243  3676 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.075541  3665 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:43.062956  1687 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:43.078338  3665 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.078859  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.079691  1687 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.087618  3291 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:43.104992  1539 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.117213  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:43.118891  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.118937  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.119830  2264 raft_consensus.cc:2368] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:43.119706  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.122699  3570 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:43.122937  1687 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:43.123533  3559 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.122097  3628 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.124374  1510 leader_election.cc:400] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:43.124675  1510 leader_election.cc:403] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:00:43.124804  1691 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:43.121794  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:43.126246  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.126243  1622 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:43.127357  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.128050  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.128521  3664 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.128615  3448 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:43.128654  3627 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.130712  3657 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.130789  3664 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:43.134078  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.135946  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.136896  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.128521  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:43.128551  3628 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.148325  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:43.138067  1687 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:43.150089  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.152876  1613 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.127020  3636 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.154414  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.135421  3654 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:00:43.155933  3654 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:43.156292  3654 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:43.157235  3654 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.156045  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.159376  1613 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.162130  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.162712  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 319) took 1416 ms. Trace:
I20260709 13:00:43.124058  3559 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.163228  1613 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.164201  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.164382  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:43.164906  3559 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.129338  3542 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.165779  3542 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:43.166157  3542 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.142861  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1167) took 1678 ms. Trace:
I20260709 13:00:43.142192  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.167085  1620 rpcz_store.cc:276] 0709 13:00:41.455069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.455242 (+   173us) service_pool.cc:224] Handling call
0709 13:00:43.132990 (+1677748us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000eea54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:43.133124 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346900352}
I20260709 13:00:43.144430  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.168051  1622 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:00:43.168237  1616 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.144709  1688 raft_consensus.cc:606] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:43.141101  3515 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:43.145684  3664 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.146202  1618 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:43.144419  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.131309  3495 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:00:43.146309  3575 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.174901  3575 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.163273  1614 rpcz_store.cc:276] 0709 13:00:41.746725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.763587 (+ 16862us) service_pool.cc:224] Handling call
0709 13:00:41.789989 (+ 26402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.701158 (+911169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.162420 (+461262us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400062054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.162613 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945753984}
I20260709 13:00:43.176443  1614 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.147380  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.177101  3575 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.146752  3398 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.162819  3657 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:43.181840  3657 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:43.176345  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:43.176987  3570 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:43.177098  1619 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:43.178217  3398 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.187407  1619 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:43.178682  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48920us
I20260709 13:00:43.147500  3230 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.158700  3654 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.181949  3648 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:00:43.182638  3515 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.191030  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.191892  1539 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.192250  3687 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.188586  3398 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.154940  3636 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.194489  3478 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.195160  3636 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:43.196714  3662 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.652s	user 0.003s	sys 0.001s
I20260709 13:00:43.165954  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.205430  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.211498  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.219190  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.219669  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.219864  1547 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.215327  3648 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.220643  1543 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:00:43.221450  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 91759.7us
I20260709 13:00:43.217082  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:43.222582  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.223233  1539 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:43.224077  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:43.224485  1620 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:43.225255  1619 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:43.225867  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.227028  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:43.227353  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.228034  1691 raft_consensus.cc:2368] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3.
I20260709 13:00:43.228596  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1179) took 1024 ms. Trace:
I20260709 13:00:43.229138  1617 rpcz_store.cc:276] 0709 13:00:42.204332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.660176 (+455844us) service_pool.cc:224] Handling call
0709 13:00:42.687153 (+ 26977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.971507 (+284354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.228291 (+256784us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54002a7bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.228517 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652596480}
I20260709 13:00:43.203007  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.203722  3515 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.190997  3575 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:43.232582  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.211777  3627 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:43.215175  3478 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:43.238236  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.192636  3687 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:43.238756  1691 raft_consensus.cc:2376] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3. Re-sending same reply.
I20260709 13:00:43.223917  3546 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:00:43.233503  3495 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:43.233114  3606 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:43.236214  1613 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.234390  3633 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:43.234683  3343 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:43.237286  3599 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:43.245618  3209 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:00:43.240052  3527 raft_consensus.cc:2764] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:43.253262  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.246781  1614 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.240439  3687 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.235971  3532 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:00:43.263741  1691 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:43.264164  2265 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:43.237362  3575 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.270438  3632 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:43.245998  3592 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:00:43.250385  3343 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.243018  3627 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:00:43.278437  3666 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:00:43.295064  3575 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.233508  3676 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.298383  3676 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.299226  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.300420  1691 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:43.301007  3260 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.301678  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.302386  1691 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.303934  3592 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:43.304126  3639 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.304397  3592 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:43.305284  3592 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.305760  3639 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:43.306265  3639 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.307325  3450 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:43.310848  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.310886  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:43.311674  2265 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.312680  3542 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.313799  2263 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.315881  1617 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.316979  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.318732  1621 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:43.259699  3606 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:43.298278  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.336035  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.338889  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:43.371872  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.372756  1620 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.344030  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:43.356247  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.380052  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.388016  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:43.389648  1620 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:43.266337  3549 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:00:43.325920  3592 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.291179  3343 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.289618  3632 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:43.319618  3576 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.410555  3443 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:43.411206  3443 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:43.412124  1538 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:43.412310  1691 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:43.412213  3443 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.414001  3443 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.410651  3657 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.416949  3657 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.420790  3663 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:43.423555  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 321) took 1074 ms. Trace:
I20260709 13:00:43.423946  1615 rpcz_store.cc:276] 0709 13:00:42.349302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.672978 (+323676us) service_pool.cc:224] Handling call
0709 13:00:42.673252 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.875122 (+201870us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:42.982852 (+107730us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.023554 (+ 40702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.023603 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.023763 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.423326 (+399563us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002ca454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.423369 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.423492 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":152789,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":78,"raft.run_wall_time_us":3758,"spinlock_wait_cycles":507141120,"thread_start_us":147653,"threads_started":2,"wal-append.queue_time_us":48800}
I20260709 13:00:43.425848  3657 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:43.430424  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:43.430909  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:43.428819  3687 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.393664  3230 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:43.388888  3542 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.445027  3687 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.397609  3639 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.455605  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.390013  3575 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:00:43.442051  3654 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:43.400100  3398 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:00:43.457686  1691 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:43.435173  3627 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:00:43.440438  3576 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.460124  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 327) took 1039 ms. Trace:
I20260709 13:00:43.462149  3230 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:43.559115  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.559886  1691 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.470000  3654 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:43.518563  3527 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:00:43.575084  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.559584  3495 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:43.571097  3463 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:43.614732  2265 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.622502  3654 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.623569  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.624219  1689 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:43.623804  3617 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.624923  3617 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:43.625162  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.625762  1689 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:43.626529  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.629199  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.630100  1543 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.631283  1540 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:43.631304  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.631760  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.632360  1539 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:43.632419  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.633013  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.633605  1539 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:43.514042  3606 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.633646  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.637414  1544 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:43.631424  1538 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:43.628479  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.639566  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.640132  1538 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:43.640136  1689 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:43.643006  1691 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.519731  3632 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.644569  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.615736  3588 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:43.657445  1691 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.662387  1538 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:43.663955  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.664750  1691 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.664731  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.666805  1547 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:43.667276  1547 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:43.660506  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 246777us
W20260709 13:00:43.672295  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.656338  3478 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.673738  1689 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.684509  1538 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:43.684341  3495 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.668167  1547 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.687451  1547 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:43.692080  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.673360  3632 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.701766  1546 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:43.662921  3588 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.698323  3697 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.712505  1547 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:00:43.716233  1547 pending_rounds.cc:85] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 3
I20260709 13:00:43.716686  1547 pending_rounds.cc:107] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:00:43.717089  1547 raft_consensus.cc:2889] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.715641  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.723632  1689 raft_consensus.cc:2368] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:43.727262  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.727591  1691 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:43.697074  3478 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.728633  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.729617  1691 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:43.730077  3478 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:43.730410  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.730798  1689 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:43.731551  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.732101  1691 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4. Re-sending same reply.
I20260709 13:00:43.732916  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.733876  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.734851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.741843  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.682062  3230 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.742707  1691 raft_consensus.cc:2368] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:43.744885  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.746078  1547 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:43.745297  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:43.751147  3664 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
I20260709 13:00:43.751734  3664 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.754041  3664 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.517275  2257 rpcz_store.cc:276] 0709 13:00:42.417858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.423884 (+  6026us) service_pool.cc:224] Handling call
0709 13:00:42.445023 (+ 21139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.672714 (+227691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.676884 (+  4170us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.738302 (+ 61418us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.945644 (+207342us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:42.952347 (+  6703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.432971 (+480624us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54006a0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.433029 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.433077 (+    48us) raft_consensus.cc:1685] finished
0709 13:00:43.433094 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.457064 (+ 23970us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42365,"raft.queue_time_us":57328,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3646,"spinlock_wait_cycles":52736256,"thread_start_us":152843,"threads_started":1,"wal-append.queue_time_us":260144}
I20260709 13:00:43.759955  3588 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.761027  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.736155  3697 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.765048  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.767364  1691 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:43.773293  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.773963  1691 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:43.774886  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.776942  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1974) took 1374 ms. Trace:
I20260709 13:00:43.777382  1692 rpcz_store.cc:276] 0709 13:00:42.402193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.402374 (+   181us) service_pool.cc:224] Handling call
0709 13:00:42.402746 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.677133 (+274387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.677160 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.677206 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:42.677255 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.776654 (+1099399us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b540012d4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.776703 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.776871 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630635904}
I20260709 13:00:43.777886  3405 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.779187  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.781060  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.781862  1692 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:43.783852  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:43.784749  1692 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:43.785275  2230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.026s	sys 0.012s
W20260709 13:00:43.785656  2230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.026s	sys 0.012s
W20260709 13:00:43.785941  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 553951us
I20260709 13:00:43.787976  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:43.788888  1692 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:43.792117  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.767364  3343 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.795315  3343 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.796993  3230 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.801815  1691 raft_consensus.cc:2410] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:43.811848  1618 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:00:43.814036  3230 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:43.815744  3599 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:43.816201  3599 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:43.792637  3664 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:43.817972  3664 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:43.818307  3664 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:43.819379  1691 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.820214  1692 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:43.822577  1691 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:43.817121  3230 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:43.813680  3688 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:00:43.820302  3664 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.828137  3664 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:43.842038  1618 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:43.842134  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:43.844842  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:43.998974  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.007114  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.889989  2266 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:44.087380  2266 pending_rounds.cc:85] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 7
I20260709 13:00:44.091915  2266 pending_rounds.cc:107] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 13:00:43.889709  3209 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:43.876103  3599 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:43.838819  3697 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:43.880511  3592 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
W20260709 13:00:43.843974  3704 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:44.102360  1616 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.077440  3628 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:44.104331  1613 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:44.104517  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.141921  1538 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:44.108428  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.109584  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.113267  1544 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:44.113945  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:43.879755  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 334) took 1102 ms. Trace:
I20260709 13:00:43.869875  2257 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:43.874578  2259 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:44.118395  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.118889  1547 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:00:44.121224  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 145219us
I20260709 13:00:44.122044  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.157874  1540 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:44.158478  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:44.158885  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.159142  1544 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:00:44.123540  1557 tablet_copy_service.cc:342] P 9fbc4df0bb934bba941cfa20c0afead2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-459063895bc847b9a15dc71e10b36267 received from {username='slave'} at 127.0.0.1:35956
W20260709 13:00:44.118894  3594 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:43.889106  3689 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:00:44.137205  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.137699  1512 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.522s (SENT)
I20260709 13:00:44.140295  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.145015  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:44.151666  1688 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:44.152813  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.145777  2258 rpcz_store.cc:276] 0709 13:00:42.777540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.797153 (+ 19613us) service_pool.cc:224] Handling call
0709 13:00:42.797503 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.959680 (+162177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.879399 (+919719us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54006676d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:43.879671 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353991424}
I20260709 13:00:44.157229  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.118361  2266 raft_consensus.cc:2889] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.160049  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.181172  1544 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:44.292054  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:44.293970  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.243784  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.303853  1690 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:44.303000  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.221879  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.193965  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.302851  1687 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:44.181074  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:44.308362  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 170700us
I20260709 13:00:44.309155  1587 leader_election.cc:400] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:44.309607  1587 leader_election.cc:403] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:44.303447  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1270) took 1086 ms. Trace:
I20260709 13:00:44.312916  1688 rpcz_store.cc:276] 0709 13:00:43.217401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.108168 (+890767us) service_pool.cc:224] Handling call
0709 13:00:44.303387 (+195219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.314890  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:44.314564  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 133598us
I20260709 13:00:44.316347  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:44.316037  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:44.289866  3710 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:00:44.347683  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:44.349138  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:44.351601  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:44.297910  3664 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.307621  3689 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:44.293977  1540 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:44.327351  1557 tablet_copy_service.cc:434] P 9fbc4df0bb934bba941cfa20c0afead2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-459063895bc847b9a15dc71e10b36267 on tablet 459063895bc847b9a15dc71e10b36267 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:44.360409  3676 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:44.360841  3676 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:44.361243  3576 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:44.361729  3676 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:44.362802  3676 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:44.364792  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.365535  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.319522  3617 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:44.368538  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2050) took 1411 ms. Trace:
I20260709 13:00:44.368933  1546 rpcz_store.cc:276] 0709 13:00:42.957336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.958170 (+   834us) service_pool.cc:224] Handling call
0709 13:00:44.368379 (+1410209us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54000848d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:44.368481 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705939712}
I20260709 13:00:44.178311  3688 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.187s
I20260709 13:00:44.314210  3209 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:00:44.346678  3588 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:44.380097  1544 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:44.380415  1546 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:00:44.380290  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.383533  1546 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:44.383889  1541 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:44.370716  3664 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.385921  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.319317  3230 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:00:44.419679  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1984) took 1035 ms. Trace:
I20260709 13:00:44.177320  3653 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:44.424563  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 1976) took 2015 ms (client timeout 1970 ms). Trace:
W20260709 13:00:44.425227  1693 rpcz_store.cc:269] 0709 13:00:42.409461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.564293 (+154832us) service_pool.cc:224] Handling call
0709 13:00:44.424307 (+1860014us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540019c154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:44.424464 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322141056}
I20260709 13:00:44.428113  3653 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:44.428217  1696 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:00:44.428877  1696 pending_rounds.cc:85] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 1
I20260709 13:00:44.429185  1696 pending_rounds.cc:107] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:00:44.429481  1696 raft_consensus.cc:2889] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.431241  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.431775  1690 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:44.433638  1690 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:44.441702  1546 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:00:44.442167  1546 pending_rounds.cc:85] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 5
I20260709 13:00:44.442408  1546 pending_rounds.cc:107] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:00:44.442762  1546 raft_consensus.cc:2889] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.420351  1691 rpcz_store.cc:276] 0709 13:00:43.384522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.839395 (+454873us) service_pool.cc:224] Handling call
0709 13:00:43.839716 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.840082 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.840112 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.840549 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.123163 (+282614us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:44.123203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.127168 (+  3965us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.419353 (+292185us) raft_consensus.cc:1685] finished
0709 13:00:44.419385 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.419585 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":826,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2600,"thread_start_us":227832,"threads_started":1,"wal-append.queue_time_us":267465}
I20260709 13:00:44.448355  1693 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:44.449308  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1992) took 1062 ms. Trace:
I20260709 13:00:44.449745  1693 rpcz_store.cc:276] 0709 13:00:43.395975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.426290 (+1030315us) service_pool.cc:224] Handling call
0709 13:00:44.448071 (+ 21781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.448987 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.449235 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.430428  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1993) took 1033 ms. Trace:
W20260709 13:00:44.450731  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.451073  1696 rpcz_store.cc:276] 0709 13:00:43.396880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.427360 (+1030480us) service_pool.cc:224] Handling call
0709 13:00:44.427727 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.430076 (+  2349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.430355 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.453956  1691 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:44.457553  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 86971.1us
I20260709 13:00:44.459420  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:44.480340  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.458727  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 136297us
I20260709 13:00:44.496690  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.498096  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:44.511256  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 201870us
W20260709 13:00:44.512193  1512 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.693s (SENT)
I20260709 13:00:44.516775  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.499210  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.517922  3617 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:44.518209  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.519879  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.532202  3653 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:44.535176  3718 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:44.535817  3718 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:44.540701  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.545228  3209 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.518486  3617 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:44.545452  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.505970  3230 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:44.521708  3588 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:44.556370  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:44.556790  3697 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:44.564744  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 243) took 3932 ms. Trace:
W20260709 13:00:44.565706  2259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 519) took 1823 ms (client timeout 2208 ms). Trace:
W20260709 13:00:44.566162  2259 rpcz_store.cc:269] 0709 13:00:42.742602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.761723 (+ 19121us) service_pool.cc:224] Handling call
0709 13:00:43.310651 (+548928us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:00:44.565508 (+1254857us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400723dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:44.565647 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091686784}
I20260709 13:00:44.554915  3209 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:44.569061  3209 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:44.569694  2262 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.570015  2258 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:44.588616  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.565279  1545 rpcz_store.cc:276] 0709 13:00:40.632426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.101535 (+469109us) service_pool.cc:224] Handling call
0709 13:00:41.103584 (+  2049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.283630 (+180046us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:41.761225 (+477595us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.560217 (+1798992us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b18004156c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf 00007f7f1a8f4038
0709 13:00:43.566843 (+  6626us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.567092 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.567158 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.567227 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.564378 (+997151us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400047ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:44.564445 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.564637 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11093,"prepare.queue_time_us":1865788,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":85,"raft.queue_time_us":63183,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":28404,"spinlock_wait_cycles":422902400,"thread_start_us":572819,"threads_started":2,"wal-append.queue_time_us":255743}
I20260709 13:00:44.554987  3675 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.617853  3675 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.620297  3675 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:44.620719  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.600745  2260 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.600781  3653 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.606823  3676 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:00:44.607242  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:44.621124  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.608156  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.609012  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.610852  3700 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:44.624974  1693 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:44.626974  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.627704  1693 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:44.629340  1693 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:00:44.611833  3463 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:44.611681  3617 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.613047  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1285) took 1052 ms. Trace:
I20260709 13:00:44.614975  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.617244  3697 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.622591  1696 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:00:44.634289  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 114501us
I20260709 13:00:44.623536  1691 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:44.633749  1689 rpcz_store.cc:276] 0709 13:00:43.560921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.726889 (+165968us) service_pool.cc:224] Handling call
0709 13:00:44.612798 (+885909us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b54000b45d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:44.612970 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6310144}
I20260709 13:00:44.638577  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.536698  3718 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:44.660830  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.622403  3653 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:44.598886  3209 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:00:44.636643  3463 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.633405  3607 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:44.636453  3697 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:44.666333  3676 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:44.680706  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 222399us
I20260709 13:00:44.669765  2259 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:44.671945  3653 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.683995  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 1985) took 1299 ms. Trace:
I20260709 13:00:44.680074  3697 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:44.701072  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:44.711762  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.681275  3209 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:44.719732  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.723680  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85174.5us
I20260709 13:00:44.687592  3230 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:44.729574  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:44.730481  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.677942  3607 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:44.686831  1692 rpcz_store.cc:276] 0709 13:00:43.384801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.840979 (+456178us) service_pool.cc:224] Handling call
0709 13:00:43.841281 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.841631 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.841667 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.842055 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.138313 (+296258us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:44.526604 (+388291us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.683556 (+156952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.683662 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.683725 (+    63us) raft_consensus.cc:1685] finished
0709 13:00:44.683743 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.683926 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":462331,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":91,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10842,"thread_start_us":735001,"threads_started":3,"wal-append.queue_time_us":283775}
I20260709 13:00:44.687247  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:44.736490  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101328us
I20260709 13:00:44.685345  3594 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:44.742972  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 55848.5us
I20260709 13:00:44.748492  2260 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:44.748700  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:44.748967  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:44.749418  1613 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:44.746809  1512 leader_election.cc:400] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4.
I20260709 13:00:44.751036  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:44.751103  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1484) took 2864 ms (client timeout 3057 ms). Trace:
W20260709 13:00:44.751670  1621 rpcz_store.cc:269] 0709 13:00:41.886535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.886727 (+   192us) service_pool.cc:224] Handling call
0709 13:00:44.750860 (+2864133us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400062554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:44.751002 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3144890624}
I20260709 13:00:44.748704  1622 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:44.754220  3209 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:44.721652  3728 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:44.770252  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.687448  3588 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:44.736037  3628 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:44.780390  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.750031  3230 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.779383  3576 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:44.816501  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 68351.4us
I20260709 13:00:44.801776  3732 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.831596  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 161282us
I20260709 13:00:44.835664  3555 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:44.810595  3731 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:44.836089  3555 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:44.809182  3728 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:44.840605  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.859771  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.861152  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:44.862385  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:44.867244  1696 raft_consensus.cc:606] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.871933  1696 raft_consensus.cc:614] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:44.876407  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:44.877624  1696 raft_consensus.cc:606] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:44.831286  3628 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:44.881870  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:44.890221  3742 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:00:44.896495  3628 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.903553  1692 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:44.913017  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:44.918599  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:44.840402  3599 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:44.842011  3727 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.935177  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 184225us
I20260709 13:00:44.936561  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:00:44.837248  3739 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:44.884963  3555 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.866715  3633 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:44.871125  3731 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:44.831992  3576 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.940601  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:44.946916  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:44.833951  3732 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:44.823825  3607 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:44.954454  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.832641  3735 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:00:44.943867  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:44.946870  3685 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:00:44.947773  3733 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:44.986344   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:44.989249  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:44.990284  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 46546.4us
I20260709 13:00:44.991026  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.871501  3588 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:44.996752  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:44.975713  3555 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.969969  3736 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:45.003968  2260 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.008355  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:45.009205  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.011407  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:44.943658  3727 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:45.011540  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 250082us
W20260709 13:00:45.016456  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.017504  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.017987  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.994481  3733 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:44.996351  3607 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.963939  3633 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:44.996531  3724 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:44.982609  2265 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:45.005038  3742 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.005270  3478 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:45.008634  3209 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.004572  3736 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.050087  1688 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:00:45.150568  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.161161  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 224672us
I20260709 13:00:45.162132  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:45.013538  3744 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.181s
I20260709 13:00:45.001241  3728 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:45.282318  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.185113  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.184595  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 302) took 2184 ms. Trace:
I20260709 13:00:45.316618  1695 rpcz_store.cc:276] 0709 13:00:42.999810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.000129 (+   319us) service_pool.cc:224] Handling call
0709 13:00:44.430714 (+1430585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.430979 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.431019 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.431077 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:44.431126 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.431200 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.184387 (+753187us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540019c150. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:45.184529 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3289646336}
I20260709 13:00:45.049340  3742 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.055572  3209 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.158077  3736 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:45.048019  3724 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.318982  3724 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.320511  1443 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 3 to 4, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:45.321810  3633 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:45.317970  3742 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.321300  3209 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.322253  1443 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 3, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:45.322395   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:45.048523  3654 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.048030  3737 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:45.331624  1443 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.047756  3730 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:45.333580  1443 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:45.323005  3751 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:00:45.334524  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 305) took 8733 ms. Trace:
I20260709 13:00:45.274852  3733 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.339051  1443 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:00:45.323683  3743 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:00:45.055559  3723 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.297s
I20260709 13:00:45.049623  3734 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:45.342100  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.357534  3527 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.349238  1443 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 3, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:45.366098  3448 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.367421  3736 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:45.368971  3747 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.107s	user 0.000s	sys 0.002s
I20260709 13:00:45.342808  1444 rpcz_store.cc:276] 0709 13:00:36.600854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.601202 (+   348us) service_pool.cc:224] Handling call
0709 13:00:37.604786 (+1003584us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54003c8554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a844090 00007f7f1a8e2f3a 00007f7f206991cc 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc 00007f7f1ec57392 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:45.334404 (+7729618us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:40.087813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:40.171321 (+ 83508us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:40.188941 (+ 17620us) write_op.cc:435] Acquired schema lock
0709 13:00:40.193871 (+  4930us) tablet.cc:662] Decoding operations
0709 13:00:40.280538 (+ 86667us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:40.280631 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:40.280658 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:00:40.343605 (+ 62947us) tablet.cc:701] Row locks acquired
0709 13:00:40.353886 (+ 10281us) write_op.cc:260] PREPARE: finished
0709 13:00:40.395578 (+ 41692us) write_op.cc:270] Start()
0709 13:00:40.439577 (+ 43999us) write_op.cc:276] Timestamp: P: 1783602040373267 usec, L: 0
0709 13:00:40.444399 (+  4822us) op_driver.cc:348] REPLICATION: starting
0709 13:00:40.494953 (+ 50554us) log.cc:844] Serialized 4412 byte log entry
0709 13:00:41.384695 (+889742us) op_driver.cc:464] REPLICATION: finished
0709 13:00:42.242998 (+858303us) write_op.cc:301] APPLY: starting
0709 13:00:42.258587 (+ 15589us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:42.283021 (+ 24434us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:42.283147 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:42.368451 (+ 85304us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:42.368781 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:00:42.368849 (+    68us) write_op.cc:312] APPLY: finished
0709 13:00:42.369255 (+   406us) log.cc:844] Serialized 83 byte log entry
0709 13:00:42.678697 (+309442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.692183 (+ 13486us) write_op.cc:454] Released schema lock
0709 13:00:42.696147 (+  3964us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:42.753095 (+ 56948us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:42.753125 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14404,"reported_tablets":24,"spinlock_wait_cycles":1367722880,"child_traces":[["op",{"apply.queue_time_us":757680,"apply.run_cpu_time_us":40389,"apply.run_wall_time_us":601478,"num_ops":11,"prepare.queue_time_us":310246,"prepare.run_cpu_time_us":23020,"prepare.run_wall_time_us":723557,"raft.queue_time_us":523397,"raft.run_cpu_time_us":16367,"raft.run_wall_time_us":493696,"replication_time_us":898190,"thread_start_us":1235297,"threads_started":5,"wal-append.queue_time_us":603587,"wal-append.run_cpu_time_us":20133,"wal-append.run_wall_time_us":2400099}]]}
I20260709 13:00:45.342422  3664 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:45.374944  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.038s	sys 0.105s
W20260709 13:00:45.441370  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.039s	sys 0.105s
W20260709 13:00:45.441862  1585 connection.cc:256] RPC call timeout handler was delayed by -1.491702714999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:00:45.442296  1585 connection.cc:256] RPC call timeout handler was delayed by -1.325202714999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 13:00:45.442740  1585 connection.cc:256] RPC call timeout handler was delayed by -1.1587027149999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:00:45.443146  1585 connection.cc:256] RPC call timeout handler was delayed by -1.148802714999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:00:45.333992  3754 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.376283  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:45.386452  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:45.343852  3730 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.376430  3734 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:45.386799  3448 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:45.445505  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.446220  3754 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:45.446733  3754 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.446445  3448 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.447568  2261 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 1 LEARNER]: Advancing to term 3
I20260709 13:00:45.378818  3739 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:45.448441  3739 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:45.449218  3739 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.388568  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:45.446260  3697 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.701s	user 0.009s	sys 0.003s
I20260709 13:00:45.375373  3527 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:45.462242  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.355799  3732 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:45.050740  3731 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.451576  1585 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.453723  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:45.454291  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:45.447517  3448 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.461501  1691 raft_consensus.cc:2410] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:00:45.453693  2231 leader_election.cc:336] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.846s (SENT)
I20260709 13:00:45.445534  3734 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.451998  3746 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.463462  3697 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.482023  3732 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:45.542704  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1290) took 1919 ms. Trace:
W20260709 13:00:45.500069  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.012s	sys 0.008s
W20260709 13:00:45.506933  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.524443  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 72975.3us
W20260709 13:00:45.608114  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.026s	sys 0.023s
W20260709 13:00:45.524471  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70828.4us
I20260709 13:00:45.450178  3739 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.462881  3727 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:45.543288  1690 rpcz_store.cc:276] 0709 13:00:43.623470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.434577 (+811107us) service_pool.cc:224] Handling call
0709 13:00:44.434854 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.622280 (+187426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.622309 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.635314 (+ 13005us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.827853 (+192539us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.827894 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.827974 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.542471 (+714497us) raft_consensus.cc:1685] finished
0709 13:00:45.542490 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.542646 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28792,"raft.queue_time_us":292675,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":31648,"thread_start_us":345460,"threads_started":2,"wal-append.queue_time_us":331894}
W20260709 13:00:45.582064  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.620791  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 840501us
W20260709 13:00:45.473384  3594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.002s	sys 0.023s
W20260709 13:00:45.622331  3594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.005s	sys 0.027s
I20260709 13:00:45.622483  3721 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:45.622864  3594 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.583380  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.016s	sys 0.007s
W20260709 13:00:45.630904  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.016s	sys 0.007s
W20260709 13:00:45.631328  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 572787us
I20260709 13:00:45.461567  3718 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.523855  3719 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:45.485198  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:45.608687  1585 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.375456  3758 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:45.524750  3749 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:00:45.613580  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.656375  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47780.6us
I20260709 13:00:45.617445  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 513) took 2922 ms. Trace:
I20260709 13:00:45.656960  2266 rpcz_store.cc:276] 0709 13:00:42.688701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.689052 (+   351us) service_pool.cc:224] Handling call
0709 13:00:42.689321 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.293512 (+1604191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.610611 (+1317099us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002706d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:45.610871 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2760745856}
I20260709 13:00:45.657635  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.463836  3735 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:45.643450  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:45.632172  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:45.623420  3594 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.623751  3762 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.666028  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:45.663405  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:45.658267  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:45.673363  1621 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:45.674394  1621 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:45.684149  2266 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:45.672744  3555 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.003s
I20260709 13:00:45.665499  3588 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:45.681471  1621 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.703310  1621 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:45.673280  3725 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.659053  3719 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:45.705868  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 520916us
I20260709 13:00:45.706126  2264 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:45.671010  3759 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:45.647270  3527 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:45.695799  3607 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.003s
I20260709 13:00:45.717244  3689 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.665715  3727 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:45.723115  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:45.668118  3732 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:45.739358  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:45.740180  1619 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.724181  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:45.725090  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:45.726890  3588 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:45.727231  1621 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:00:45.693632  3749 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.742498  1621 pending_rounds.cc:85] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:00:45.744926  1621 pending_rounds.cc:107] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:00:45.745206  1621 raft_consensus.cc:2889] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.704952  3740 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:45.693104  3767 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:45.746515  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:45.709594  3725 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.747049  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:45.687456  3495 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:00:45.762456  1620 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:45.741940  1617 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:45.751434  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.751571  1539 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:45.754096  3757 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:00:45.754783  3755 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:00:45.756034  3576 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:45.756469  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.756705  2261 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:45.623355  3721 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.760070  3746 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:45.760160  3463 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.078s	user 0.006s	sys 0.006s
I20260709 13:00:45.764082  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:45.750384  3740 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.768821  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:45.666926  3735 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.793035  3774 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.794126  3774 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.796988  3735 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:45.659621  3758 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.672886  3718 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.704592  3723 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 13:00:45.759006  3748 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:00:45.746369  3607 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.767922  3767 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.766571  3744 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.754808  1613 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:45.750586  3749 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:45.770040  3653 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.070s	user 0.009s	sys 0.004s
I20260709 13:00:45.671218  3762 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.767192  1620 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:45.788941  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:45.763253  3588 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.763474  3689 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:45.792047  3753 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
W20260709 13:00:45.792701  3766 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:00:45.766389  3725 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.767159  3654 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.814086  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.772387  3736 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:45.776103  3761 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.815407  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.880955  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 217110us
I20260709 13:00:45.852368  3767 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:45.799969  3756 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.336s	user 0.001s	sys 0.001s
I20260709 13:00:45.790488  1621 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:45.864323  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75687.8us
W20260709 13:00:45.839329  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.807327  3752 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 13:00:45.813689  3723 raft_consensus.cc:993] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
W20260709 13:00:45.802727  3768 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:45.814585  3740 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:45.801074  3478 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:45.801043  3628 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:45.874763  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:45.917411  3727 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.813756  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1507) took 1079 ms. Trace:
I20260709 13:00:45.928745  3765 raft_consensus.cc:2764] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:00:45.881301  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.860335  1619 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:45.798502  3774 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:45.802110  3746 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:45.801430  3758 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:45.828137  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.903131  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.852128  3697 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:45.808987  3719 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:45.784881  3754 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:45.861366  3749 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:45.918552  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:45.928550  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 309972us
I20260709 13:00:45.999536  3628 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:45.813512  3718 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:45.915303  3676 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.233s	user 0.005s	sys 0.009s
I20260709 13:00:45.814599  3463 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:45.938000  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.037730  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2004) took 1365 ms. Trace:
I20260709 13:00:45.852843  3607 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.037983  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 532) took 1142 ms. Trace:
W20260709 13:00:45.955228  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 243775us
I20260709 13:00:45.819267  3764 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.861270  3744 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:45.865609  3653 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:45.880414  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.946779  3755 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:46.004060  1621 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:00:46.058480  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.058555  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:46.005692  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.936362  3736 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.888814  3654 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.025969  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:46.033676  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.069334  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.069365  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67428.7us
I20260709 13:00:46.030496  3758 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.070516  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:46.056277  2262 rpcz_store.cc:276] 0709 13:00:44.895616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.895962 (+   346us) service_pool.cc:224] Handling call
0709 13:00:44.896659 (+   697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.897465 (+   806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.897519 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.898438 (+   919us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.011880 (+113442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:45.012020 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.012504 (+   484us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.037787 (+1025283us) raft_consensus.cc:1685] finished
0709 13:00:46.037808 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.037933 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3787,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":287,"thread_start_us":112304,"threads_started":1,"wal-append.queue_time_us":435156}
I20260709 13:00:46.023428  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 271) took 1895 ms. Trace:
I20260709 13:00:46.003386  3594 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.024562  3774 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:45.915977  3761 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.011351  3478 raft_consensus.cc:1081] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:46.050482  2263 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:46.050251  1694 rpcz_store.cc:276] 0709 13:00:44.672485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.672792 (+   307us) service_pool.cc:224] Handling call
0709 13:00:44.680830 (+  8038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.816843 (+136013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.816877 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.817352 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.017019 (+199667us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:45.017078 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.017180 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.037536 (+1020356us) raft_consensus.cc:1685] finished
0709 13:00:46.037556 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.037674 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23541,"raft.queue_time_us":122738,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6852,"thread_start_us":279197,"threads_started":2,"wal-append.queue_time_us":629914}
I20260709 13:00:46.049731  3599 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:00:46.054217  3773 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:46.020187  3771 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.056744  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.111003  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.111476  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.003600  3723 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:00:46.005789  3727 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.068495  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:46.033969  3731 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.955811  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 289859us
I20260709 13:00:46.071831  1546 rpcz_store.cc:276] 0709 13:00:44.128027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.384225 (+256198us) service_pool.cc:224] Handling call
0709 13:00:44.384526 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.446544 (+ 62018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.023090 (+1576546us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b54000532d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:46.023352 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130610432}
I20260709 13:00:46.069018  1620 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:46.035502  3628 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.038416  3676 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:00:46.124986  3780 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:00:46.060016  3209 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.735s	user 0.013s	sys 0.000s
I20260709 13:00:46.082542  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:46.065894  3742 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
I20260709 13:00:46.125752  3209 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.126080  3742 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.126941  3772 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:00:46.128432  3742 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.129897  3742 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:46.086491  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 689) took 1102 ms. Trace:
I20260709 13:00:46.130731  2264 rpcz_store.cc:276] 0709 13:00:44.988683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.988897 (+   214us) service_pool.cc:224] Handling call
0709 13:00:46.086302 (+1097405us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:46.086429 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645600512}
I20260709 13:00:46.131722  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 690) took 1130 ms. Trace:
I20260709 13:00:46.131910  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1287) took 2529 ms. Trace:
I20260709 13:00:46.132114  2263 rpcz_store.cc:276] 0709 13:00:45.001336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.001656 (+   320us) service_pool.cc:224] Handling call
0709 13:00:46.038478 (+1036822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.086818 (+ 48340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.131510 (+ 44692us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400506250. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:46.131656 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384003328}
I20260709 13:00:46.061991  3733 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:00:46.135874  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53436.9us
I20260709 13:00:46.024281  3746 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.002960  1614 rpcz_store.cc:276] 0709 13:00:44.734583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.735955 (+  1372us) service_pool.cc:224] Handling call
0709 13:00:45.813278 (+1077323us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54000f9bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:45.813594 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998961024}
I20260709 13:00:46.073226  3697 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.167454  3697 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.170634  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.072444  3657 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.173606  3657 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:46.174793  3657 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.176354  3657 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.077271  3784 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.119984  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:46.179314  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59443.5us
I20260709 13:00:46.179023  3784 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.180433  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:46.118278  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.089533  3778 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:46.059924  3765 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:46.132331  1687 rpcz_store.cc:276] 0709 13:00:43.603091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.432238 (+829147us) service_pool.cc:224] Handling call
0709 13:00:44.432577 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:44.624924 (+192347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.624952 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:44.658354 (+ 33402us) log.cc:844] Serialized 52 byte log entry
0709 13:00:44.983917 (+325563us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.002714 (+ 18797us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.047046 (+ 44332us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.251230 (+204184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.251334 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.131681 (+880347us) raft_consensus.cc:1685] finished
0709 13:00:46.131702 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.131854 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42758,"prepare.queue_time_us":66122,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":2701,"raft.queue_time_us":451711,"raft.run_cpu_time_us":557,"raft.run_wall_time_us":43237,"thread_start_us":696132,"threads_started":3,"wal-append.queue_time_us":698763}
I20260709 13:00:46.134693  3731 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.138834  3676 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.132507  3727 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.137651  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:46.170343  3697 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.126765  3797 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.122669  3721 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.073446  3736 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.184397  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:46.230072  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.182309  3784 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.081502  3774 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.081297  3758 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.193171  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55613.7us
I20260709 13:00:46.252558  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:46.141263  3775 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:00:46.196600  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 278163us
I20260709 13:00:46.117774  3771 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.184547  3718 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.233530  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:46.243005  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 58676.4us
I20260709 13:00:46.183184  3765 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.263736  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:46.264806  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:46.079224  3764 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:46.192066  3732 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.255905  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:46.203653  3778 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:46.267647  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 196773us
W20260709 13:00:46.259846  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.232962  3724 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.912s	user 0.009s	sys 0.005s
I20260709 13:00:46.260018  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.271708  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.272179  2264 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:00:46.233997  3721 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:46.262667  3718 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.275348  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:46.253508  3617 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:46.201354  3762 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.276379  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.260932  3697 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:46.277273  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:46.278095  3797 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:46.278394  3774 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.278656  3796 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:46.253628  3588 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.281142  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:46.282068  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:46.268378  3790 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:46.256309  3463 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.280759  3778 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:46.270455  3732 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.252166  3628 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.300109  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.300915  1538 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:46.319585  1546 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:46.320376  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.321398  1538 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:46.301790  1543 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:46.302680  1547 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:46.322775  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.302531  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.303035  1542 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:00:46.303793  1587 connection.cc:256] RPC call timeout handler was delayed by -1.8642101649999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:00:46.324316  1587 connection.cc:256] RPC call timeout handler was delayed by -1.7321288489999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:00:46.324642  1587 connection.cc:256] RPC call timeout handler was delayed by -1.6814983320000465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:00:46.325026  1587 connection.cc:256] RPC call timeout handler was delayed by -1.6568892559999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 13:00:46.283381  3718 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.287310  3783 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:46.283136  3721 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.282943  3794 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:46.288847  2264 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:46.317943  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.326236  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:46.326876  1587 connection.cc:256] RPC call timeout handler was delayed by -1.587365262999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 13:00:46.298244  3762 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:46.307355  1613 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.288914  3727 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:00:46.307305  3697 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:46.328202  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.411181  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:46.411574  3791 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:00:46.412443  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:46.413486  3734 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.838s	user 0.005s	sys 0.005s
I20260709 13:00:46.413918  3734 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.328218  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:46.364708  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79788.5us
I20260709 13:00:46.280179  3724 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.312322  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:46.411188  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:46.419272  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.417181  1543 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:00:46.312623  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 246433us
I20260709 13:00:46.420156  1542 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:46.372818  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:46.329375  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:46.439184  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.432775  1690 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:46.431233  1512 connection.cc:256] RPC call timeout handler was delayed by -1.477597473000003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 13:00:46.424245  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.442178  2265 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:46.318864  3732 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.309453  3607 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.371420  3754 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.314989  3654 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.365070  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 531) took 1522 ms. Trace:
I20260709 13:00:46.461839  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:46.463433  1543 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3. Re-sending same reply.
W20260709 13:00:46.462385  1512 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.622s (SENT)
I20260709 13:00:46.328820  3588 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:46.465097  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:46.420042  3762 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.379227  3788 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:46.466300  1542 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:46.440232  1614 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.429512  3783 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:46.480125  3783 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:46.431565  3478 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:46.481006  3478 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.383379  1540 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:46.449637  3784 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.487031  3784 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.489027  3784 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.455521  3727 consensus_queue.cc:1243] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:00:46.489656  3727 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.489990  3727 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:46.490106  1614 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:46.490821  3727 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.329715  3733 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:46.491775  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:46.491914  3733 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.493255  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.494243  3733 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.495189  3209 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.495497  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.495584  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:46.486400  3478 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.496433  1614 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:46.496753  3478 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:46.498162  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.498647  3727 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.499001  1614 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:46.502866  3594 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:46.507551  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 530) took 1688 ms. Trace:
I20260709 13:00:46.507752  3727 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:46.508152  3727 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:46.509068  3727 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.508001  2259 rpcz_store.cc:276] 0709 13:00:44.818992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.827091 (+  8099us) service_pool.cc:224] Handling call
0709 13:00:44.868214 (+ 41123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.256769 (+388555us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:45.677115 (+420346us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.021337 (+344222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.029227 (+  7890us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.031815 (+  2588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.143845 (+112030us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800390340. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1e7ae58f 00007f7f177ed571 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd
0709 13:00:46.507271 (+363426us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54005d0554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:46.507342 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.507483 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11120,"prepare.queue_time_us":535737,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":10091,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8364,"spinlock_wait_cycles":747557888,"thread_start_us":578748,"threads_started":2,"wal-append.queue_time_us":343770}
I20260709 13:00:46.458825  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.455475  3746 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.511904  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:46.512794  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51813us
I20260709 13:00:46.459795  3761 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.463522  3676 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.515053  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:46.514077  3803 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:00:46.521098  3771 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.458771  3778 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.429932  3794 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.521826  3764 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:46.524374  3805 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:46.455410  3599 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 13:00:46.525610  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.596210  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.526937  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.478070  3731 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.553767  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:46.465476  2257 rpcz_store.cc:276] 0709 13:00:44.842739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.842888 (+   149us) service_pool.cc:224] Handling call
0709 13:00:46.127684 (+1284796us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:46.127915 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.128124 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:46.128420 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.364522 (+236102us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.364618 (+    96us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:46.364706 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.364808 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.364980 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1227,"prepare.queue_time_us":5158,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":45078,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":33168256,"thread_start_us":206318,"threads_started":2,"wal-append.queue_time_us":191837}
W20260709 13:00:46.559128  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44167.1us
I20260709 13:00:46.614006  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:46.559674  3607 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:46.478488  3762 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:46.560567  3800 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:00:46.519047  3654 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.479314  3788 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.529337  3697 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.564177  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.607139  3739 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.957s	user 0.004s	sys 0.010s
I20260709 13:00:46.585901  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.528210  3746 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:46.586783  3724 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:46.636863  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.611307  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 334654us
W20260709 13:00:46.612275  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 149135us
I20260709 13:00:46.533383  3676 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.612962  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 152312us
I20260709 13:00:46.527930  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:46.477123  3588 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:46.532856  3758 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.592196  3771 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.629487  3788 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:46.524859  3495 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:00:46.609032  3736 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.588871  3633 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:46.622305  3607 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.629140  3721 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.682919  3826 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.683225  3588 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.683566  3826 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:46.648397  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.625437  3784 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:46.627204  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 177863us
I20260709 13:00:46.634702  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:46.687098  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47062.6us
I20260709 13:00:46.636329  3746 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:46.686904  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47725.1us
I20260709 13:00:46.693930  1613 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:46.698830  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61086.2us
I20260709 13:00:46.699997  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:46.702557  2262 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:46.704411  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.654359  3765 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.688535  3607 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:46.693511  3784 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.701892  3734 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.663482  3771 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.642007  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.649173  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:47.141546  2260 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:00:47.084692  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.114889  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.114197  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.084318  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.085821  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.124779  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.100689  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:47.137293  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.003s	sys 0.023s
W20260709 13:00:47.120005  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5333652629999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 13:00:47.088979   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:47.092774  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:47.095182  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 254) took 2981 ms (client timeout 2065 ms). Trace:
W20260709 13:00:47.310331  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.268817  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5257542129999706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:00:46.905386  3767 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.978s	user 0.010s	sys 0.000s
I20260709 13:00:47.287149  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.088287  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:47.007133  3797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.000s	sys 0.020s
I20260709 13:00:47.272115  1546 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:47.316301  3767 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:46.902419  3740 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.902s	user 0.003s	sys 0.005s
I20260709 13:00:47.356781  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.356891  3740 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.357627  3785 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:47.358158  3785 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:47.283560  3527 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:47.358494  3807 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.359560  3807 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.359827  3785 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.360639  3731 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:47.361303  3731 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.331434  3653 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:46.773507  3815 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
W20260709 13:00:47.365787  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.325371  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.367353  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2072) took 1065 ms. Trace:
I20260709 13:00:47.368209  3740 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:47.321691  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4945056130000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:00:47.317564  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.286250  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:46.959115  3749 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.907s	user 0.005s	sys 0.005s
W20260709 13:00:47.015384  3718 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.001s
W20260709 13:00:47.322502  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.007s	sys 0.027s
I20260709 13:00:47.141602  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 535) took 1326 ms. Trace:
I20260709 13:00:47.393409  3734 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.394192  3734 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.393265  2261 rpcz_store.cc:276] 0709 13:00:45.815339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.824488 (+  9149us) service_pool.cc:224] Handling call
0709 13:00:45.877474 (+ 52986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.949270 (+ 71796us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.997645 (+ 48375us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.049913 (+ 52268us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.232857 (+182944us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.284597 (+ 51740us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.313515 (+ 28918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.316540 (+  3025us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.499152 (+182612us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b18003905e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:00:46.717408 (+218256us) raft_consensus.cc:1685] finished
0709 13:00:46.753619 (+ 36211us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.141242 (+387623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23968,"prepare.queue_time_us":27433,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":15096,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":49718,"spinlock_wait_cycles":14006016,"thread_start_us":138891,"threads_started":1,"wal-append.queue_time_us":255156}
I20260709 13:00:47.287510  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.397426  3734 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.397639  1688 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:47.399737  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4664841109999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 13:00:47.331525  3719 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:46.736670  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:46.888242  3822 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 13:00:46.909176  3795 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.646s	user 0.002s	sys 0.005s
W20260709 13:00:46.910234  3802 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.580s	user 0.010s	sys 0.005s
W20260709 13:00:47.353329  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.865334  3689 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.001s
W20260709 13:00:47.307542  1539 rpcz_store.cc:269] 0709 13:00:44.113279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.118902 (+  5623us) service_pool.cc:224] Handling call
0709 13:00:47.094585 (+2975683us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400189cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.094914 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3327603072}
W20260709 13:00:46.866432  3756 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:00:46.863397  3725 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.949s	user 0.005s	sys 0.006s
I20260709 13:00:47.356796  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1514) took 1619 ms. Trace:
I20260709 13:00:46.650341  1540 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:47.369800  1696 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:47.367815  1541 rpcz_store.cc:276] 0709 13:00:46.301799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.302993 (+  1194us) service_pool.cc:224] Handling call
0709 13:00:46.303293 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.307506 (+  4213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.307534 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.308110 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.475271 (+167161us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:46.475341 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.475453 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.901093 (+425640us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b48000030d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:00:47.366728 (+465635us) raft_consensus.cc:1685] finished
0709 13:00:47.366767 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.367101 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3849,"raft.queue_time_us":4005,"raft.run_cpu_time_us":11990,"raft.run_wall_time_us":591937,"spinlock_wait_cycles":4926848,"thread_start_us":86074,"threads_started":1,"wal-append.queue_time_us":296503}
W20260709 13:00:47.372185  3836 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:00:46.898967  3730 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:46.970930  3676 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:47.494762  3725 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.496742  3740 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.497799  3725 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.497696  3740 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.002228  3762 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.824239  3664 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.379528  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.372196  1545 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:00:47.226359  3657 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.049s	user 0.011s	sys 0.004s
I20260709 13:00:47.381292  1544 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:46.707754  3824 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.671s
I20260709 13:00:46.767910  3784 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:47.400173  1587 connection.cc:256] RPC call timeout handler was delayed by -1.46052621299998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:00:46.902555  3759 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:46.772925  3810 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.891144  3803 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:47.513202  1614 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:46.761765  3820 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.430790  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:47.435905  3785 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:46.862402  3794 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:47.368496  3771 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:46.904322  3744 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.997929  3788 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.440783  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.442853  3718 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:46.895918  3727 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:47.434599  2230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.000s	sys 0.026s
I20260709 13:00:46.821713  3746 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.398272  3576 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:47.377396  3628 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:47.483963  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.595291  1621 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.595619  3576 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.596228  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:47.596864  1616 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.485826  1541 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:47.599200  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 276) took 1147 ms. Trace:
I20260709 13:00:46.863476  3732 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.599768  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 330) took 1046 ms. Trace:
I20260709 13:00:47.600144  1695 rpcz_store.cc:276] 0709 13:00:46.380741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.380923 (+   182us) service_pool.cc:224] Handling call
0709 13:00:46.413716 (+ 32793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.414067 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.414095 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.414547 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.641020 (+226473us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:46.641072 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.641162 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.263485 (+622323us) raft_consensus.cc:1685] finished
0709 13:00:47.288110 (+ 24625us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.427187 (+139077us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":557,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1461,"thread_start_us":226028,"threads_started":1,"wal-append.queue_time_us":445249}
I20260709 13:00:47.601540  3732 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:47.487080  3581 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.599582  1541 rpcz_store.cc:276] 0709 13:00:46.451814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.484849 (+1033035us) service_pool.cc:224] Handling call
0709 13:00:47.485443 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.598915 (+113472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.599128 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.603058  1620 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:47.561326  3718 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:47.604471  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1212) took 1309 ms. Trace:
I20260709 13:00:47.604867  1620 rpcz_store.cc:276] 0709 13:00:46.295589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.410943 (+115354us) service_pool.cc:224] Handling call
0709 13:00:47.604233 (+1193290us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400231254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.604396 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2721462144}
I20260709 13:00:47.605500  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2077) took 1300 ms. Trace:
I20260709 13:00:47.605880  1547 rpcz_store.cc:276] 0709 13:00:46.305108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.322440 (+ 17332us) service_pool.cc:224] Handling call
0709 13:00:47.605182 (+1282742us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000852d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.605356 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2573656832}
I20260709 13:00:47.606179  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.602574  3581 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.607806  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.608945  3581 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:47.609112  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:47.487424  3728 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.609758  1617 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:47.609848  3728 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.612031  3728 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:46.912006  3826 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:47.488103  1539 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.613000  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 277) took 1160 ms. Trace:
I20260709 13:00:47.613344  1539 rpcz_store.cc:276] 0709 13:00:46.452122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.487262 (+1035140us) service_pool.cc:224] Handling call
0709 13:00:47.487754 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.612755 (+125001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.612946 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.489078  2261 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:47.489614  1689 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:47.615737  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.616429  1689 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:47.617341  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.617949  1689 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:47.489889  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.619748  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:47.509483  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 343) took 1496 ms. Trace:
W20260709 13:00:47.538921  1587 connection.cc:256] RPC call timeout handler was delayed by -1.3971101650000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 13:00:47.505286  3653 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:47.284941  2263 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:47.512578  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.513334  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.537190  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2080) took 1224 ms. Trace:
I20260709 13:00:47.505013  3527 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:47.506879  3731 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.551118  3759 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:47.551178  1546 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:00:47.554776  3803 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:47.556619  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 280) took 1103 ms. Trace:
I20260709 13:00:47.556985  3788 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:47.558706  3760 raft_consensus.cc:993] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:47.561296  1694 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:47.561484  1542 raft_consensus.cc:2368] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8.
I20260709 13:00:47.473816  1615 rpcz_store.cc:276] 0709 13:00:45.701283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.702127 (+   844us) service_pool.cc:224] Handling call
0709 13:00:45.702498 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.710878 (+  8380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.710909 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.728833 (+ 17924us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.688499 (+959666us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b18003af840. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:00:47.122802 (+434303us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:47.122935 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.155471 (+ 32536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.158507 (+  3036us) raft_consensus.cc:1685] finished
0709 13:00:47.158529 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.320576 (+162047us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3727,"raft.queue_time_us":17262,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12080,"spinlock_wait_cycles":21971328,"thread_start_us":433273,"threads_started":1,"wal-append.queue_time_us":1228374}
W20260709 13:00:47.561844  2230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.001s	sys 0.026s
I20260709 13:00:47.565333  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:47.567270  3824 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.567291  3810 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.568714  3807 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.569823  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 281) took 1116 ms. Trace:
I20260709 13:00:47.570561  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.571674  1543 raft_consensus.cc:2410] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:00:47.571645  3664 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.574374  3719 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:47.510042  3697 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.579063  1691 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:47.579305  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.475742  3749 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.580124  3762 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.511234  3806 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.582006  3740 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:47.582108  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76374.4us
I20260709 13:00:47.583155  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:47.589548  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:47.591414  2260 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:00:47.593691  2265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.016s	sys 0.014s
W20260709 13:00:47.594244  3607 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.801s	user 0.013s	sys 0.000s
I20260709 13:00:47.621091  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:47.625180  1587 connection.cc:256] RPC call timeout handler was delayed by -1.3890082169999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 13:00:47.623812  1545 rpcz_store.cc:276] 0709 13:00:46.306042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.370806 (+1064764us) service_pool.cc:224] Handling call
0709 13:00:47.371546 (+   740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.528057 (+156511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.530572 (+  2515us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.626576  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.628795  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 273) took 1178 ms. Trace:
I20260709 13:00:47.627535  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 539) took 1185 ms. Trace:
I20260709 13:00:47.620606  1619 rpcz_store.cc:276] 0709 13:00:46.012552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.017841 (+  5289us) service_pool.cc:224] Handling call
0709 13:00:46.019104 (+  1263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.030906 (+ 11802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.030933 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.031395 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.191574 (+160179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:46.191611 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.191686 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.909918 (+718232us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b24001322d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f176739c4 00007f7f17671acb 00007f7f1782cdc9 00007f7f1782ca55 00007f7f1782c09d 00007f7f1a45e10e 00007f7f1a47588c 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221
0709 13:00:47.508808 (+598890us) raft_consensus.cc:1685] finished
0709 13:00:47.508859 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.509234 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11381,"raft.queue_time_us":12135,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":15037,"spinlock_wait_cycles":12910464,"thread_start_us":83068,"threads_started":1,"wal-append.queue_time_us":202504}
I20260709 13:00:46.762276  3783 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:47.599117  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.633855  1544 rpcz_store.cc:276] 0709 13:00:46.453499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.660302 (+206803us) service_pool.cc:224] Handling call
0709 13:00:47.569627 (+909325us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b540003aa54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.569759 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58973056}
I20260709 13:00:47.648893  1622 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:47.690464  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:47.695745  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:47.688727  2265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.017s	sys 0.014s
I20260709 13:00:47.699597  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:47.699932  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.700718  2266 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:47.701463  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.701658  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.684727  2260 pending_rounds.cc:85] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 5
I20260709 13:00:47.702333  1694 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:47.625041  3653 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:47.702641  2260 pending_rounds.cc:107] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:00:47.699661  2264 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:47.637952  3719 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.635056  3576 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:47.694727  1546 rpcz_store.cc:276] 0709 13:00:46.450674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.419806 (+969132us) service_pool.cc:224] Handling call
0709 13:00:47.536112 (+116306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.628547 (+ 92435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.628744 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:47.714555  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.710016  2260 raft_consensus.cc:2889] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.821202  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:47.695798  2263 rpcz_store.cc:276] 0709 13:00:46.442035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.442224 (+   189us) service_pool.cc:224] Handling call
0709 13:00:47.161584 (+719360us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:47.284091 (+122507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.623477 (+339386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.627451 (+  3974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13204736}
W20260709 13:00:47.911540  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 270671us
I20260709 13:00:47.870985  1618 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:47.844870  3807 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.355140  3807 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.102638  3820 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.357178  1690 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 3.
I20260709 13:00:48.357672  3807 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:48.206120  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 365111us
W20260709 13:00:47.811378  1587 connection.cc:256] RPC call timeout handler was delayed by -1.253098332000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2605s for a response
I20260709 13:00:47.959888  1621 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:48.049592  1616 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:48.011006  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.363754  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.359659  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.721935  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:48.351719  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 506355us
I20260709 13:00:47.866037  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.631047  1540 rpcz_store.cc:276] 0709 13:00:46.453179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.495315 (+ 42136us) service_pool.cc:224] Handling call
0709 13:00:47.556254 (+1060939us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400021054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.556430 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320024320}
W20260709 13:00:48.010552  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 126602us
I20260709 13:00:47.746841  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:47.874811  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:48.195706  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:47.710379  1613 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:48.368762  1617 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.003s
I20260709 13:00:48.369339  1617 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:47.822582  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.371832  2266 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:47.886938  1689 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 2.
I20260709 13:00:47.827680  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 541) took 1070 ms. Trace:
I20260709 13:00:48.352711  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:47.886042  1695 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4. Re-sending same reply.
I20260709 13:00:47.924743  3783 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.378319  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.373193  1615 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:00:48.359854  2231 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.704s (SENT)
W20260709 13:00:47.941253  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 274) took 1490 ms (client timeout 1764 ms). Trace:
I20260709 13:00:48.380456  1692 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.378490  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:47.942080  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 279) took 1489 ms (client timeout 1704 ms). Trace:
I20260709 13:00:48.386955  1620 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:48.388284  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:48.258888  3784 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:00:48.131819  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:47.969597  3728 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:48.146266  3822 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.024s	sys 0.080s
W20260709 13:00:48.418665  3822 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.024s	sys 0.085s
I20260709 13:00:48.392385  2264 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:48.420562  1614 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.000s
I20260709 13:00:48.420750  3760 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.421221  1614 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:00:48.422606  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 796915us
I20260709 13:00:47.876173  3697 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.424489  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:47.924239  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.425227  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:48.398584  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:48.426013  3697 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.426211  1691 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.426357  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.427078  1544 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.426920  3728 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.429234  3728 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.399125  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.430930  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.431860  1694 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.432662  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1511) took 2751 ms. Trace:
I20260709 13:00:48.432821  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:48.433552  1694 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:48.433094  1618 rpcz_store.cc:276] 0709 13:00:45.680917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.681054 (+   137us) service_pool.cc:224] Handling call
0709 13:00:45.699799 (+ 18745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.354865 (+2655066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.432424 (+ 77559us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400116f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:48.432582 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4710353280}
I20260709 13:00:47.720396  3653 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.434331  1695 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:47.879647  3803 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.435261  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.435302  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.436163  3803 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.409946  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.438727  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.438988  1613 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.439495  1544 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.440240  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.410789  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:47.703198  3527 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.373194  2265 rpcz_store.cc:276] 0709 13:00:46.692671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.692818 (+   147us) service_pool.cc:224] Handling call
0709 13:00:46.693192 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.693452 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:46.711933 (+ 18481us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.762748 (+1050815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.762888 (+   140us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.762971 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.763079 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.763289 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18767,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":80,"raft.queue_time_us":116253,"raft.run_cpu_time_us":540,"raft.run_wall_time_us":321122,"thread_start_us":984269,"threads_started":1}
I20260709 13:00:48.444654  3527 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.413206  1619 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:48.412662  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.445399  1692 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:48.413844  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.083751  3835 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:48.414808  1693 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:48.447865  3835 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.410516  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:48.450155  3835 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:48.386973  1543 rpcz_store.cc:269] 0709 13:00:46.452876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.466056 (+ 13180us) service_pool.cc:224] Handling call
0709 13:00:47.941835 (+1475779us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400107554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.942022 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424781568}
I20260709 13:00:48.450502  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:48.417586  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:48.372860  3810 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:47.707656  3607 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.416985  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.452521  1546 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.431046  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.453320  3607 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.453482  1547 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.418180  3740 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:48.436312  1539 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:48.447533  1621 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:48.454507  1695 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:47.969436  3759 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:48.416893  3719 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.003s
I20260709 13:00:48.456301  3759 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.456260  3719 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.458945  1613 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:00:48.462682  3576 consensus_queue.cc:1175] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:48.377897  3749 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.464623  3749 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:48.465090  3749 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:48.466380  3576 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:48.466113  3749 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.467026  3576 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:48.393838  3664 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:48.469897  1691 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:48.486405  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.487254  1543 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:48.488776  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.489393  1543 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:48.470112  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 404164us
W20260709 13:00:48.490582  2231 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.725s (SENT)
I20260709 13:00:48.491678  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:48.492046  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.764s (SENT) [suppressed 29 similar messages]
I20260709 13:00:48.492468  1543 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:47.764832  3824 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.493603  1688 raft_consensus.cc:2376] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4. Re-sending same reply.
I20260709 13:00:48.498895  3824 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:48.421303  3760 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.472821  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.474193  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.501703  3760 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:48.502738  1539 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:00:48.503872  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.474910  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:00:48.504674  1539 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.504972  1546 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.505481  1546 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.505625  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.506939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.475471  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.511170  1547 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.512398  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.512809  1543 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:47.703130  3731 raft_consensus.cc:1081] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:00:48.514154  1545 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:00:48.476114  1696 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.000s
I20260709 13:00:48.514930  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.515120  1696 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.515265  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.458420  3719 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.515622  1543 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.468165  3576 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.513172  1547 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:48.516865  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.517534  1547 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:48.473254  2264 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:00:48.518532  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.520382  1547 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:48.521613  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.501647  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:48.524065  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:48.526103  3727 consensus_meta.cc:287] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.974s	user 0.011s	sys 0.001s
I20260709 13:00:48.526827  3767 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.531826  1543 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:48.544797  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:48.550271  3740 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:48.035014  3581 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:48.383617  1542 rpcz_store.cc:269] 0709 13:00:46.451031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.519789 (+ 68758us) service_pool.cc:224] Handling call
0709 13:00:47.940918 (+1421129us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54000483d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:47.941148 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194150144}
I20260709 13:00:48.576604  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.563297  1545 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:47.771587  3657 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.391289  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:48.566880  3746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.037s	sys 0.055s
I20260709 13:00:48.434365  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:48.576037  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:48.576293  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 74803.7us
I20260709 13:00:48.579210  1546 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.504674  1544 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:47.771802  3806 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.585569  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1526) took 1071 ms. Trace:
I20260709 13:00:48.587414  1543 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:48.583532  1694 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.588927  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.586154  1616 rpcz_store.cc:276] 0709 13:00:47.513806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.384217 (+870411us) service_pool.cc:224] Handling call
0709 13:00:48.585468 (+201251us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:48.572820  2261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.020s	sys 0.053s
I20260709 13:00:48.594120  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:48.584700  3746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.037s	sys 0.055s
I20260709 13:00:48.562702  3784 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.595161  1546 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.579967  3697 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.599211  1547 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:48.595391  2261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.020s	sys 0.053s
I20260709 13:00:48.605418  1613 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.596542  3607 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:48.608207  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.609368  1538 raft_consensus.cc:2368] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5.
I20260709 13:00:48.609858  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1525) took 1096 ms. Trace:
I20260709 13:00:48.610215  1620 rpcz_store.cc:276] 0709 13:00:47.513479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.588954 (+1075475us) service_pool.cc:224] Handling call
0709 13:00:48.604844 (+ 15890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.609499 (+  4655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.609525 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.609564 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:48.609610 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.609668 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.609781 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.598814  3581 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.606099  3810 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:48.616593  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1533) took 1004 ms. Trace:
I20260709 13:00:48.617095  1619 rpcz_store.cc:276] 0709 13:00:47.612472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.589813 (+977341us) service_pool.cc:224] Handling call
0709 13:00:48.604293 (+ 14480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.613687 (+  9394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.613706 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.616383 (+  2677us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:48.616409 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.616448 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.616548 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.600329  3657 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.613854  3820 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:48.617754  3746 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:00:48.624993  3654 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.943s	user 0.009s	sys 0.014s
W20260709 13:00:48.632645  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 88042.6us
I20260709 13:00:48.635833  1511 leader_election.cc:400] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:48.637969  1511 leader_election.cc:403] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:00:48.624486  3607 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:48.637117  3633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.013s	user 0.039s	sys 0.068s
I20260709 13:00:48.635680  3746 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:48.642151  3697 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:48.641373  3633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.040s	sys 0.069s
I20260709 13:00:48.646855  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.636742  3654 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:48.647303  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:00:48.651098  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 283) took 2197 ms (client timeout 1860 ms). Trace:
I20260709 13:00:48.640924  2257 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:48.653162  3581 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:48.652737  1538 rpcz_store.cc:269] 0709 13:00:46.454140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.092164 (+638024us) service_pool.cc:224] Handling call
0709 13:00:48.649034 (+1556870us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400189cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:48.651012 (+  1978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963575168}
I20260709 13:00:48.656584  3527 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:48.665778  1539 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.666653  1687 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:48.663193  3527 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.659392  3810 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:48.669216  3527 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.669255  3810 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:48.669827  3810 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:48.673715  2258 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:48.663022  3657 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.652940  3746 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.675797  1539 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:48.657897  3607 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.658854  3784 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:48.682925  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.683394  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.684629  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.685390  1546 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:48.695998  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60967.3us
W20260709 13:00:48.686144  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 262357us
I20260709 13:00:48.686796  1545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
W20260709 13:00:48.686890  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 275241us
I20260709 13:00:48.688333  3607 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.688519  3820 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:48.688370  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.689275  3740 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:48.689580  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.690102  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 702) took 1099 ms. Trace:
W20260709 13:00:48.692988  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.693152  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:48.693707  3727 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:48.693615  3527 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.704267  1545 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:48.705685  1547 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:48.720572  1545 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.707492  1694 raft_consensus.cc:2410] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:48.708493  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:48.719591  2265 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:48.722393  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1304) took 1141 ms. Trace:
I20260709 13:00:48.723282  1694 rpcz_store.cc:276] 0709 13:00:47.580804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.434111 (+853307us) service_pool.cc:224] Handling call
0709 13:00:48.722332 (+288221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:48.722396  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.693310  3810 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.735198  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:48.732241  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.737651  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1318) took 1103 ms. Trace:
I20260709 13:00:48.726709  1659 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:48.740253  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.738082  1687 rpcz_store.cc:276] 0709 13:00:47.635359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.636132 (+   773us) service_pool.cc:224] Handling call
0709 13:00:48.736586 (+1100454us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54003aedd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:48.736694 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420777728}
I20260709 13:00:48.745819  3527 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:48.746919  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.747614  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:48.749337  2260 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.750696  1621 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:48.751825  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.752432  1619 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
W20260709 13:00:48.740170  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47177.9us
I20260709 13:00:48.718001  3607 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.757417  2264 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:48.758136  3653 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:48.710925  2261 rpcz_store.cc:276] 0709 13:00:47.620876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.624905 (+  4029us) service_pool.cc:224] Handling call
0709 13:00:47.635693 (+ 10788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.700018 (+ 64325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.700057 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.700607 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.611201 (+910594us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:48.614299 (+  3098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.616115 (+  1816us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.689848 (+ 73733us) raft_consensus.cc:1685] finished
0709 13:00:48.689866 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.690020 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1355,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":905591,"threads_started":1,"wal-append.queue_time_us":935463}
I20260709 13:00:48.766438  3607 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.752333  3806 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:48.762720  3653 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:48.760141  3527 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:48.758855  3835 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:48.782899  3835 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.783326  3835 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:48.785422  1614 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:48.737977  3820 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.771957  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:48.775235  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.797888  1613 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:48.797957  3657 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:48.772181  3653 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.782132  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.799499  2263 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:48.790868  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.801178  3657 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:48.802806  3527 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:48.803274  3527 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:48.804356  3527 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.806046  3527 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.817662  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:48.770584  1545 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.786167  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:48.795414  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 220447us
I20260709 13:00:48.820833  3581 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:48.821430  3581 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.821972  1545 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:48.824122  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 50930.8us
I20260709 13:00:48.772234  2260 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:48.840976  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:48.842286  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69419us
I20260709 13:00:48.845052  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.844115  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.846639  1621 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.833563  3653 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:48.847771  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 355746us
W20260709 13:00:48.849963  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 399549us
I20260709 13:00:48.853608  3527 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:48.854342  3527 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:48.855396  3527 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:48.857097  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 161610us
W20260709 13:00:48.859483  2231 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.829s (SENT)
I20260709 13:00:48.863768  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.852157  3653 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.869029  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.871279  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.872340  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.872897  1619 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:48.874696  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.876619  3810 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:48.878858  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.880080  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:48.880658  1545 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5. Re-sending same reply.
I20260709 13:00:48.882318  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.872821  3653 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.891482  3731 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:48.871345  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 683) took 4007 ms (client timeout 1732 ms). Trace:
W20260709 13:00:48.894946  2257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 545) took 1414 ms (client timeout 1702 ms). Trace:
I20260709 13:00:48.895090  3581 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.891850  3760 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:48.908308  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.909179  2263 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:48.908814  3760 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:48.910959  3760 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.895547  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 282) took 2441 ms. Trace:
I20260709 13:00:48.900074  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.902877  1614 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:48.903679  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.907460  1613 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:00:48.905680  2258 rpcz_store.cc:269] 0709 13:00:44.863599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.866154 (+  2555us) service_pool.cc:224] Handling call
0709 13:00:48.871093 (+4004939us) spinlock_profiling.cc:243] Waited 3.72 s on lock 0x7b54003a4654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:48.871253 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8549085568}
I20260709 13:00:48.912088  1541 rpcz_store.cc:276] 0709 13:00:46.453817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.603297 (+1149480us) service_pool.cc:224] Handling call
0709 13:00:47.603670 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.831023 (+1227353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.831068 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.831131 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:48.831186 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.895298 (+ 64112us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54000217d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:48.895348 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.895490 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20830,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"spinlock_wait_cycles":1888060288,"thread_start_us":405912,"threads_started":1}
I20260709 13:00:48.905714  3731 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.916735  3731 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:48.916764  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.917855  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:48.918121  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:48.918825  3824 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:48.919333  3824 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:48.920223  3824 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.921332  3848 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:48.921921  3848 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:48.922896  3848 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:48.924875  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:48.915786  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:48.924212  3847 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:48.932816  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79549.8us
I20260709 13:00:48.935878  3760 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:48.907290  3820 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:48.956001  1621 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:48.957386  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:48.957495  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:48.958359  1614 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:48.945580  3657 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:48.951329  3581 raft_consensus.cc:2764] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 13:00:48.907114  2257 rpcz_store.cc:269] 0709 13:00:47.531324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.539149 (+  7825us) service_pool.cc:224] Handling call
0709 13:00:48.894738 (+1355589us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b5400668354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:48.894854 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929442560}
W20260709 13:00:48.994843  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 70048.7us
W20260709 13:00:48.996611  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 72653.6us
I20260709 13:00:48.975274  3657 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:49.001422  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 74663.2us
W20260709 13:00:49.001893  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 109228us
I20260709 13:00:48.959834  3820 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:00:49.009269  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:49.036173  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:48.999933  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:49.011157  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.012831  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.039803  1621 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:49.013420  3863 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:49.014325  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:48.985741  3740 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:00:49.025115  3855 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:49.024748  3633 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:49.002374  3657 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.029228  1613 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:49.007215  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:49.008206  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:49.024205  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:49.022315  3835 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.042080  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.041718  3607 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.086968  3810 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:00:49.087502  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 63377.2us
I20260709 13:00:49.075003  3654 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:49.109896  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.087668  3839 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.052495  3847 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.087029  1620 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.117784  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:49.104997  3607 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:49.131191  3847 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:49.132436  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 124322us
W20260709 13:00:49.133636  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139866us
I20260709 13:00:49.107239  3810 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:49.120152  3633 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.114355  3746 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:49.114574  3839 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:49.142885  3810 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.084678  3844 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:00:49.127664  3760 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.138713  3607 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.179836  3654 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.184688  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 109113us
I20260709 13:00:49.139825  3664 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:49.228041  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55680.4us
I20260709 13:00:49.226503  1619 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:49.210961  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 74594us
W20260709 13:00:49.226876  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 192442us
I20260709 13:00:49.229075  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.230327  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.231474  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.232456  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 94473.5us
I20260709 13:00:49.134857  3731 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.232406  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:49.190765  3871 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:00:49.172845  3839 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:49.291031  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.239109  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 207870us
I20260709 13:00:49.292865  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:49.234805  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 234981us
I20260709 13:00:49.182852  3760 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:49.139883  3653 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.233831  3664 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.300468  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.302438  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.303413  1617 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.234541  3527 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.309442  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.290340  3746 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.312671  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.313907  1616 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:49.290592  3820 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:00:49.324005  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 93763us
I20260709 13:00:49.325791  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.306255  3760 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.325342  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.308808  3664 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.309820  3654 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:49.310308  3879 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.326190  3810 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.360872  3879 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:49.334640  3880 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:49.365041  3853 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.374s	user 0.001s	sys 0.002s
I20260709 13:00:49.365528  3835 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:49.366585  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 73809.4us
I20260709 13:00:49.375521  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:49.376892  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.378119  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:49.339104  3731 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:49.323975  3527 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.380626  3527 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:49.370998  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76859.3us
I20260709 13:00:49.381526  3870 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:49.381740  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:49.382231  3870 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.383407  3870 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.384383  3527 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.385136  3527 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.338639  3886 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:49.385869  3886 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.386236  3886 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.388244  3727 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.388787  3727 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.391079  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1532) took 1778 ms. Trace:
I20260709 13:00:49.391501  1622 rpcz_store.cc:276] 0709 13:00:47.612203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.589098 (+976895us) service_pool.cc:224] Handling call
0709 13:00:48.601164 (+ 12066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.604752 (+  3588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.604770 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.618124 (+ 13354us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.849208 (+231084us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:48.849596 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.850071 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.850144 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.364746 (+514602us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b2400132368. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f176739c4 00007f7f17671acb 00007f7f1782cdc9 00007f7f1782ca55 00007f7f1782c09d 00007f7f1a45e10e 00007f7f1a47588c 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221
0709 13:00:49.390773 (+ 26027us) raft_consensus.cc:1685] finished
0709 13:00:49.390885 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.391022 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":216,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":332,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":5300,"spinlock_wait_cycles":15414528,"thread_start_us":216554,"threads_started":1,"wal-append.queue_time_us":320221}
I20260709 13:00:49.394030  3820 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.398063  3581 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.398684  3581 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:49.399228  3581 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.398269  3820 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.410995  3886 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:49.416040  3886 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:49.362490  3879 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:49.418442  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.389948  3727 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.420534  3727 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.385063  3870 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:49.460525  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.461483  3877 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:49.462050  3653 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:49.463459  3874 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:49.463608  2261 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:49.464469  1442 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 4, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.467304  3863 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:00:49.470947  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53887.9us
W20260709 13:00:49.519930  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 69129.6us
I20260709 13:00:49.527915  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:49.528739  1616 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:00:49.529003  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 131865us
I20260709 13:00:49.535403  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.536028  1622 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.537137  3581 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.541761  3607 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:49.543521  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 217827us
I20260709 13:00:49.544359  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.546362  3879 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.548895  3879 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:49.549597  3581 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:49.551430  1622 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:49.531644  3746 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:49.554065  3581 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:49.555361  3885 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:49.555127  3746 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.556667  3845 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.553187  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:49.557466  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:49.558095  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 195434us
W20260709 13:00:49.580928  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.596207  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:49.597019  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.506552  3884 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 13:00:49.600674  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:49.604423  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.599318  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:49.607856  3892 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.608425  2258 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:49.633335  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 75945.3us
I20260709 13:00:49.635385  2263 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:00:49.635874  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 257838us
I20260709 13:00:49.639742  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:49.620153  2260 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:49.608402  3892 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.647647  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.653579  3845 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:49.648073  3892 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:49.655505  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 111214us
I20260709 13:00:49.652833  3760 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:49.644656  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85505.9us
W20260709 13:00:49.638756  3697 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.996s	user 0.013s	sys 0.000s
W20260709 13:00:49.668406  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 78776.9us
I20260709 13:00:49.656842  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.671249  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.678300  1620 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.002s
I20260709 13:00:49.678726  1620 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:49.679702  1615 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:49.681026  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.639452  3870 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.657001  2257 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.686398  1616 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:00:49.685557  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89450.4us
I20260709 13:00:49.659157  3654 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:49.654597  3845 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:49.716046  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:49.716763  3898 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:00:49.664183  3664 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.682484  3897 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:49.684705  3870 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:49.717702  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:49.720513  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 70156.1us
I20260709 13:00:49.676728  3697 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:49.686085  3820 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:49.726714  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55570.3us
I20260709 13:00:49.728111  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.723618  3654 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:49.731665  3891 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.731884  3900 raft_consensus.cc:2764] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:00:49.743506  3654 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.735940  3581 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.744733  3581 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:49.745114  3581 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.738814  3607 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:49.719862  3894 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:00:49.756855  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 69225.4us
I20260709 13:00:49.757877  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.766420  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48802.1us
I20260709 13:00:49.769052  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:49.768635  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.729077  3870 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:49.771785  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 89021.2us
I20260709 13:00:49.775978  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.731323  3884 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:49.739398  3881 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:49.779361  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49452.1us
I20260709 13:00:49.732609  3760 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:49.785153  2258 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:49.736613  3845 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.787199  3872 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:49.789427  3581 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.798691  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:49.804104  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.807070  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.860s (SENT)
I20260709 13:00:49.810387  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.811391  1615 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:49.812017  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.770766  3847 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:00:49.781858  3884 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:49.793015  3835 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:49.820894  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.823410  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.825639  1659 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:49.826407  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.808022  3872 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.829823  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.807781  3881 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:49.818527  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:49.839157  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.835976  3847 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:49.843222  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 43956.2us
I20260709 13:00:49.843428  3888 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.843950  3697 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.863462  1692 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:49.873078  1618 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:49.844453  3740 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:49.846817  3909 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:49.863819  3760 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:00:49.882158  3760 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:00:49.885131  3810 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.005s
W20260709 13:00:49.886389  3657 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.000s
I20260709 13:00:49.847843  3664 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:49.848852  3884 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.851773  3581 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:49.852483  3839 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 13:00:49.823319  3877 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:49.858853  3847 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.836699  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:49.831135  3654 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:49.866637  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.832944  3872 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:49.877624  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 291) took 11885 ms (client timeout 15000 ms). Trace:
I20260709 13:00:49.879444  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.935061  1616 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:49.880396  1619 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.880609  3740 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:49.932665  1443 rpcz_store.cc:269] 0709 13:00:37.992515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.992908 (+   393us) service_pool.cc:224] Handling call
0709 13:00:49.875178 (+11882270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:46.014703 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:46.130243 (+115540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:46.130297 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:00:46.130318 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:46.131158 (+   840us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:46.131213 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:46.131242 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:46.131730 (+   488us) tablet.cc:701] Row locks acquired
0709 13:00:46.131746 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:00:46.131933 (+   187us) write_op.cc:270] Start()
0709 13:00:46.132038 (+   105us) write_op.cc:276] Timestamp: P: 1783602046131880 usec, L: 0
0709 13:00:46.132059 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:00:46.135052 (+  2993us) log.cc:844] Serialized 2457 byte log entry
0709 13:00:48.587242 (+2452190us) op_driver.cc:464] REPLICATION: finished
0709 13:00:48.783971 (+196729us) write_op.cc:301] APPLY: starting
0709 13:00:48.784094 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:48.784347 (+   253us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:48.784472 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:48.838055 (+ 53583us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:48.838351 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:48.838423 (+    72us) write_op.cc:312] APPLY: finished
0709 13:00:48.838893 (+   470us) log.cc:844] Serialized 53 byte log entry
0709 13:00:48.841918 (+  3025us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.853656 (+ 11738us) write_op.cc:454] Released schema lock
0709 13:00:48.853748 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:48.861976 (+  8228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:48.863723 (+  1747us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":691831,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":196362,"apply.run_cpu_time_us":4146,"apply.run_wall_time_us":70391,"num_ops":6,"prepare.queue_time_us":554890,"prepare.run_cpu_time_us":15360,"prepare.run_wall_time_us":664892,"raft.queue_time_us":1000361,"raft.run_cpu_time_us":31124,"raft.run_wall_time_us":180059,"replication_time_us":2452404,"thread_start_us":1805177,"threads_started":4,"wal-append.queue_time_us":513731,"wal-append.run_cpu_time_us":131517,"wal-append.run_wall_time_us":3224965}]]}
I20260709 13:00:49.937065  3740 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.846877  3883 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.890322  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.940202  1614 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:49.896279  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57202.7us
I20260709 13:00:49.899258  1615 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:49.903097  1618 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:49.842717  3905 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:00:49.882504  3760 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.916742  1442 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.921706  3697 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:49.923750  2231 connection.cc:256] RPC call timeout handler was delayed by -1.1994649229999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:00:49.971980  2231 connection.cc:256] RPC call timeout handler was delayed by -1.1850649230000272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260709 13:00:49.854076  3881 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:49.889773  3653 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 13:00:49.967800  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 131208us
I20260709 13:00:49.886868  3657 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:49.915977  3877 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:49.984143  3657 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:49.985466  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:49.988008  3760 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:49.988552  3824 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:49.989014  3824 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:49.989073  3760 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:49.977785  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 2, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:49.998592  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:49.948872  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 175914us
I20260709 13:00:49.963656  3884 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:49.923205  3654 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:49.914875  3810 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:00:50.019050  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.018522  1442 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 5, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.019557  3810 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.019685  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:50.020157  3810 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:50.005077  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 174076us
I20260709 13:00:49.994975  3877 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.018410  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:49.989957  3824 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.040660  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:49.976502  3731 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:49.939349  3581 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:00:50.041363  1616 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:49.924474  3847 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:49.972929  3806 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:00:50.063292  1614 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:50.021020  3810 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.035892  3654 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.075925  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:50.068490  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61773.7us
I20260709 13:00:50.024755  3880 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.070317  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:50.071565  1622 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.067754  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:50.068763  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:50.076710  1544 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.069921  1442 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:50.079203  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.080001  1547 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.078316  1442 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 3, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:50.082918  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.083534  1543 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.084270  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.085743  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:49.924337  3839 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.086899  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.087437  1545 raft_consensus.cc:2376] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3. Re-sending same reply.
I20260709 13:00:50.088209  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.088625  1541 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.089548  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.086460  1538 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.085675  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.076956  3731 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:50.100553  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.101208  1544 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.101380  3731 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:50.102677  3916 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:00:50.102674  3903 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.104005  3903 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.104341  3903 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.069196  3892 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.108587  3892 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.100553  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.071935  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:50.111580  2231 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.854s (SENT)
I20260709 13:00:50.124351  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:50.112826  3919 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:00:50.112705  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.095010  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.113591  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.114213  3894 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.091274  3886 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.118911  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.119158  1694 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.119251  3654 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.121132  3888 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:50.132282  1543 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:50.095008  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.160498  1540 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.161536  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.160604  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:50.140573  1539 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:50.114899  1544 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.134881  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.136919  3810 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.164547  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.164716  1540 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.164857  1544 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.165292  1539 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.165688  3845 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.166246  3845 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:50.168650  1616 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:50.169713  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.170292  1621 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.171514  3881 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:00:50.171569  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 68967.8us
W20260709 13:00:50.145437  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80103.7us
I20260709 13:00:50.172734  3888 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.147181  2260 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:50.147431  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.147676  2261 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:50.146116  3923 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.149386  3846 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:50.175110  3846 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:50.175956  3839 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.139715  1542 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.176095  3846 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.177466  3846 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.177800  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.178109  3848 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.178563  3848 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:50.178634  3740 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.179097  3848 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.179153  3740 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:50.179740  3740 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.175892  3845 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.152158  3883 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.123147  3878 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:50.182754  3878 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.183892  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:50.183800  3894 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:50.175171  3888 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.173056  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:50.185793  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66975.1us
I20260709 13:00:50.213006  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.179117  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.190496  1621 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:00:50.215481  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:50.218856  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46549.4us
I20260709 13:00:50.219096  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:50.219555  2231 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.049s (SENT)
I20260709 13:00:50.220687  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:50.151854  3903 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.227268  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.191650  3784 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:50.233044  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54002.9us
I20260709 13:00:50.233789  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.199295  3878 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.225086  3657 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.156574  3886 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.224155  3527 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:50.237519  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.065s (SENT)
I20260709 13:00:50.242092  1546 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.236121  3607 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:50.238394  3657 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.248348  3848 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.250002  3877 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.251667  3740 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.253444  1538 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:50.253710  1545 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:50.253930  3891 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.255782  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.256560  3903 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.261106  3872 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:50.275404  2231 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.225s (SENT)
I20260709 13:00:50.275938  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:50.211561  3870 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:50.277050  2231 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.336s (SENT)
I20260709 13:00:50.273703  3657 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.277529  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:50.278542  3870 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:50.266969  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 94017.4us
W20260709 13:00:50.279138  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.280021  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.281190  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.281447  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.226446  3746 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:50.229923  3879 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.228281  3905 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.295502  3654 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.297008  2261 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:50.298858  3848 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.286594  3581 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.302992  3877 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.271893  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.285216  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.225055  3847 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.289865  3746 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:50.290310  3911 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.272651  3607 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:50.276997  3872 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.277012  3740 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.292073  3886 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.292680  3749 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:50.313515  1619 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:00:50.316057  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 44253.4us
I20260709 13:00:50.355587  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.362125  1617 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:50.360569  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:50.336140  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.364632  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.349851  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 122640us
I20260709 13:00:50.356383  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.357049  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:50.365811  1616 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:50.358734  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.367904  2262 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:50.368165  2258 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:50.369621  1619 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:50.289867  3908 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.378356  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.379019  3847 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:50.379344  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 102325us
I20260709 13:00:50.379719  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:50.380633  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 98049.2us
I20260709 13:00:50.381429  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.382580  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.386405  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.341576  3607 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:50.397789  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:50.404875  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.409199  3607 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.356300  3848 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:50.414357  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.419472  1540 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.321777  3870 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:00:50.332553  3654 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:00:50.424719  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46470.3us
I20260709 13:00:50.421774  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:50.383087  3749 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:50.382130  3897 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:50.436568  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.438019  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:50.414852  3903 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.451436  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.441056  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:50.454473  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 71960.2us
I20260709 13:00:50.420756  3894 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.436691  3740 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:50.419977  3848 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:50.427336  3806 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.471154  3848 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.472338  3820 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:50.472927  3820 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:50.473400  3820 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:50.416271  3877 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
W20260709 13:00:50.467830  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 116079us
I20260709 13:00:50.477543  3877 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:50.478084  3877 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:50.478536  3848 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.482594  3848 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.483237  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.484241  2262 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:50.481076  3877 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.491828  3877 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.493242  3820 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.497476  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.451257  3527 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.502028  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.456557  3880 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.440091  3886 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:00:50.446921  3633 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:00:50.453007  3847 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:00:50.562973  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.454809  3903 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.499836  3894 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:00:50.570042  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 102219us
I20260709 13:00:50.501933  3883 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:50.575976  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 74074us
I20260709 13:00:50.581782  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.504194  3607 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.504146  3740 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:50.569793  3653 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:50.584795  3740 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.586452  3880 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.586992  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.560156  3527 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.588259  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:50.589452  3929 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.448s	user 0.003s	sys 0.000s
I20260709 13:00:50.590020  3527 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.590209  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.501287  3746 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.590587  3527 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.589558  2266 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:50.586985  3880 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.592216  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.592989  3880 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.593120  3784 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.593353  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.594007  3820 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:50.594129  3527 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:50.596247  1544 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:00:50.596448  3527 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.592965  1542 raft_consensus.cc:2376] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4. Re-sending same reply.
I20260709 13:00:50.594194  1539 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:50.603222  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.567651  3878 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:50.608371  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:50.611735  3944 raft_consensus.cc:2764] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:50.621080  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.617448  3883 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:00:50.638307  3932 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.496s	user 0.005s	sys 0.001s
I20260709 13:00:50.639698  3903 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.618124  3886 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:00:50.582896  3921 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:00:50.615067  3936 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:50.617843  3877 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:00:50.642051  3879 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.653339  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.643493  1542 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:50.629693  3894 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.650069  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:50.649513  3942 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:00:50.655321  1544 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:50.656080  1545 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.657582  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.659371  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.659909  1538 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.662549  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.662925  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.663196  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.663635  1541 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.667137  3936 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:50.667975  3936 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.668579  3824 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:50.669682  1543 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:50.673692  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:50.674333  1615 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:50.674333  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:50.675024  1614 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:50.680212  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.680810  1546 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:50.682219  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 158784us
I20260709 13:00:50.687294  1622 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:50.688256  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:50.694005  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.702481  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:50.501550  3925 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.167s
I20260709 13:00:50.656559  3883 consensus_queue.cc:1243] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:50.706346  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:50.717051  1687 raft_consensus.cc:2368] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:50.710839  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:50.714022  1546 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:50.721117  1696 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:50.726964  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.731323  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.733094  1546 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:50.736665  1622 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:50.710173  3824 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.743165  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.744609  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.736179  3883 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:50.749374  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.742813  3872 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.746892  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.750815  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.752370  1545 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:50.746790  3880 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.751415  3886 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:50.761690  1538 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:50.757359  3883 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:50.744603  3824 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:50.765357  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 322077us
I20260709 13:00:50.767333  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.766541  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:50.767933  1545 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:50.766866  1546 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:50.768837  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.770015  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.770560  2266 raft_consensus.cc:2376] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:00:50.771906  1696 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:00:50.772255  1538 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:50.770460  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:50.773873  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:50.777181  3824 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.778354  1692 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:50.761145  3889 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:50.783778  1546 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:50.757313  3877 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:50.786737  1587 connection.cc:256] RPC call timeout handler was delayed by -2.8460781120000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:00:50.788235  1587 connection.cc:256] RPC call timeout handler was delayed by -2.7443781120000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:00:50.788542  1587 connection.cc:256] RPC call timeout handler was delayed by -2.6732781120000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:00:50.788897  1587 connection.cc:256] RPC call timeout handler was delayed by -2.5841781120000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:00:50.789165  1587 connection.cc:256] RPC call timeout handler was delayed by -2.5301781120000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:00:50.789465  1587 connection.cc:256] RPC call timeout handler was delayed by -2.3015781120000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 13:00:50.789880  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:50.754343  3872 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.753083  3936 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:00:50.794782  1545 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:50.779004  3883 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:50.813364  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.868347  2262 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:50.871469  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:50.797907  1546 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:50.794392  2266 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:50.815009  2265 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:50.795220  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:50.795241  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:50.804170  1659 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.893009  1696 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:50.866735  1542 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:50.894912  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 90830.2us
I20260709 13:00:50.786159  3889 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:50.815218  1544 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:50.895496  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:50.793177  3891 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
W20260709 13:00:50.811264  3949 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:00:50.796825  3657 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.005s
I20260709 13:00:50.905372  1687 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:50.806826  2260 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:00:50.793633  3749 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:50.912094  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.799079  3923 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:00:50.909523  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.909938  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:50.798333  3633 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:50.935673  3633 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:50.906124  3911 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.931463  3876 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:50.936822  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.918751  3657 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.937983  1539 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:50.938867  3806 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:50.939280  3657 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:50.932487  3886 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:00:50.935712  3923 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:50.932629  3921 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:00:50.942548  3923 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.942936  3923 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:50.943717  3923 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.944998  3923 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:50.931330  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:50.947212  1544 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:50.863616  3810 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.929492  3880 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:50.931094  3905 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:00:50.948944  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:50.936668  3911 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.950325  3880 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.950863  3880 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:50.951931  3880 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:50.952975  3810 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:50.953158  3760 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:50.928957  3945 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:50.955531  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:50.809176  3872 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:50.920648  1687 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:50.796492  3925 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:50.956072  3905 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:00:51.013579  3925 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:51.014854  3925 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:50.932168  3950 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:00:51.015693  3955 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.994827  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:50.971741  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.017688  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:51.018589  3905 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.018723  3633 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.019371  3905 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.019852  3633 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:50.957258  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.056442  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.026072  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.068270  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:51.085394  1615 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:51.085793  1541 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.095682  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:50.908186  3891 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.100059  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:51.100245  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:50.957327  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.103542  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:51.105628  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 148392us
I20260709 13:00:50.896749  3889 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.107443  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.108297  1543 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:51.107460  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 170723us
I20260709 13:00:51.111474  1538 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:51.111853  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.106794  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.114269  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.116961  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.117784  1540 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:51.088922  3746 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:51.143092  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47278.1us
I20260709 13:00:51.173575  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.173895  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.174199  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.174680  1546 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:00:51.175529  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 68833.5us
I20260709 13:00:51.175726  1543 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:00:51.176033  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.176328  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:51.176743  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79138.4us
I20260709 13:00:51.177205  1616 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:51.178167  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.178360  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.179842  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:51.180656  1692 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:00:51.181547  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.178468  1688 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.184414  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.186803  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:51.101224  3760 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:51.190109  1540 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.111001  3820 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:50.973538  3921 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.204s
I20260709 13:00:51.195077  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:51.116176  3905 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.123512  3749 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:51.207350  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:51.175799  3746 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.192376  3872 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:51.209151  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.207559  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.214975  3947 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:51.214591  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.203222  3581 raft_consensus.cc:2764] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:51.218489  3956 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:51.218981  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.219949  1695 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:51.220844  1690 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:51.221432  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.222385  1693 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:51.223680  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:51.223809  3883 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:51.226388  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:50.989114  3897 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.203s
I20260709 13:00:51.209592  3886 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:51.203773  1687 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:51.133087  3653 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:00:51.196509  3878 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:51.231587  3746 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.275660  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.276786  1547 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:51.231914  3872 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.233243  1688 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:51.198122  3893 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:51.234215  1692 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:51.213846  1616 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:51.233908  3947 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.303345  3947 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.210120  3810 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:51.240938  1615 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:51.203132  3905 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:51.212266  3820 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:51.232085  1694 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:00:51.309470  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.312075  1691 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:51.232375  1546 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:00:51.209475  3824 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:51.255781  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.287276  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:51.287503  3958 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:51.287401  3749 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.288013  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.283504  3872 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.289425  1545 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:51.283934  3878 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:51.212066  3879 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:00:51.281222  3903 raft_consensus.cc:476] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:51.308599  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.267450  3961 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.322746  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.335459  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.284250  3886 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:51.280997  3877 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:51.362313  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.317739  3905 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.285707  3581 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:00:51.368083  1692 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:51.371155  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 152249us
W20260709 13:00:51.371955  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63448.4us
I20260709 13:00:51.378881  1691 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.388414   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:51.391464  1688 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.406493  1545 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:51.398200  1694 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:00:51.410790  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.387900  3845 raft_consensus.cc:2764] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:00:51.413962  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.435094  1688 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:51.436088  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.436775  1688 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:51.437479  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.415026  1694 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.439347  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.439854  1694 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:51.400170  3961 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.415593  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.442947  1692 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:51.443725  3961 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:51.423439  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.426939  3893 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:51.447625  1691 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.447944  3893 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:51.448367  3893 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:51.448513  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.449177  3893 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.429060  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.450008  3878 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.451295  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:51.438419  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.452394  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:51.429590  3810 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:51.455449  3810 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.456283  3810 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:51.454528  3846 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:51.457103  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.457921  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:51.458567  3964 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:51.458684  2262 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:00:51.455022  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.463397  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.460347  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.470391  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:51.470984  1696 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.460614  1542 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:00:51.426378  3952 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.613s	user 0.003s	sys 0.000s
I20260709 13:00:51.472580  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:51.475068  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:51.494284  1688 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:51.460788  3810 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:51.471787  3846 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.505276  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:51.402908  3877 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.482756  3664 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:51.485206  3806 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:51.509773  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:51.412671  3820 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.525974  1688 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:51.659353  1689 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:51.632792  1693 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:51.571676  1692 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:51.571648  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:00:51.590384  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115380us
I20260709 13:00:51.671599  1696 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:00:51.647521  3969 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:00:51.674630  3967 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:00:51.509162  3664 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:51.575917  1691 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:51.514714  3886 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.674774  3879 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.518448  3806 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:51.895291  3903 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.895761  3806 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.895262  3879 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.895998  3903 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.782308  3872 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.682840  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.789980  3877 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:51.898130  3903 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:51.678710  3911 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:51.899391  3903 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.789412  3746 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.900104  3903 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.901015  1689 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:51.901398  1541 raft_consensus.cc:2368] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:51.902437  1689 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:51.709997  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:51.899776  3664 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:51.902733  3903 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:51.898541  3872 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:51.582407  3810 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.903537  1539 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:51.778191  3974 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:51.897977  3879 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:51.917240  3746 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:51.526049  3968 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:51.918043  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:51.547243  3633 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.003s
W20260709 13:00:51.565156  3966 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:51.923735  3633 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.924096  2265 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:51.925081  3633 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.578943  3846 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:00:51.780269  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.903311  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 398158us
I20260709 13:00:51.583527  3889 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:51.634203  3947 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:51.946491  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:51.547297  3881 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:51.959842  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:51.961680  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:51.964425  3971 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:51.966568  3889 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:51.967895  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:51.941715  3846 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:51.998680  1540 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.010187  3846 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.009749  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:52.027575  2261 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:51.985910  3970 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:00:51.963054  3968 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:00:52.050976  1538 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.055675  1693 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:00:52.055282  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 93732.1us
I20260709 13:00:52.053838  3923 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.064492  3749 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:00:52.110097  1587 leader_election.cc:400] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:00:52.092360  3905 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.000s
I20260709 13:00:52.110512  1587 leader_election.cc:403] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.115321  3664 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.090888  3977 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.095798  3749 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:52.087092  3633 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:52.112980  3992 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:52.129161  3977 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.098053  3968 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:00:52.113242  3897 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.137676  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:52.087704  3846 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.137307  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:52.086542  3806 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.139487  1545 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.135972  3992 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.140662  3897 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.143321  3992 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:52.144131  3995 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:52.144706  3995 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.139797  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:52.151420  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:52.152050  1615 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:52.127638  3749 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:52.133605  3997 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.157989  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:52.155417  3988 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:52.165449  3988 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.118906  3905 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.138880  3971 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:52.292066  1621 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.234143  1620 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:52.232002  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:52.602355  1539 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.182535  1545 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:52.287801  1618 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.572957  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:52.605064  1544 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.599835  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2026) took 1561 ms. Trace:
I20260709 13:00:52.605677  1687 rpcz_store.cc:276] 0709 13:00:51.038837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.097614 (+ 58777us) service_pool.cc:224] Handling call
0709 13:00:52.316001 (+1218387us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b5400002154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:52.599734 (+283733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15665024}
W20260709 13:00:52.575913  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 438340us
I20260709 13:00:52.175606  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:52.607227  1540 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:52.580379  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:52.579296  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:52.599848  1692 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:52.609231  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1344) took 1305 ms. Trace:
I20260709 13:00:52.609498  1692 rpcz_store.cc:276] 0709 13:00:51.304036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.661389 (+357353us) service_pool.cc:224] Handling call
0709 13:00:52.187243 (+525854us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:52.599666 (+412423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.608991 (+  9325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.609184 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12409088}
I20260709 13:00:52.613883  3988 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:52.616885  3845 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.617427  3845 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:52.572374  3998 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.619092  3998 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.620198  3997 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:00:52.608153  1617 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:52.623482  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1626) took 1419 ms. Trace:
W20260709 13:00:52.586771  3886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.009s	sys 0.005s
I20260709 13:00:52.155289  3664 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:52.625115  1538 rpcz_store.cc:276] 0709 13:00:51.203768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.203975 (+   207us) service_pool.cc:224] Handling call
0709 13:00:52.050746 (+846771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.051582 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.623277 (+571695us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400257950. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:52.623406 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917217664}
I20260709 13:00:52.632115  1619 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:52.633315  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:52.313395  3784 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.157092  3947 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:52.417205  3607 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.613236  3633 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:52.626858  2257 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:52.188514  3925 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:52.644300  3925 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:52.644690  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:52.645241  3925 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:52.646013  3633 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.646508  3925 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.648102  3633 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:52.629297  1539 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:52.630416  1620 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:52.319790  3863 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.241773  3999 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:52.177780  3957 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.804s	user 0.001s	sys 0.000s
I20260709 13:00:52.168079  2261 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:52.319638  3881 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:00:52.230784  3820 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.165501  3921 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:52.579108  3977 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:52.171343  3846 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:52.246057  3897 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:52.638454  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:52.639339  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.166337  3980 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.627708  3994 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260709 13:00:52.658767  3999 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:52.640435  3607 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:52.652886  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:52.640344  3784 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.653249  3880 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:52.653590  3923 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:52.653926  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:52.655242  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:52.660085  1544 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:00:52.663719  1618 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:52.297097  3749 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:52.631742  3886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.009s	sys 0.005s
I20260709 13:00:52.739526  3947 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.749847  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 119384us
I20260709 13:00:52.765095  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:52.769817  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 114656us
I20260709 13:00:52.737807  4005 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.779886  2263 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:52.747601  3903 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:52.699908  3992 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:00:52.692911  3881 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:52.759588  3897 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:52.737964  3820 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:52.748116  3971 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:52.661903  3863 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.772361  3880 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.700826  4003 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:00:52.759429  3980 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.818703  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:52.892027  1692 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:52.822889  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:52.786724  3923 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.844612  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:52.849929  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:52.811291  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74386.1us
W20260709 13:00:53.537178  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.623s (SENT) [suppressed 14 similar messages]
W20260709 13:00:53.300199  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.795670  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 151065us
I20260709 13:00:53.540071  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:52.855576  1691 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:53.206830  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 137355us
I20260709 13:00:52.826292  1695 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
W20260709 13:00:53.543431  3881 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.687s	user 0.008s	sys 0.002s
I20260709 13:00:53.543728  4021 raft_consensus.cc:476] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:53.543910  3881 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.544441  4021 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:53.544996  4021 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.546137  3881 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:53.550952  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:53.552749  4023 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.556286  4023 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.611518  4023 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:53.612252  4029 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:53.612978  4025 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.613000  4026 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:53.613587  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 73598.7us
I20260709 13:00:53.627130  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:53.613961  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63139.1us
I20260709 13:00:53.628825  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:53.615630  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.619040  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 378) took 1474 ms. Trace:
I20260709 13:00:53.617715  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:53.318226  3925 consensus_meta.cc:287] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.671s	user 0.002s	sys 0.007s
W20260709 13:00:53.142143  4010 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 13:00:53.629874  1614 rpcz_store.cc:276] 0709 13:00:52.144485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.148644 (+  4159us) service_pool.cc:224] Handling call
0709 13:00:52.148962 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.769192 (+620230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.769219 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.826540 (+ 57321us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.066547 (+240007us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:53.066588 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.066671 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:53.618766 (+552095us) raft_consensus.cc:1685] finished
0709 13:00:53.618789 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:53.618955 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60101,"raft.queue_time_us":479512,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":9837,"thread_start_us":404571,"threads_started":2,"wal-append.queue_time_us":732521}
I20260709 13:00:52.855618  3977 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.202368  4017 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.820933  4007 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.140410  4013 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:53.548033  3784 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:53.257036  3657 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.318234  3911 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:52.850765  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 379) took 1764 ms. Trace:
I20260709 13:00:52.879279  3863 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:52.877097  4006 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:53.115381  3886 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:52.823424  3845 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.485797  4012 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:52.855598  3897 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:53.080971  3905 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:53.259167  3880 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:53.068408  3820 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:53.652782  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:53.080443  4015 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.604s
I20260709 13:00:53.657406  4025 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.711774  4031 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.688264  3886 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.712410  4031 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.713078  4025 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.619897  3944 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.661926  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:53.713661  4014 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:00:53.714028  3886 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:53.081491  3999 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:53.714609  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 52778.2us
I20260709 13:00:53.714905  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:53.715085  3999 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.715394  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:53.715981  4009 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:53.716500  4009 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:53.716652  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:53.664439  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.619237  4003 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:52.813877  3947 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:52.820551  3903 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.673333  4030 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:53.675488  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:53.654886  3977 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.683781  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:00:53.685421  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67793.5us
I20260709 13:00:53.655673  4023 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:00:52.853528  3988 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.711710  4015 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:53.715480  2262 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:53.667635  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:53.672317  3892 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.722800  2263 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:52.811950  4005 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.725485  4030 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.652478  4026 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.732849  4036 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:00:53.733382  4003 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.686766  4006 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:53.736250  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60826.4us
W20260709 13:00:53.736946  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69386.7us
I20260709 13:00:53.749346  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:53.738106  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 196056us
I20260709 13:00:53.666644  3657 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.714577  3886 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.713670  3880 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.670588  3911 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.742823  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:53.745487  1538 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:53.724038  3925 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:53.771698  3925 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:00:53.719868  3881 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:53.772800  3881 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:53.774310  1587 connection.cc:256] RPC call timeout handler was delayed by -1.3824132770000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:00:53.792299  1587 connection.cc:256] RPC call timeout handler was delayed by -1.13941327699996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:00:53.709620  3845 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:00:53.795282  4034 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.795619  4003 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.795840  4034 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.796343  4037 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.797001  4037 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.730473  3977 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.775545  3881 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.803046  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:53.722373  3944 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.735422  4015 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:53.666424  4007 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.780515  3892 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:00:53.784143  4032 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.664247  4017 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.666725  4013 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.784497  4036 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:53.785882  3995 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:53.720841  3897 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.789048  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:53.717406  4009 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.739820  4033 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.740142  3820 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.746299  3863 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:53.766332  4041 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:53.708599  4012 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.794487  4042 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.740592  4030 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:53.767112  4029 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:53.792021  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:53.803424  1613 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:53.803704  1616 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:53.819619  1587 leader_election.cc:400] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:53.906113  1587 leader_election.cc:403] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:53.906342  1614 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:53.907843  1621 raft_consensus.cc:2410] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:53.780125  3653 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:53.915621  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 96227.2us
I20260709 13:00:53.666261  2259 rpcz_store.cc:276] 0709 13:00:51.086516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.106703 (+ 20187us) service_pool.cc:224] Handling call
0709 13:00:52.849027 (+1742324us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:52.849502 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.849970 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.850008 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.850094 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:52.850196 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.850318 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.850673 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6306176}
I20260709 13:00:53.779852  3886 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.823621  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:51160
I20260709 13:00:53.787668  3880 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.927042  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:53.927634  4039 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:54.163466  4039 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:54.167933  4039 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.832559  4006 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:54.037355  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 286524us
I20260709 13:00:53.825856  4005 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:54.028705  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.037051  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 287826us
W20260709 13:00:54.019181  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 145846us
I20260709 13:00:53.823290  4014 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:53.865216  3925 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.843282  3923 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:54.139416  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 398610us
I20260709 13:00:54.151880  3863 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:53.827442  2291 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:35005 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:35005 timed out after 15.000s (SENT)
I20260709 13:00:53.823894  4034 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.176121  2257 raft_consensus.cc:606] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:53.991451  1614 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:53.908875  4036 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:53.996487  3760 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:54.037539  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 289069us
I20260709 13:00:53.918187  3820 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.830654  4026 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.080307  3806 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:53.824121  4027 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.274010  3760 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.274142  4027 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:53.917944  4033 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:53.970444  1618 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:54.276480  4033 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.277215  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:54.277921  2258 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:54.270604  3820 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.186924  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:53.840238  3903 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.000715  4012 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.227591  3978 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:54.004827  4015 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.316032  4038 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:54.316226  4015 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.313639  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.316666  4038 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.072703  3897 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.232782  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.229068  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:54.318751  1693 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:54.319213  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 90252.7us
I20260709 13:00:54.319538  1541 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:54.230648  4014 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:54.280997  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 48077.2us
W20260709 13:00:54.237782  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.841270  3911 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:53.828956  4037 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.327052  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:53.827481  3980 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.259507  2257 raft_consensus.cc:614] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:54.327780  4014 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.261381  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:54.328809  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67554.4us
I20260709 13:00:54.328997  4045 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:54.329818  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:54.262919  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1264) took 2010 ms. Trace:
I20260709 13:00:54.330873  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:54.330761  1615 rpcz_store.cc:276] 0709 13:00:52.252844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.253050 (+   206us) service_pool.cc:224] Handling call
0709 13:00:52.600317 (+347267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:52.785471 (+185154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:52.785514 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:52.827674 (+ 42160us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.130570 (+1302896us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b1800405400. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:00:54.262342 (+131772us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:54.262406 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.262506 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.262564 (+    58us) raft_consensus.cc:1685] finished
0709 13:00:54.262581 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.262848 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79269,"raft.queue_time_us":216708,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":12898,"spinlock_wait_cycles":4285824,"thread_start_us":241385,"threads_started":2,"wal-append.queue_time_us":1403740}
I20260709 13:00:54.333010  4005 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:54.266260  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:54.268096  1544 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:54.268618  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:54.334491  4034 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.334935  4034 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.927771  3971 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.269681  1540 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:00:54.270550  1539 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:54.271037  1688 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:54.271862  2259 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:53.822667  4003 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:54.026113  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.999145  4017 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.068229  4013 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.276499  4027 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.360433  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:53.917430  4042 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:54.297133  1546 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:54.315873  3978 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.385279  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.388185  1544 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:00:54.014384  3749 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:00:54.234740  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63546.5us
I20260709 13:00:54.071635  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 584) took 2614 ms. Trace:
I20260709 13:00:54.391251  2265 rpcz_store.cc:276] 0709 13:00:51.457218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.457355 (+   137us) service_pool.cc:224] Handling call
0709 13:00:51.457627 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.924650 (+467023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.071242 (+2146592us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54005a00d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:54.071513 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1071236480}
I20260709 13:00:53.981087  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 376) took 2746 ms. Trace:
I20260709 13:00:54.392251  1619 rpcz_store.cc:276] 0709 13:00:51.235017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.236009 (+   992us) service_pool.cc:224] Handling call
0709 13:00:51.236216 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.632554 (+1396338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.980761 (+1348207us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002ca454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:53.981004 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3210171776}
I20260709 13:00:54.392658  1544 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:54.065773  4011 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.236981  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.393528  1616 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
W20260709 13:00:54.323825  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.394143  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.012346  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 721) took 1879 ms. Trace:
I20260709 13:00:54.261222  3863 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.318696  3839 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:54.326368  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:54.403995  1541 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.326893  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.405218  1693 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:00:54.332744  4045 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:54.268838  1547 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:54.265862  3905 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:53.822983  4040 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.343858  3977 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.006s
I20260709 13:00:54.347160  1691 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:54.347872  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.281917  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.350849  3697 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:00:54.312029  3988 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:54.288321  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.433822  1617 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:54.296936  1543 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:54.351141  4041 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:00:54.386060  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:54.389675  4038 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.259476  3925 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.342687  4006 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:54.398084  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.341687  3746 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:54.401152  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.401139  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:54.331007  4043 consensus_queue.cc:1175] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fbc4df0bb934bba941cfa20c0afead2" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:54.403081  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.407217  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.412967  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.499377  1614 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:54.413445  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.340885  4012 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:00:54.350772  3903 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:00:54.431716  2230 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:54.428121  2231 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:54.436110  1543 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:54.506163  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:54.506946  1543 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.383708  1539 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:54.431844  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:54.402120  4013 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:54.337201  4034 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:54.413757  3977 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.442776  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:54.503458  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:54.189812  4029 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:54.413389  4035 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:54.385044  4033 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:54.413815  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:54.455843  1619 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 2.
I20260709 13:00:54.384330  4003 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.470422  2257 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:54.500461  1622 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:54.407931  4017 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:00:54.411311  3897 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:00:54.511029  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79279.3us
I20260709 13:00:54.511118  4007 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.513489  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:54.541944  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 150912us
I20260709 13:00:54.542244  1547 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:54.508852  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.543455  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.544739  1539 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:00:54.414234  3923 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:00:54.408165  4011 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.443078  4042 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:54.517568  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 85096.7us
I20260709 13:00:54.569252  1615 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
W20260709 13:00:54.517832  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 89814us
I20260709 13:00:54.431293  3839 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:00:54.576203  1693 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:54.530584  3988 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:54.579885  1695 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:54.433964  3999 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:00:54.413146  4040 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:54.497526  3947 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.402575  2261 rpcz_store.cc:276] 0709 13:00:52.133495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.134128 (+   633us) service_pool.cc:224] Handling call
0709 13:00:52.137254 (+  3126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.701325 (+564071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.011968 (+1310643us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:54.012254 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70419840}
I20260709 13:00:54.514783  3886 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:54.439854  3944 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 13:00:54.534492  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 316) took 1882 ms (client timeout 2118 ms). Trace:
I20260709 13:00:54.534650  1543 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:54.535588  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 187254us
I20260709 13:00:54.535844  4031 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.531251  3653 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:54.537727  3893 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.515470  4014 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:00:54.546201  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.404179  4036 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:54.454926  4030 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.556213  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.527861  4038 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:00:54.572422  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:54.574967  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:54.522027  4035 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:54.412472  4048 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
W20260709 13:00:54.517346  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 86114.2us
I20260709 13:00:54.540583  3925 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.516300  4013 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.502115  4050 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:00:54.816541  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 246127us
I20260709 13:00:54.974133  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:54.976361  1542 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:00:54.974946  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 1.26598e+06us
I20260709 13:00:54.984246  1692 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:00:54.919457  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 416113us
W20260709 13:00:54.951539  1541 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.547s	user 0.003s	sys 0.008s
I20260709 13:00:54.992034  1541 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:54.993306  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.993930  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:54.994599  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:54.995504  1538 rpcz_store.cc:269] 0709 13:00:52.652462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.652602 (+   140us) service_pool.cc:224] Handling call
0709 13:00:54.534301 (+1881699us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400021054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:54.534428 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266443008}
W20260709 13:00:54.867494  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.997934  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.998268  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.669675  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:54.999418  1691 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:00:54.860247  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.992277  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:54.556226  3980 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:54.963210  4059 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:00:55.082849  3905 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.084472  4058 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.560s	user 0.000s	sys 0.000s
I20260709 13:00:55.084734  3905 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.085001  3903 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:00:55.086001  4055 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.566s	user 0.001s	sys 0.000s
I20260709 13:00:55.083508  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:55.087604  4030 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:55.087831  3749 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.000s
I20260709 13:00:55.088408  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:55.084053  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:55.083034  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.083747  1542 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:55.090634  1543 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:54.540827  4062 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.104549  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:54.896560  4056 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
I20260709 13:00:54.970816  4003 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:55.107537  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:55.107743  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:55.004246  3653 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.775841  4033 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:55.108618  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:55.108774  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.109514  1692 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:55.109601  1693 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:55.109921  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.090162  3970 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.110415  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:55.115330  1613 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:00:55.129688  1692 raft_consensus.cc:2376] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5. Re-sending same reply.
I20260709 13:00:54.994953  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:55.137522  1692 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:00:55.139726  1547 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 13:00:55.175459  1547 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:54.976740  3971 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.003s
I20260709 13:00:54.745321  3607 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.176584  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.971671  3977 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:55.122114  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:55.145188  1659 connection.cc:256] RPC call timeout handler was delayed by -1.6707058819999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
I20260709 13:00:55.295408  1692 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:00:55.298064  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.109149  4033 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:55.298964  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 195694us
W20260709 13:00:55.299417  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 307200us
I20260709 13:00:55.274340  1693 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:55.312832  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:55.313750  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.007112  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:55.315415  2265 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:55.284689  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 227655us
I20260709 13:00:55.158166  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:55.302934  1543 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:55.045781  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 473448us
I20260709 13:00:55.316910  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:55.322500  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.322947  1693 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:00:55.325016  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 166952us
I20260709 13:00:55.325917  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:55.328181  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:55.089833  3905 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:54.965278  3760 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.002s
W20260709 13:00:54.968940  4015 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
W20260709 13:00:55.348451  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 122720us
I20260709 13:00:55.378084  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:54.744283  4008 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.934s
I20260709 13:00:55.314674  1692 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:55.115645  4014 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.121613  3999 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.121196  3944 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:55.103401  3911 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:55.351876  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.580796  4007 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.974670  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:54.580174  3988 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.324071  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.122184  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:54.725128  4006 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:55.108660  3653 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.001511  3997 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.352859  3881 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:55.288341  3749 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:00:55.120839  3972 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:55.129544  4062 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.114833  3992 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.327966  3971 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:54.856280  3863 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:55.353174  1540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.025s	sys 0.013s
I20260709 13:00:55.243217  3970 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.307636  4005 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:00:55.353267  1659 connection.cc:256] RPC call timeout handler was delayed by -1.3956959180000013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:00:55.374034  3897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.016s	sys 0.044s
I20260709 13:00:55.345304  3980 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:54.969883  4011 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:54.580137  4042 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:54.996357  4038 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.116163  4013 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:55.090232  3892 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.344s
I20260709 13:00:55.349174  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:55.381850  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:55.307355  4048 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.387338  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:55.388240  1694 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:55.110925  3923 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.243s
I20260709 13:00:55.110520  4021 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:55.289237  4040 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.311370  3978 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.349079  3903 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:55.117025  4035 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:55.377604  3947 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:55.395321  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:55.833422  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.895865  1689 raft_consensus.cc:2410] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:55.489464  1620 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:55.878764  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.008s	sys 0.008s
I20260709 13:00:55.879992  1690 raft_consensus.cc:606] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:55.897302  1690 raft_consensus.cc:614] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:55.422459  4003 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.811524  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.879340  1622 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:55.901537  1692 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:55.571297  3998 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.402129  3911 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.424450  4007 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:55.908643  4034 consensus_meta.cc:287] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.387s	user 0.009s	sys 0.001s
I20260709 13:00:55.909111  4034 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.909945  4007 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:55.629951  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 255380us
I20260709 13:00:55.911301  4034 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:55.421772  4079 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.519s
I20260709 13:00:55.912189  4034 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.912670  4034 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.391149  3999 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:55.894037  4042 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:55.915351  3999 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.916249  3980 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.916581  3999 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.898648  4048 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:55.917032  4042 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:55.393447  3944 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:00:55.918497  4080 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:00:55.918951  4048 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:55.803684  4084 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:00:55.920300  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1635) took 1484 ms. Trace:
W20260709 13:00:55.703709  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.886170  1540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.498s	user 0.027s	sys 0.031s
I20260709 13:00:55.920786  1539 rpcz_store.cc:276] 0709 13:00:54.436349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.545363 (+109014us) service_pool.cc:224] Handling call
0709 13:00:54.545651 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:54.559091 (+ 13440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.559138 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:54.690279 (+131141us) log.cc:844] Serialized 52 byte log entry
0709 13:00:55.143870 (+453591us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:55.143928 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.144014 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.920078 (+776064us) raft_consensus.cc:1685] finished
0709 13:00:55.920099 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.920242 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22909,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4619,"thread_start_us":268089,"threads_started":1,"wal-append.queue_time_us":713809}
W20260709 13:00:55.923041  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 573956us
W20260709 13:00:55.898049  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.008s	sys 0.008s
I20260709 13:00:55.745790  4068 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.545370  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 194577us
I20260709 13:00:55.883186  4038 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:55.902761  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.929145  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.929769  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:55.746870  4076 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:00:55.426755  4069 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:00:55.520546  4064 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.393268  3976 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.565425  4073 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.895394  3897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.320s	user 0.021s	sys 0.056s
I20260709 13:00:55.888293  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:55.924638  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 573263us
I20260709 13:00:55.880339  1693 raft_consensus.cc:2376] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
I20260709 13:00:55.746012  4067 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.887990  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.926121  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 330329us
I20260709 13:00:55.886382  3997 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:55.894945  3947 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.956102  3947 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.393146  4014 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.932214  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.901813  3988 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:55.931877  4068 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.879618  4005 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:55.387084  3905 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.536s
W20260709 13:00:55.930724  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55183.7us
I20260709 13:00:55.894503  4062 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:55.925030  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:55.899881  3903 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:55.936609  4090 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.922662  3911 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:55.940054  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51876.3us
I20260709 13:00:55.925947  4034 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:55.937772  3976 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:55.951220  4085 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:55.924705  4013 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:55.941244  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:55.955267  4048 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:55.955413  4082 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.894687  3992 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.930830  1622 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:55.879391  3881 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:55.919380  3944 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:55.977372  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:00:56.065092  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 87787.1us
I20260709 13:00:56.065696  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:56.066072  4081 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:00:56.066323  4097 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:55.905944  4003 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.067093  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:55.995147  4087 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:00:55.941779  4069 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:56.002084  1659 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:55.997257  1693 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:56.062875  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.067366  4095 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:55.956759  4033 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:55.905875  3972 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:55.955322  4006 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.997280  3976 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.068145  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:56.082891  1695 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.064268  3881 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:56.072487  4092 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:56.072659  3863 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:56.072871  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.072989  4093 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.987287  3968 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:00:55.955928  4073 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.076403  3944 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:56.075242  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:56.067034  4097 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.066890  4081 consensus_queue.cc:1243] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:00:56.075685  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2103) took 1776 ms. Trace:
I20260709 13:00:55.993304  4042 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:00:56.109974  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.078249  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:56.078588  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.112952  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.075126  3884 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:56.081166  3749 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:56.081342  3992 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:55.997004  4013 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:56.085968  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.009079  4085 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:56.092585  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:56.074446  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 149512us
I20260709 13:00:56.104511  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:56.116132  1622 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:55.940059  4064 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:55.954905  4067 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.091590  4033 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:56.118438  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.119220  1687 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:56.108726  3955 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:56.087384  4095 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:56.118104  3980 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:56.118533  4033 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:56.136870  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:56.071332  3997 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.120123  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.121405  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:56.138998  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.138532  1687 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:56.110414  1540 rpcz_store.cc:276] 0709 13:00:54.298864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.340095 (+ 41231us) service_pool.cc:224] Handling call
0709 13:00:54.340355 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.346435 (+  6080us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:00:55.922240 (+1575805us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.075350 (+153110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.075404 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:56.075459 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.075518 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.075628 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13231,"prepare.queue_time_us":1252327,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":15595,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7683,"thread_start_us":1657860,"threads_started":2}
I20260709 13:00:56.141426  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:56.108114  4097 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.126107  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.127825  2263 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:56.129140  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:56.107244  4092 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.123407  4081 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:56.131541  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:56.131325  4013 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.122890  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.112677  3657 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:56.003821  4090 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.209518  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.076326  4005 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:56.134815  3893 consensus_meta.cc:287] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.139s	user 0.007s	sys 0.004s
I20260709 13:00:56.119748  3749 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.121109  4085 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:56.205206  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:56.150326  3992 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:56.212972  1622 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:56.059070  4082 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.134676  4095 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.208730  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.209656  2265 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:56.215466  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:56.120782  4008 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:56.210175  1540 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:56.207758  3997 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.137429  3955 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:56.205209  4070 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.582s	user 0.001s	sys 0.000s
I20260709 13:00:56.206445  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.106647  3903 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.219579  1547 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:56.219944  2266 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:56.143313  4033 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:56.203320  4092 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.225586  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.210812  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:56.227077  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.215698  3992 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.222770  4008 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:56.232185  2261 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:56.258344  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.221563  4081 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:00:56.112093  4093 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:56.247929  3992 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:56.287473  4008 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:56.247496  4068 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:56.362133  4078 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:56.362720  4078 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:56.363039  3972 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:56.363152  4078 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:56.372365  1587 leader_election.cc:336] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.975s (SENT)
W20260709 13:00:56.365664  4103 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:00:56.363397  4095 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.444300  1539 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:56.451047  4095 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:56.455878  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.371446  4003 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:56.482195  4100 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
W20260709 13:00:56.493149  1546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2110) took 2141 ms (client timeout 1990 ms). Trace:
I20260709 13:00:56.230496  3955 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:56.530201  3911 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.532s	user 0.000s	sys 0.007s
W20260709 13:00:56.520653  1546 rpcz_store.cc:269] 0709 13:00:54.351472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.492929 (+2141457us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:56.493051 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:56.514603  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 512628us
W20260709 13:00:56.515967  4099 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:00:56.531088  3653 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.629s	user 0.001s	sys 0.009s
W20260709 13:00:56.580967  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 95033.6us
W20260709 13:00:56.589380  1510 leader_election.cc:336] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.525s (SENT)
I20260709 13:00:56.594445  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:00:56.597276  1695 consensus_meta.cc:287] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.016s
I20260709 13:00:56.597734  1695 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:56.598224  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2050) took 1446 ms. Trace:
I20260709 13:00:56.598524  1695 rpcz_store.cc:276] 0709 13:00:55.151462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.005193 (+853731us) service_pool.cc:224] Handling call
0709 13:00:56.598168 (+592975us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:56.537972  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:56.600360  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:56.601532  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:56.599707  4042 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.615996  1546 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:56.538007  3911 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:56.627202  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:56.618202  3999 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.701s	user 0.006s	sys 0.007s
I20260709 13:00:56.588032  4034 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:00:56.634339  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.637280  4093 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:56.618656  4089 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.587941  3653 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:56.651095  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.625836  4048 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:56.629042  3980 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.625777  3749 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:56.619706  4064 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:56.672727  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.613807  4042 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:56.683706  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:56.689867  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:56.690582  1540 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:00:56.690872  1546 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:00:56.776803  4108 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:00:57.178607  4009 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.040s	sys 0.073s
W20260709 13:00:56.740777  3944 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.009s
W20260709 13:00:57.204658  4009 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.041s	sys 0.073s
W20260709 13:00:56.749280  3988 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.758s	user 0.006s	sys 0.004s
I20260709 13:00:56.743893  3653 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.205891  3988 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:56.673724  3980 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:56.744647  4111 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 13:00:57.172305  4078 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.809s	user 0.009s	sys 0.003s
I20260709 13:00:56.795090  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:56.888012  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.213809  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2051) took 1317 ms. Trace:
W20260709 13:00:57.214920  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.000s	sys 0.010s
W20260709 13:00:56.660799  4038 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.723s	user 0.015s	sys 0.026s
W20260709 13:00:57.215320  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.000s	sys 0.010s
W20260709 13:00:57.216522  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 426207us
I20260709 13:00:56.983753  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1278) took 3192 ms. Trace:
W20260709 13:00:57.217150  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 139728us
I20260709 13:00:57.023732  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1342) took 5680 ms. Trace:
I20260709 13:00:56.658840  4048 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:56.675611  4106 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:00:56.745240  3947 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.778s	user 0.001s	sys 0.019s
I20260709 13:00:57.214308  1695 rpcz_store.cc:276] 0709 13:00:55.896411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.774117 (+877706us) service_pool.cc:224] Handling call
0709 13:00:57.213724 (+439607us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.248989  1618 rpcz_store.cc:276] 0709 13:00:53.791406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.791537 (+   131us) service_pool.cc:224] Handling call
0709 13:00:53.791921 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.276680 (+484759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.983464 (+2706784us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54001603d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:56.983673 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310753024}
W20260709 13:00:56.969815  3881 consensus_meta.cc:287] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.006s
W20260709 13:00:57.089607  4085 consensus_meta.cc:287] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.857s	user 0.009s	sys 0.002s
W20260709 13:00:57.088709  4092 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.802s	user 0.007s	sys 0.005s
W20260709 13:00:57.238409  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1280) took 2837 ms (client timeout 1978 ms). Trace:
W20260709 13:00:56.915848  4062 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.923s	user 0.012s	sys 0.000s
W20260709 13:00:57.116535  3976 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.034s	user 0.010s	sys 0.002s
W20260709 13:00:56.748558  3997 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.002s
I20260709 13:00:56.669497  4090 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:57.188191  4033 consensus_meta.cc:287] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.003s
I20260709 13:00:57.264192  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.249959  1688 rpcz_store.cc:276] 0709 13:00:51.303367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.660022 (+356655us) service_pool.cc:224] Handling call
0709 13:00:54.010758 (+2350736us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5e9c 00007f7f177b5a5b 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:54.010982 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:54.341266 (+330284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.983041 (+2641775us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400451854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:56.983304 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610773888}
I20260709 13:00:57.325076  1696 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:00:57.325562  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.306110  3911 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.306835  3980 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.309458  3988 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:56.746096  3992 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.311107  4068 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:00:57.311141  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:57.350731  1618 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:57.314819  1615 rpcz_store.cc:269] 0709 13:00:54.400813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.400936 (+   123us) service_pool.cc:224] Handling call
0709 13:00:57.237570 (+2836634us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54000eea54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.238335 (+   765us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228079872}
W20260709 13:00:57.167388  4008 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.002s
I20260709 13:00:57.321543  1622 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:00:57.228058  4006 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.005s	sys 0.005s
W20260709 13:00:56.918082  4097 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.710s	user 0.011s	sys 0.000s
I20260709 13:00:57.329909  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.356431  3992 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.371002  1695 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:00:57.371872  4017 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:57.372114  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.372346  4017 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:57.373018  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1370) took 2060 ms. Trace:
I20260709 13:00:57.326304  1688 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:57.352077  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.352905  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:00:57.374063  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.374260  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 385) took 1167 ms. Trace:
I20260709 13:00:57.374404  1615 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:57.374418  1696 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:57.259320  4048 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.387158  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:57.388237  4026 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:57.388695  4026 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:57.389559  4026 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.391290  4040 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:57.391733  4040 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:57.392557  4040 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.393824  4040 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.395023  3846 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:57.395442  3846 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:57.396261  3846 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.397282  3846 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.405956  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1285) took 2967 ms. Trace:
W20260709 13:00:57.408181  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.408977  3653 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:57.409515  3653 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.411329  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1281) took 3009 ms. Trace:
I20260709 13:00:57.411725  1621 rpcz_store.cc:276] 0709 13:00:54.401464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.401574 (+   110us) service_pool.cc:224] Handling call
0709 13:00:54.401875 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.122752 (+720877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.122783 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.123267 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.622757 (+499490us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:55.622818 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.410970 (+1788152us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400117e54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.411015 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.411058 (+    43us) raft_consensus.cc:1685] finished
0709 13:00:57.411071 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.411274 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":161664,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":1657055488,"thread_start_us":323375,"threads_started":1,"wal-append.queue_time_us":635070,"wal-append.run_cpu_time_us":1821,"wal-append.run_wall_time_us":1011949}
I20260709 13:00:57.413546  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.414111  1621 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:00:57.418608  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.421592  1691 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 2.
I20260709 13:00:57.422901  1691 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:00:57.423492  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2039) took 2286 ms. Trace:
I20260709 13:00:57.423802  1691 rpcz_store.cc:276] 0709 13:00:55.137350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.422301 (+2284951us) service_pool.cc:224] Handling call
0709 13:00:57.422669 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.423240 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.423428 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.425235  1691 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:57.425781  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2040) took 2288 ms. Trace:
I20260709 13:00:57.406421  1614 rpcz_store.cc:276] 0709 13:00:54.438738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.516385 (+ 77647us) service_pool.cc:224] Handling call
0709 13:00:54.527535 (+ 11150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.530681 (+  3146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.530712 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.541494 (+ 10782us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.992819 (+451325us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:54.992860 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.992921 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.401070 (+2408149us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b2400132488. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f176739c4 00007f7f17671acb 00007f7f1782cdc9 00007f7f1782ca55 00007f7f1782bfb0 00007f7f1a4a2488 00007f7f1a4a2be8 00007f7f1a47a398 00007f7f1a47576a 00007f7f1a474bb6
0709 13:00:57.405633 (+  4563us) raft_consensus.cc:1685] finished
0709 13:00:57.405655 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.405892 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":441745,"raft.queue_time_us":41700,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":92130,"spinlock_wait_cycles":20184960,"thread_start_us":230438,"threads_started":1,"wal-append.queue_time_us":802503}
I20260709 13:00:57.428972  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.429600  1614 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:57.430066  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 401) took 1501 ms (client timeout 1754 ms). Trace:
I20260709 13:00:57.420288  4014 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.438037  3653 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.438839  3653 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.439450  3653 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.442270  3653 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:57.348220  4116 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:00:57.361291  1618 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:00:57.311952  4064 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:00:57.374754  1688 rpcz_store.cc:276] 0709 13:00:56.206931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.325269 (+1118338us) service_pool.cc:224] Handling call
0709 13:00:57.374208 (+ 48939us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.358841  4006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.005s	sys 0.006s
I20260709 13:00:57.373446  1695 rpcz_store.cc:276] 0709 13:00:55.312613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.371799 (+2059186us) service_pool.cc:224] Handling call
0709 13:00:57.372942 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.375166  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1604) took 1408 ms (client timeout 1601 ms). Trace:
I20260709 13:00:56.674247  4089 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.373297  4017 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.458221  1544 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:00:57.348425  3947 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.460112  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2106) took 3145 ms. Trace:
I20260709 13:00:57.460341  3947 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.460724  4089 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.460623  1544 rpcz_store.cc:276] 0709 13:00:54.314345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.393378 (+ 79033us) service_pool.cc:224] Handling call
0709 13:00:54.393655 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.458915 (+3065260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.459756 (+   841us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b54000474d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.460000 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7047735040}
I20260709 13:00:57.379663  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2112) took 1257 ms. Trace:
I20260709 13:00:57.462083  1539 rpcz_store.cc:276] 0709 13:00:56.122484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.122653 (+   169us) service_pool.cc:224] Handling call
0709 13:00:57.379437 (+1256784us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54000479d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.379598 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543793408}
I20260709 13:00:57.321974  3881 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:57.348003  4111 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:00:57.496101  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.496531  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.496810  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.448463  4036 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.450874  3880 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.264477  4034 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:00:57.451399  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1284) took 3014 ms. Trace:
W20260709 13:00:57.414536  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1601) took 1458 ms (client timeout 1648 ms). Trace:
W20260709 13:00:57.503295  1621 rpcz_store.cc:269] 0709 13:00:55.955853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.413290 (+1457437us) service_pool.cc:224] Handling call
0709 13:00:57.414485 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.321074  4062 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.426087  1691 rpcz_store.cc:276] 0709 13:00:55.137582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.424587 (+2287005us) service_pool.cc:224] Handling call
0709 13:00:57.424876 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.425548 (+   672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.425728 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.453747  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 398) took 2104 ms (client timeout 2213 ms). Trace:
I20260709 13:00:57.503199  1617 rpcz_store.cc:276] 0709 13:00:54.437102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.437291 (+   189us) service_pool.cc:224] Handling call
0709 13:00:54.442289 (+  4998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.568294 (+126005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.568339 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.586089 (+ 17750us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.378949 (+792860us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:55.379070 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.450924 (+2071854us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54002cae54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.450983 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.451030 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:57.451046 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.451326 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29288,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":21892,"spinlock_wait_cycles":159288064,"thread_start_us":540404,"threads_started":2,"wal-append.queue_time_us":716295,"wal-append.run_cpu_time_us":9196,"wal-append.run_wall_time_us":1635594}
I20260709 13:00:57.253299  4038 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.238539  4078 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:57.455952  1615 rpcz_store.cc:269] 0709 13:00:55.966978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.351883 (+1384905us) service_pool.cc:224] Handling call
0709 13:00:57.375112 (+ 23229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.456645  1688 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:57.381439  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 739) took 1237 ms. Trace:
I20260709 13:00:57.516515  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2043) took 2378 ms. Trace:
I20260709 13:00:57.516278  2265 rpcz_store.cc:276] 0709 13:00:56.144083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.194363 (+ 50280us) service_pool.cc:224] Handling call
0709 13:00:56.194712 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.219795 (+ 25083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.381182 (+1161387us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b54003a4654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.381377 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33941248}
I20260709 13:00:57.517042  1688 rpcz_store.cc:276] 0709 13:00:55.138452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.455026 (+2316574us) service_pool.cc:224] Handling call
0709 13:00:57.455343 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.516272 (+ 60929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.516466 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.495749  3810 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.518723  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.519487  1615 raft_consensus.cc:2368] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:00:57.521284  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.522274  1546 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.523962  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.524293  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.524953  2259 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:57.527387  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.528141  1546 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:57.529862  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.530288  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.530658  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.530927  1547 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:57.530931  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.531271  1545 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:57.532033  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.532294  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.531013  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.532924  1543 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.533263  1546 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:57.533605  1545 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:57.532925  1542 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:57.320748  3976 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.390583  4026 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:57.499583  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.499405  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 383) took 3705 ms (client timeout 1704 ms). Trace:
I20260709 13:00:57.330700  4033 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.504555  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:57.535977  1620 rpcz_store.cc:269] 0709 13:00:53.793683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.909512 (+115829us) service_pool.cc:224] Handling call
0709 13:00:57.499224 (+3589712us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000eef54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.499341 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2818218752}
W20260709 13:00:57.536620  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1590) took 1960 ms (client timeout 2111 ms). Trace:
I20260709 13:00:57.537072  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.537636  1692 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:57.537714  1620 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
W20260709 13:00:57.538317  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1602) took 1582 ms (client timeout 1838 ms). Trace:
I20260709 13:00:57.317575  4085 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:57.507494  1618 rpcz_store.cc:269] 0709 13:00:55.349620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.302249 (+1952629us) service_pool.cc:224] Handling call
0709 13:00:57.453678 (+151429us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.540328  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:57.541031  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1591) took 1939 ms (client timeout 2245 ms). Trace:
I20260709 13:00:57.541513  4085 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:00:57.542078  1620 rpcz_store.cc:269] 0709 13:00:55.956191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.536824 (+1580633us) service_pool.cc:224] Handling call
0709 13:00:57.538262 (+  1438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.543501  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:57.544260  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1584) took 2122 ms (client timeout 2500 ms). Trace:
W20260709 13:00:57.544646  1620 rpcz_store.cc:269] 0709 13:00:55.422366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.543233 (+2120867us) service_pool.cc:224] Handling call
0709 13:00:57.544208 (+   975us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.541345  1618 rpcz_store.cc:269] 0709 13:00:55.602117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.540060 (+1937943us) service_pool.cc:224] Handling call
0709 13:00:57.540980 (+   920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.546345  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.547034  1618 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
W20260709 13:00:57.547448  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1598) took 1649 ms (client timeout 2156 ms). Trace:
I20260709 13:00:57.458338  1695 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:00:57.547914  3976 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.317054  4092 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.532328  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:57.548506  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2044) took 2409 ms. Trace:
I20260709 13:00:57.548496  4033 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.548743  1540 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:00:57.430428  1614 rpcz_store.cc:269] 0709 13:00:55.928535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.428679 (+1500144us) service_pool.cc:224] Handling call
0709 13:00:57.430013 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.550343  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:57.550609  1689 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:57.550685  1692 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:00:57.551055  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1606) took 1583 ms. Trace:
I20260709 13:00:57.551331  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1372) took 2221 ms. Trace:
I20260709 13:00:57.551700  1689 rpcz_store.cc:276] 0709 13:00:55.329567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.550101 (+2220534us) service_pool.cc:224] Handling call
0709 13:00:57.550386 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.551099 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.551284 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.553205  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 381) took 2203 ms. Trace:
I20260709 13:00:57.551427  1614 rpcz_store.cc:276] 0709 13:00:55.967701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.550101 (+1582400us) service_pool.cc:224] Handling call
0709 13:00:57.551001 (+   900us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.553355  4092 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:57.553326  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 382) took 2203 ms (client timeout 2213 ms). Trace:
I20260709 13:00:57.554728  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.555482  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1609) took 1475 ms. Trace:
W20260709 13:00:57.555051  1692 rpcz_store.cc:269] 0709 13:00:55.350187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.123628 (+773441us) service_pool.cc:224] Handling call
0709 13:00:57.553124 (+1429496us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400366ad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.553259 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3072283904}
I20260709 13:00:57.555924  1614 rpcz_store.cc:276] 0709 13:00:56.079729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.554462 (+1474733us) service_pool.cc:224] Handling call
0709 13:00:57.555428 (+   966us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.556946  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.558151  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.362713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.619014  1616 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
W20260709 13:00:57.619565  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1608) took 1540 ms (client timeout 1522 ms). Trace:
W20260709 13:00:57.619954  1616 rpcz_store.cc:269] 0709 13:00:56.079377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.362307 (+1282930us) service_pool.cc:224] Handling call
0709 13:00:57.619484 (+257177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.553544  1689 rpcz_store.cc:276] 0709 13:00:55.349918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.552430 (+2202512us) service_pool.cc:224] Handling call
0709 13:00:57.552734 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.552909 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.552936 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.552973 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:57.553012 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.553063 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.553154 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.537081  1621 rpcz_store.cc:269] 0709 13:00:55.576559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.504295 (+1927736us) service_pool.cc:224] Handling call
0709 13:00:57.536536 (+ 32241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.558917  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1610) took 1471 ms (client timeout 1673 ms). Trace:
W20260709 13:00:57.613286  1512 leader_election.cc:336] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.525s (SENT)
W20260709 13:00:57.621325  1615 rpcz_store.cc:269] 0709 13:00:56.087728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.515719 (+1427991us) service_pool.cc:224] Handling call
0709 13:00:57.558858 (+ 43139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.621539  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:57.375150  4008 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.624611  4075 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:57.625025  4075 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:57.625691  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.625901  4008 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.452672  4097 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.560490  2263 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.560773  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.625828  4075 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:00:57.561704  4117 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:57.561648  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:57.645020  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1595) took 1772 ms (client timeout 1920 ms). Trace:
W20260709 13:00:57.645350  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.645920  1617 rpcz_store.cc:269] 0709 13:00:55.872702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.520285 (+1647583us) service_pool.cc:224] Handling call
0709 13:00:57.644871 (+124586us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.562328  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.563211  2258 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:57.560559  1695 rpcz_store.cc:276] 0709 13:00:55.149362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.455789 (+2306427us) service_pool.cc:224] Handling call
0709 13:00:57.458114 (+  2325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.548212 (+ 90098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.548437 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.547762  1618 rpcz_store.cc:269] 0709 13:00:55.898513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.546092 (+1647579us) service_pool.cc:224] Handling call
0709 13:00:57.547398 (+  1306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9600}
I20260709 13:00:57.568827  4062 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.569103  3881 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.570905  4078 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.571630  1687 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:57.572073  4006 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.575438  4048 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.578547  4038 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.579485  3970 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.585700  4042 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.671324  1695 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:57.661609  3806 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:57.672079  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2052) took 1775 ms. Trace:
I20260709 13:00:57.672147  3806 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.672483  1695 rpcz_store.cc:276] 0709 13:00:55.896694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.659221 (+1762527us) service_pool.cc:224] Handling call
0709 13:00:57.670980 (+ 11759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.671816 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.672021 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.673101  4048 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.673837  1695 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:00:57.674263  3806 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.604974  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 592) took 5632 ms. Trace:
I20260709 13:00:57.610019  3947 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:00:57.610648  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.610579  4090 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:57.611860  4005 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.609894  3653 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.615077  4067 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:57.623611  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1348) took 6318 ms. Trace:
I20260709 13:00:57.561493  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:57.622692  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 356943us
I20260709 13:00:57.637933  1692 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:57.674486  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2056) took 1776 ms. Trace:
I20260709 13:00:57.641922  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.688973  2265 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:57.683130  2266 rpcz_store.cc:276] 0709 13:00:51.972239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.972462 (+   223us) service_pool.cc:224] Handling call
0709 13:00:51.972808 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.228602 (+4255794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.604637 (+1376035us) spinlock_profiling.cc:243] Waited 4.24 s on lock 0x7b54006676d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.604890 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9760120192}
I20260709 13:00:57.674401  1696 raft_consensus.cc:2368] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:57.647555  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:57.613667  4017 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:57.667734  4006 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.671555  2259 raft_consensus.cc:2410] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:57.690150  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:57.690845  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 43492us
I20260709 13:00:57.691304  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.647219  4121 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.695518  4097 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.682868  1694 rpcz_store.cc:276] 0709 13:00:51.305032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.899990 (+594958us) service_pool.cc:224] Handling call
0709 13:00:54.009454 (+2109464us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:54.009723 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.879873 (+1870150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.623398 (+1743525us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540029ca54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:57.623557 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3194897536}
I20260709 13:00:57.695832  4121 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.696503  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43144 (request call id 20) took 3167 ms. Trace:
I20260709 13:00:57.696803  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:57.697461  1694 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:57.698197  4121 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.698838  4122 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.699319  4122 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.699342  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:57.700255  2259 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.695526  4013 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.689268  3653 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.701956  4073 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:57.698220  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2042) took 2560 ms (client timeout 2643 ms). Trace:
I20260709 13:00:57.702857  4015 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:57.640414  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.609824  4089 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:57.703050  1687 rpcz_store.cc:269] 0709 13:00:55.138168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.227156 (+1088988us) service_pool.cc:224] Handling call
0709 13:00:57.698041 (+1470885us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000b31d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.698163 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2946444032}
I20260709 13:00:57.703909  4089 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.704470  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.705888  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:57.706070  4089 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.689776  4090 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.708210  4006 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.709901  4090 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.704480  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.683208  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 383) took 2332 ms. Trace:
I20260709 13:00:57.689603  3947 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.692389  2261 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:57.703394  4015 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:57.712390  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:57.712397  4015 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:57.713544  4015 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.713723  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:57.714432  2262 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:57.668394  4075 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:57.715087  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 385) took 2610 ms. Trace:
I20260709 13:00:57.692775  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.715750  2265 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:00:57.716604  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.717248  2265 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:57.710992  1692 rpcz_store.cc:276] 0709 13:00:55.350471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.556239 (+2205768us) service_pool.cc:224] Handling call
0709 13:00:57.637663 (+ 81424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.682906 (+ 45243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.683148 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.703313  3653 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.715435  2262 rpcz_store.cc:276] 0709 13:00:55.104507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.713992 (+2609485us) service_pool.cc:224] Handling call
0709 13:00:57.714265 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.714853 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.715038 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.718492  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:57.719923  2263 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:57.720026  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:57.720769  1692 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.710583  4126 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.718987  4035 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.696959  1690 rpcz_store.cc:276] 0709 13:00:54.547845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.568491 (+ 20646us) service_pool.cc:224] Handling call
0709 13:00:57.696329 (+3127838us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540029ca54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d4853 00007f7f1f8a260a 00007f7f18e287d4 00007f7f18e28762 00007f7f18e28691 00007f7f18e2860c 00007f7f18e278c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.696440 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026195712}
I20260709 13:00:57.721079  2260 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:57.721426  4126 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:57.722266  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 382) took 5805 ms (client timeout 1525 ms). Trace:
I20260709 13:00:57.722803  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2058) took 1645 ms. Trace:
W20260709 13:00:57.722724  2260 rpcz_store.cc:269] 0709 13:00:51.917150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.917466 (+   316us) service_pool.cc:224] Handling call
0709 13:00:57.722093 (+5804627us) spinlock_profiling.cc:243] Waited 5.8 s on lock 0x7b54005b18d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.722191 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13343585152}
I20260709 13:00:57.691563  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:57.710677  2264 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:57.696308  4097 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:57.721192  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2053) took 1824 ms. Trace:
I20260709 13:00:57.712955  3947 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:57.741750  1694 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
W20260709 13:00:57.691821  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.688728  1695 rpcz_store.cc:276] 0709 13:00:55.897789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.673256 (+1775467us) service_pool.cc:224] Handling call
0709 13:00:57.673608 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.674242 (+   634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.674436 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.725708  1696 rpcz_store.cc:276] 0709 13:00:55.896942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.386851 (+1489909us) service_pool.cc:224] Handling call
0709 13:00:57.721016 (+334165us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b5400002154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.721137 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658386816}
I20260709 13:00:57.725244  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:57.765326  1693 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:57.766487  2265 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:57.727254  3978 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.752032  3810 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:57.784080  4097 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:57.872432  4097 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:57.874034  4126 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:57.612351  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:57.576869  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2120) took 1346 ms. Trace:
I20260709 13:00:57.918548  1541 rpcz_store.cc:276] 0709 13:00:56.230969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.511497 (+280528us) service_pool.cc:224] Handling call
0709 13:00:56.511907 (+   410us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:56.523802 (+ 11895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.523848 (+    46us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:56.540020 (+ 16172us) log.cc:844] Serialized 78 byte log entry
0709 13:00:57.231413 (+691393us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.522935 (+291522us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.567079 (+ 44144us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.576563 (+  9484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.576637 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.576672 (+    35us) raft_consensus.cc:1685] finished
0709 13:00:57.576684 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.576814 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74625,"prepare.queue_time_us":346734,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":75723,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":33455,"thread_start_us":845727,"threads_started":2,"wal-append.queue_time_us":632535}
W20260709 13:00:57.612180  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.922648  1539 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:57.923300  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.576193  1544 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:00:57.924455  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:57.927443  1547 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:57.628064  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1611) took 1036 ms. Trace:
I20260709 13:00:57.628005  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.616425  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 395) took 2481 ms. Trace:
I20260709 13:00:57.623728  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.546331  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.626421  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1599) took 1721 ms. Trace:
I20260709 13:00:57.706465  1687 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.723217  1690 rpcz_store.cc:276] 0709 13:00:56.077135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.721817 (+1644682us) service_pool.cc:224] Handling call
0709 13:00:57.722140 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.722441 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.722474 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.722524 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:57.722566 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.722646 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.722750 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.933380  1614 rpcz_store.cc:276] 0709 13:00:56.591543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.557871 (+966328us) service_pool.cc:224] Handling call
0709 13:00:57.627980 (+ 70109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.934715  1615 raft_consensus.cc:2410] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:57.960330  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:57.960983  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1592) took 2347 ms. Trace:
I20260709 13:00:57.961644  1614 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:57.961588  1615 rpcz_store.cc:276] 0709 13:00:55.614084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.627752 (+2013668us) service_pool.cc:224] Handling call
0709 13:00:57.960842 (+333090us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.959164  1619 rpcz_store.cc:276] 0709 13:00:55.135420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.135552 (+   132us) service_pool.cc:224] Handling call
0709 13:00:57.237704 (+2102152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.237940 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.237971 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.238017 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:57.238064 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.238172 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.616266 (+378094us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54000eea50. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:57.616368 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4834004864}
I20260709 13:00:57.930260  1510 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:57.968292  1616 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:00:57.969168  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1587) took 2484 ms (client timeout 3117 ms). Trace:
W20260709 13:00:57.942691  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 437054us
I20260709 13:00:57.969839  1621 rpcz_store.cc:276] 0709 13:00:55.928542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.625450 (+1696908us) service_pool.cc:224] Handling call
0709 13:00:57.626367 (+   917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.936553  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:00:57.917897  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 304369us
I20260709 13:00:57.971590  1620 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:57.972661  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:57.973258  1694 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:57.933831  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.977587  1616 rpcz_store.cc:269] 0709 13:00:55.484336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.623477 (+2139141us) service_pool.cc:224] Handling call
0709 13:00:57.969070 (+345593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.987530  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 233741us
W20260709 13:00:57.992899  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1594) took 2242 ms (client timeout 2204 ms). Trace:
I20260709 13:00:58.002208  4036 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.004247  4036 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.004850  4036 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:57.834986  3810 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:58.007133  3810 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:57.833323  3978 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:58.011525  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 393) took 3573 ms (client timeout 2124 ms). Trace:
I20260709 13:00:58.012284  3897 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.013376  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1583) took 2610 ms (client timeout 2073 ms). Trace:
I20260709 13:00:58.013219  3897 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.013947  3653 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.015091  4049 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:58.016487  4049 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.017062  4049 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.019699  3921 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.020630  3921 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.023658  4043 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:00:58.024683  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.027354  2265 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:58.028311  4036 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.030376  4126 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.030583  4036 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.030913  4126 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:58.031448  4126 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.035005  3905 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:58.035861  3905 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.038970  4073 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.039832  4073 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.040611  4068 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:58.040853  4050 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.042042  4017 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.043197  4034 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:58.044673  4034 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.042258  4068 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.044516  4017 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:58.013837  1622 rpcz_store.cc:269] 0709 13:00:55.402831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.215207 (+812376us) service_pool.cc:224] Handling call
0709 13:00:58.012906 (+1797699us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400232654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.013195 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2541412608}
W20260709 13:00:58.001435  1620 rpcz_store.cc:269] 0709 13:00:55.750298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.546040 (+1795742us) service_pool.cc:224] Handling call
0709 13:00:57.986277 (+440237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11008}
I20260709 13:00:58.045792  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2060) took 1870 ms. Trace:
I20260709 13:00:58.052724  1694 rpcz_store.cc:276] 0709 13:00:56.121546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.743205 (+1621659us) service_pool.cc:224] Handling call
0709 13:00:57.972696 (+229491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.981318 (+  8622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.991632 (+ 10314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.011983  4014 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.058815  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.059235  4014 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.060315  3880 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:58.060881  3880 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:00:58.011976  1613 rpcz_store.cc:269] 0709 13:00:54.438324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.438494 (+   170us) service_pool.cc:224] Handling call
0709 13:00:58.011087 (+3572593us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b540034f8d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.011273 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377445120}
I20260709 13:00:58.063676  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.064584  1613 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:58.064867  4034 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.065688  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.050243  4068 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.066543  4034 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.043758  4073 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.062327  4014 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:58.066593  1613 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:58.067332  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.067973  1617 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.068068  4082 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:00:58.068583  1512 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.560s (SENT)
I20260709 13:00:58.120462  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:58.121999  3947 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.071486  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:58.073349  4068 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.128755  4068 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.127593  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1373) took 2776 ms. Trace:
I20260709 13:00:58.132171  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.133104  1621 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.073273  1614 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:00:58.082141  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.091032  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56426.7us
W20260709 13:00:58.137090  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.091200  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.140528  1620 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.141925  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:58.092806  2263 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.145843  2263 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:58.089021  4017 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:58.130019  1693 rpcz_store.cc:276] 0709 13:00:55.350966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.580837 (+2229871us) service_pool.cc:224] Handling call
0709 13:00:57.709088 (+128251us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:57.742651 (+ 33563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.953283 (+210632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.127208 (+173925us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b54000b4ad0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.127375 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206140032}
I20260709 13:00:58.147966  4017 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:58.149144  4017 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:58.149176  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.095932  2264 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:58.096779  3905 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.096403  3880 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.155097  1692 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:58.154999  3880 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.074496  3653 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:00:58.089449  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.170811  1615 raft_consensus.cc:2410] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:58.171631  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1607) took 2203 ms. Trace:
W20260709 13:00:58.172042  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.075378  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.083153  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.093255  4015 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:00:58.175418  1622 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:58.176357  3886 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.181511  3886 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.182018  3810 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.178886  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1588) took 2675 ms. Trace:
I20260709 13:00:58.183010  1622 rpcz_store.cc:276] 0709 13:00:55.503439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.074781 (+2571342us) service_pool.cc:224] Handling call
0709 13:00:58.178827 (+104046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.184108  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.184615  3810 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.185048  1622 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:00:58.180544  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:58.186791  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.097910  1696 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:58.188485  4075 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.189261  4075 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:58.189522  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 388) took 1975 ms. Trace:
I20260709 13:00:58.104339  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:58.172580  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.176681  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.098345  3992 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.177677  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.087342  4049 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.187419  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:58.187868  2263 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:58.096127  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.172153  1615 rpcz_store.cc:276] 0709 13:00:55.967979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.050997 (+2083018us) service_pool.cc:224] Handling call
0709 13:00:58.171500 (+120503us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.102777  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:58.149616  4017 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:58.082525  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1368) took 2785 ms. Trace:
I20260709 13:00:58.190358  1696 rpcz_store.cc:276] 0709 13:00:56.214054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.754285 (+1540231us) service_pool.cc:224] Handling call
0709 13:00:58.096944 (+342659us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:58.097399 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.188867 (+ 91468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.189351 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13115264}
I20260709 13:00:58.217257  1620 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
W20260709 13:00:58.233865  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.235949  1621 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:58.202576  4075 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:58.239312  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 154305us
W20260709 13:00:58.242105  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.242858  4014 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:58.243681  1622 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:58.244289  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1613) took 1603 ms. Trace:
I20260709 13:00:58.244596  1622 rpcz_store.cc:276] 0709 13:00:56.640714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.186127 (+1545413us) service_pool.cc:224] Handling call
0709 13:00:58.244207 (+ 58080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.246906  1692 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:00:58.248152  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.249009  1692 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:00:58.250056  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.250952  4017 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.252588  4017 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:58.252998  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.253121  2259 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.008s
I20260709 13:00:58.253666  2259 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:00:58.242575  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.247040  4049 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.265779  1694 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:58.238936  3992 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.217648  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:58.082388  3897 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.264524  1613 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:58.084928  3978 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.265532  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:00:58.310743  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.315290  2260 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:00:58.316082  3961 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.316823  3961 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.318498  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.322407  1618 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:58.322468  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 113890us
I20260709 13:00:58.323494  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.324398  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1288) took 1011 ms. Trace:
I20260709 13:00:58.324764  1622 rpcz_store.cc:276] 0709 13:00:57.312641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.323127 (+1010486us) service_pool.cc:224] Handling call
0709 13:00:58.324325 (+  1198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.325954  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.326973  3881 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:58.327476  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:00:58.327685  3881 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.329149  2230 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.329111  3881 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.330430  4027 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.331038  1616 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:58.330924  4027 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.332209  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.333067  1616 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:58.333738  3884 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:58.334028  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.334415  3884 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.335748  3884 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.330747  3961 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:58.327498  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.341693  1621 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.329793  4030 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.332362  4027 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:58.342989  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 155699us
I20260709 13:00:58.226900  1691 rpcz_store.cc:276] 0709 13:00:55.297040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.508445 (+2211405us) service_pool.cc:224] Handling call
0709 13:00:57.511084 (+  2639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.511412 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.511444 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.511891 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.726488 (+214597us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.053774 (+327286us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.081222 (+ 27448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.081406 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.081838 (+   432us) raft_consensus.cc:1685] finished
0709 13:00:58.081855 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.082142 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265485,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":6270,"raft.queue_time_us":289,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":6394,"thread_start_us":187410,"threads_started":2,"wal-append.queue_time_us":229288}
I20260709 13:00:58.320899  4012 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:58.360055  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.375988  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:00:58.376930  4035 consensus_meta.cc:287] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.655s	user 0.011s	sys 0.004s
I20260709 13:00:58.377547  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.377700  3955 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.378584  3955 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.381304  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.381631  3955 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.382160  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1295) took 1009 ms. Trace:
I20260709 13:00:58.382583  1616 rpcz_store.cc:276] 0709 13:00:57.372758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.367418 (+994660us) service_pool.cc:224] Handling call
0709 13:00:58.382096 (+ 14678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.383812  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.377111  1619 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:58.384482  1616 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.385530  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.386418  1619 raft_consensus.cc:2368] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:00:58.386756  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.387955  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.388496  1620 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:58.393440  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.387377  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.397703  1619 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:58.398214  1618 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:58.400966  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 147172us
W20260709 13:00:58.405481  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 82173us
I20260709 13:00:58.414449  1622 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:58.421360  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1605) took 2454 ms. Trace:
I20260709 13:00:58.422211  1622 rpcz_store.cc:276] 0709 13:00:55.967345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.325548 (+2358203us) service_pool.cc:224] Handling call
0709 13:00:58.421295 (+ 95747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.351289  4030 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:00:58.430570  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53169.4us
I20260709 13:00:58.424775  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.329208  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:58.440125  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.368105  4012 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:58.448029  2266 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:58.444464  3955 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.456595  1614 raft_consensus.cc:2410] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:58.457232  1618 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.474341  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:58.474685  1659 leader_election.cc:336] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.648s (SENT)
I20260709 13:00:58.475023  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:58.373764  1692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7316b60a2ea04a109142470c7a827717"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:58.481189  1692 raft_consensus.cc:606] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:58.481909  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.482758  1696 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:58.483381  4126 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:58.489140  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 57670us
I20260709 13:00:58.489378  1692 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:00:58.490651  1618 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:00:58.491380  4014 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:58.492167  1618 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.492372  4014 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:58.492726  4014 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:58.492944  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1581) took 3096 ms. Trace:
I20260709 13:00:58.493311  1618 rpcz_store.cc:276] 0709 13:00:55.396111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.491597 (+3095486us) service_pool.cc:224] Handling call
0709 13:00:58.492010 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.492564 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.492737 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.493752  4014 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.494948  1618 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:00:58.495306  1618 pending_rounds.cc:85] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 2
I20260709 13:00:58.495671  1618 pending_rounds.cc:107] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:00:58.496336  1618 raft_consensus.cc:2889] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.496757  4014 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.435971  4030 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.498297  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:58.406157  4075 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.462011  3955 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.500509  3955 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.501170  4075 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:58.503774  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:58.504987  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.505115  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:58.505802  2264 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:58.497308  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1585) took 3069 ms. Trace:
I20260709 13:00:58.497699  1692 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:00:58.486338  4126 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:58.507038  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:58.506345  4030 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.507835  2266 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:58.508059  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:58.508802  2264 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:58.506829  1692 pending_rounds.cc:85] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 2
I20260709 13:00:58.509636  1692 pending_rounds.cc:107] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:00:58.506489  1618 rpcz_store.cc:276] 0709 13:00:55.427880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.494240 (+3066360us) service_pool.cc:224] Handling call
0709 13:00:58.494578 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.497025 (+  2447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.497234 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.510087  1692 raft_consensus.cc:2889] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.511233  4030 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:58.506306  3810 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:58.514799  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48056.5us
I20260709 13:00:58.515193  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.495613  3992 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:58.524331  1616 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:58.453629  4012 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.514253  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:58.527995  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.530913  1622 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.532228  1617 raft_consensus.cc:2410] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:58.469008  4027 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.535012  1615 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:58.536038  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:58.536664  1615 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:00:58.537592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:58.538136  1615 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.539875  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 399) took 2808 ms. Trace:
I20260709 13:00:58.540446  1614 rpcz_store.cc:276] 0709 13:00:55.731111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.523548 (+2792437us) service_pool.cc:224] Handling call
0709 13:00:58.539119 (+ 15571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.539426 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.539459 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.539519 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.539593 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.539672 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.539802 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.541703  1616 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:58.542428  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1593) took 2808 ms. Trace:
I20260709 13:00:58.533244  3905 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:58.542791  1616 rpcz_store.cc:276] 0709 13:00:55.733913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.525100 (+2791187us) service_pool.cc:224] Handling call
0709 13:00:58.541503 (+ 16403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.542147 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.542367 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.525753  3810 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:58.525986  1660 connection.cc:256] RPC call timeout handler was delayed by -1.2708237119999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:00:58.528466  4035 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:00:58.544507  1616 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.544785  1614 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.545068  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:58.545873  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.560643  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:58.568456  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1596) took 2687 ms. Trace:
I20260709 13:00:58.569172  1614 rpcz_store.cc:276] 0709 13:00:55.881597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.541830 (+2660233us) service_pool.cc:224] Handling call
0709 13:00:58.542287 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.568081 (+ 25794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.568370 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.576251  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48340.7us
W20260709 13:00:58.555119  1660 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39685 timed out after 2.204s (SENT) [suppressed 58 similar messages]
I20260709 13:00:58.578302  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 400) took 2635 ms. Trace:
I20260709 13:00:58.578941  1616 rpcz_store.cc:276] 0709 13:00:55.925236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.543851 (+2618615us) service_pool.cc:224] Handling call
0709 13:00:58.544247 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.558934 (+ 14687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.560022 (+  1088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.581539  3921 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:58.585697  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 734) took 4073 ms (client timeout 1813 ms). Trace:
I20260709 13:00:58.585918  4030 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:58.545784  3992 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:00:58.586225  2258 rpcz_store.cc:269] 0709 13:00:54.390338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.390489 (+   151us) service_pool.cc:224] Handling call
0709 13:00:58.355231 (+3964742us) spinlock_profiling.cc:243] Waited 2.98 s on lock 0x7b54006f0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.463405 (+108174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6852982144}
I20260709 13:00:58.549494  4043 consensus_queue.cc:1059] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:58.548898  4048 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:00:58.588487  4048 consensus_queue.cc:1243] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:00:58.589075  4048 raft_consensus.cc:3055] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:58.546921  3810 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.589421  4048 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.546082  4073 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.549961  3880 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:00:58.583463  2265 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
W20260709 13:00:58.594368  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49485.6us
I20260709 13:00:58.587178  3992 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.604374  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1580) took 3185 ms. Trace:
I20260709 13:00:58.609189  1622 rpcz_store.cc:276] 0709 13:00:55.395759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.474026 (+3078267us) service_pool.cc:224] Handling call
0709 13:00:58.527320 (+ 53294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.580372 (+ 53052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.580619 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.611316  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:58.611562  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56489us
I20260709 13:00:58.622705  1620 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:58.624131  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 408) took 1006 ms. Trace:
I20260709 13:00:58.624507  1620 rpcz_store.cc:276] 0709 13:00:57.617417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.254880 (+637463us) service_pool.cc:224] Handling call
0709 13:00:58.624057 (+369177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.626042  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:58.545910  4075 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.639497  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 45380us
W20260709 13:00:58.641057  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.626852  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48018us
I20260709 13:00:58.592352  4050 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:58.625891  1687 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:58.615084  4036 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.002s
W20260709 13:00:58.651578  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.591948  4073 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:58.658962  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.659695  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.660223  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.667888  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1286) took 1433 ms. Trace:
I20260709 13:00:58.668519  1620 rpcz_store.cc:276] 0709 13:00:57.227073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.632542 (+1405469us) service_pool.cc:224] Handling call
0709 13:00:58.647995 (+ 15453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.655997 (+  8002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.656059 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.659461 (+  3402us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.659554 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.659682 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.660004 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.675470  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1600) took 2731 ms. Trace:
I20260709 13:00:58.676100  1614 rpcz_store.cc:276] 0709 13:00:55.935368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.615384 (+2680016us) service_pool.cc:224] Handling call
0709 13:00:58.645441 (+ 30057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.656465 (+ 11024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.656504 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.666537 (+ 10033us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.666604 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.666706 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.666859 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.646767  4050 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:58.679414  3961 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:00:58.687872  1622 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:00:58.681126  3806 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:58.688577  3806 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.688643  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1287) took 1388 ms. Trace:
I20260709 13:00:58.689175  1622 rpcz_store.cc:276] 0709 13:00:57.300419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.645625 (+1345206us) service_pool.cc:224] Handling call
0709 13:00:58.687575 (+ 41950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.688370 (+   795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.688588 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.689774  3921 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:58.689628  3806 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.690279  3921 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.690761  3921 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:58.691010  3806 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.691946  1622 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:00:58.692166  4015 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:58.692644  4015 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:00:58.692404  1622 pending_rounds.cc:85] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 2
I20260709 13:00:58.693876  1622 pending_rounds.cc:107] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:00:58.695333  1622 raft_consensus.cc:2889] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.696237  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1291) took 1324 ms. Trace:
I20260709 13:00:58.697646  1622 rpcz_store.cc:276] 0709 13:00:57.371521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.690053 (+1318532us) service_pool.cc:224] Handling call
0709 13:00:58.690385 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.695961 (+  5576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.696160 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.704281  1622 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:00:58.684249  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 615835us
I20260709 13:00:58.667981  4075 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.709209  4075 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.705235  4073 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.710474  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1292) took 1338 ms. Trace:
I20260709 13:00:58.714506  1622 rpcz_store.cc:276] 0709 13:00:57.371899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.702185 (+1330286us) service_pool.cc:224] Handling call
0709 13:00:58.704033 (+  1848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.710190 (+  6157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.710410 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.680835  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.686272  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 605) took 1022 ms. Trace:
I20260709 13:00:58.693626  4015 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:58.715445  1613 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:00:58.718690  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55099.2us
W20260709 13:00:58.719805  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54353.2us
W20260709 13:00:58.720113  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.688737  4050 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:58.717435  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 106214us
I20260709 13:00:58.717893  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:58.713785  3886 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:58.721634  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.720268  1621 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:58.730594  1615 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:00:58.590538  4048 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.731413  1616 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:58.678035  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.732424  1618 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.731050  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1296) took 1124 ms. Trace:
I20260709 13:00:58.732921  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1297) took 1125 ms. Trace:
I20260709 13:00:58.733314  1621 rpcz_store.cc:276] 0709 13:00:57.606879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.327132 (+720253us) service_pool.cc:224] Handling call
0709 13:00:58.730992 (+403860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.733451  1622 rpcz_store.cc:276] 0709 13:00:57.607170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.718165 (+1110995us) service_pool.cc:224] Handling call
0709 13:00:58.718538 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.732427 (+ 13889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.732471 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.732532 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.732579 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.732655 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.732851 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.732024  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 52234.1us
I20260709 13:00:58.735806  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.739777  1615 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:58.687873  3992 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:58.736021  1585 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.744602  1614 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:58.745417  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1298) took 1138 ms. Trace:
I20260709 13:00:58.745814  1614 rpcz_store.cc:276] 0709 13:00:57.608051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.720815 (+1112764us) service_pool.cc:224] Handling call
0709 13:00:58.744384 (+ 23569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.745108 (+   724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.745353 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.706228  3947 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:00:58.749679  1621 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:58.748253  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 201) took 20188 ms (client timeout 15000 ms). Trace:
I20260709 13:00:58.736565  3978 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.751945  1614 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:00:58.743058  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.756333  1621 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:58.716532  4036 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:00:58.766075  1692 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:00:58.766916  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.767972  4036 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.768311  4048 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:58.718724  2260 rpcz_store.cc:276] 0709 13:00:57.664534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.787908 (+123374us) service_pool.cc:224] Handling call
0709 13:00:58.296597 (+508689us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.315905 (+ 19308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.686029 (+370124us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003ae150. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.686190 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557626624}
I20260709 13:00:58.754684  3992 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.773396  3992 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.773860  3992 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.766155  4015 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:58.775873  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1603) took 2819 ms. Trace:
I20260709 13:00:58.776297  1616 rpcz_store.cc:276] 0709 13:00:55.956481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.614119 (+2657638us) service_pool.cc:224] Handling call
0709 13:00:58.731166 (+117047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.732000 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.775656 (+ 43656us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b540034f8d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.775795 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149361920}
I20260709 13:00:58.775166  1693 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:00:58.770745  2257 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:00:58.753111  3978 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.768371  4036 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:58.756996  3806 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.785925  1622 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:58.765281  4034 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.679s	user 0.002s	sys 0.012s
I20260709 13:00:58.784125  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:58.789212  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 403) took 1174 ms. Trace:
I20260709 13:00:58.789697  1619 rpcz_store.cc:276] 0709 13:00:57.614367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.736613 (+1122246us) service_pool.cc:224] Handling call
0709 13:00:58.765038 (+ 28425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.788777 (+ 23739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.788804 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.788849 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:58.788901 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.788990 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.789117 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.794445  4036 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.795993  4036 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:58.796164  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.797091  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.798170  3961 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:58.798269  3884 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:58.798702  3961 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.798867  3884 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:58.799818  3961 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.800009  3884 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:58.801916  4131 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:00:58.802836  3881 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:58.799031  1690 raft_consensus.cc:2410] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:58.810881  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55578.8us
I20260709 13:00:58.786126  3978 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.788503  3806 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:58.817363  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 273232us
W20260709 13:00:58.816967  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.791867  4050 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.818344  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:58.821421  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 376419us
W20260709 13:00:58.865093  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.815608  3886 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:58.872157  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:58.823025  3806 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.876561  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:58.866256  4075 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:58.895490  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:58.887699  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:58.876226  3886 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:58.884999  4034 raft_consensus.cc:2764] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:00:58.906824  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.882305  4017 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.892015  4075 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:58.920182  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:58.750808  1442 rpcz_store.cc:269] 0709 13:00:38.513679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.513894 (+   215us) service_pool.cc:224] Handling call
0709 13:00:58.702459 (+20188565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:50.366933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:50.622558 (+255625us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:50.622641 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:00:50.622670 (+    29us) tablet.cc:662] Decoding operations
0709 13:00:50.656278 (+ 33608us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.686674 (+ 30396us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.686717 (+    43us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:00:50.687385 (+   668us) tablet.cc:701] Row locks acquired
0709 13:00:50.687441 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:00:50.694816 (+  7375us) write_op.cc:270] Start()
0709 13:00:50.695671 (+   855us) write_op.cc:276] Timestamp: P: 1783602050687534 usec, L: 0
0709 13:00:50.695715 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.696610 (+   895us) log.cc:844] Serialized 2452 byte log entry
0709 13:00:51.360442 (+663832us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b18002f7b20. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:00:52.176762 (+816320us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:55.112700 (+2935938us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b18002f7b20. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:00:55.113040 (+   340us) op_driver.cc:464] REPLICATION: finished
0709 13:00:55.884239 (+771199us) write_op.cc:301] APPLY: starting
0709 13:00:55.895313 (+ 11074us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:55.931155 (+ 35842us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:55.933548 (+  2393us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:56.111247 (+177699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:56.111531 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:00:56.111595 (+    64us) write_op.cc:312] APPLY: finished
0709 13:00:56.115009 (+  3414us) log.cc:844] Serialized 53 byte log entry
0709 13:00:56.556309 (+441300us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.556463 (+   154us) write_op.cc:454] Released schema lock
0709 13:00:56.556531 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:56.557061 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.557088 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":392663,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":634993,"apply.run_cpu_time_us":28231,"apply.run_wall_time_us":720442,"num_ops":6,"prepare.queue_time_us":97860,"prepare.run_cpu_time_us":26601,"prepare.run_wall_time_us":553967,"raft.queue_time_us":615271,"raft.run_cpu_time_us":39540,"raft.run_wall_time_us":261017,"replication_time_us":4417159,"spinlock_wait_cycles":78521344,"thread_start_us":1431246,"threads_started":5,"wal-append.queue_time_us":854687,"wal-append.run_cpu_time_us":45182,"wal-append.run_wall_time_us":4170942}]]}
I20260709 13:00:58.924340  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 611) took 1226 ms. Trace:
W20260709 13:00:58.922129  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 43915.3us
I20260709 13:00:58.902066  3886 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:58.924748  2263 rpcz_store.cc:276] 0709 13:00:57.698297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.146918 (+448621us) service_pool.cc:224] Handling call
0709 13:00:58.147378 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.220369 (+ 72991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.922581 (+702212us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b540012e654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:58.924283 (+  1702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92387072}
I20260709 13:00:58.913275  4017 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:58.925531  4075 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:58.941017  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1371) took 3603 ms. Trace:
W20260709 13:00:58.950241  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.945883  3806 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:58.967312  4073 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:58.970906  4142 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:58.975967  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 614) took 1276 ms. Trace:
I20260709 13:00:58.939603  4017 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:58.979416  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:58.988333  1695 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:58.982975  4142 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:00:58.953429  1688 rpcz_store.cc:276] 0709 13:00:55.312945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.517693 (+2204748us) service_pool.cc:224] Handling call
0709 13:00:57.726190 (+208497us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:57.726363 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.726724 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.726752 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.727189 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.127603 (+400414us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:58.128509 (+   906us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.156065 (+ 27556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.174004 (+ 17939us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.801198 (+627194us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:58.916031 (+114833us) raft_consensus.cc:1685] finished
0709 13:00:58.916058 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.916233 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":92026,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":12156,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":204,"spinlock_wait_cycles":211024000,"thread_start_us":54475,"threads_started":1,"wal-append.queue_time_us":584066}
I20260709 13:00:58.992063  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 386) took 2784 ms. Trace:
I20260709 13:00:58.992470  1695 rpcz_store.cc:276] 0709 13:00:56.207245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.754280 (+1547035us) service_pool.cc:224] Handling call
0709 13:00:58.839627 (+1085347us) spinlock_profiling.cc:243] Waited 6.55 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:00:58.879084 (+ 39457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.991796 (+112712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.992003 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15059712}
I20260709 13:00:59.017508  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:59.020846  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 100797us
I20260709 13:00:58.945924  4036 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:00:59.023401  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 87212.7us
W20260709 13:00:59.030949  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:58.999868  4142 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:59.036258  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 328568us
I20260709 13:00:59.032451  4030 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:00:59.062146  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 63695.2us
I20260709 13:00:58.988971  2261 rpcz_store.cc:276] 0709 13:00:57.699235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.713451 (+ 14216us) service_pool.cc:224] Handling call
0709 13:00:58.975576 (+1262125us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54006bf154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:58.975774 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395970816}
I20260709 13:00:59.065627  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:00:59.061555  4012 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
W20260709 13:00:59.072114  1512 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.623s (SENT)
I20260709 13:00:59.063709  4049 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.073472  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1385) took 1121 ms. Trace:
I20260709 13:00:59.060883  4036 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.074517  1693 rpcz_store.cc:276] 0709 13:00:57.952541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.152801 (+200260us) service_pool.cc:224] Handling call
0709 13:00:59.072438 (+919637us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b540012cfd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:59.073402 (+   964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127243136}
I20260709 13:00:59.085069  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.084815  4049 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:00:59.103643  1660 leader_election.cc:400] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:00:59.108722  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.073349  4030 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.116627  3992 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.117641  4144 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.118168  4146 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.118746  4146 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.120092  4144 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.119733  4146 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:00:59.104314  4141 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:00:59.123116  3806 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:59.124023  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85025.9us
I20260709 13:00:59.124955  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.126835  4049 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:59.129990  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.130446  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.132640  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.086548  4073 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.155560  4073 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.158021  4073 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.158897  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:00:59.159514  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.134562  4068 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:59.160382  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:59.160585  4068 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:59.161280  4015 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.161656  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.161582  4068 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.162449  4015 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.162890  4068 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.163096  4015 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.136536  4122 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.089174  4014 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:59.164984  4014 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:59.165356  4014 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:00:59.165691  4014 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:59.139091  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 70141.8us
I20260709 13:00:59.145797  3886 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:59.140604  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67653.7us
I20260709 13:00:59.141556  3921 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.074739  4012 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.142505  3992 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.148566  3905 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.152278  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1380) took 1214 ms. Trace:
W20260709 13:00:59.190276  1512 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.624s (SENT)
I20260709 13:00:59.088932  3978 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:59.172951  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 159232us
I20260709 13:00:59.169960  4142 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.187660  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1289) took 1789 ms. Trace:
I20260709 13:00:59.190878  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.196851  4090 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:00:59.197245  1512 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.631s (SENT)
I20260709 13:00:59.197710  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.199105  1620 rpcz_store.cc:276] 0709 13:00:57.316148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.684860 (+1368712us) service_pool.cc:224] Handling call
0709 13:00:58.685310 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.685618 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:59.016491 (+330873us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.105387 (+ 88896us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.105440 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:59.105498 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.105569 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.105695 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25507,"prepare.queue_time_us":385374,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":82,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":390722,"threads_started":2}
I20260709 13:00:59.194855  3892 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:59.190445  1696 rpcz_store.cc:276] 0709 13:00:57.937436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.483376 (+545940us) service_pool.cc:224] Handling call
0709 13:00:58.483710 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.523352 (+ 39642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.523386 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.539005 (+ 15619us) log.cc:844] Serialized 26 byte log entry
0709 13:00:58.830218 (+291213us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:58.830303 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.830459 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.151946 (+321487us) raft_consensus.cc:1685] finished
0709 13:00:59.151982 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.152191 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35999,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":28208,"thread_start_us":290536,"threads_started":1,"wal-append.queue_time_us":526777}
I20260709 13:00:59.204352  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:59.201273  3886 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.203179  3892 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.214730  3947 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.215942  4012 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.215706  3892 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.216516  3978 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:59.216758  3892 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.217648  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.217754  4017 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.202777  4050 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.218993  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.219980  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.220615  3921 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:59.221467  1512 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.641s (SENT)
I20260709 13:00:59.221612  3992 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:59.221983  4036 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.190073  4073 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:59.224112  3905 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:59.224857  4075 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.227226  1587 leader_election.cc:400] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:59.219038  2261 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:59.228331  4015 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.205384  1687 raft_consensus.cc:606] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.261673  1687 raft_consensus.cc:614] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:59.248740  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.198873  4049 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.259852  1587 leader_election.cc:403] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:59.246040  4014 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.263171  2262 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:00:59.263806  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.263607  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:00:59.265707  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 157089us
I20260709 13:00:59.266252  2263 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:59.268162  3921 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
I20260709 13:00:59.255775  4050 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:59.269094  4130 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.678s	user 0.003s	sys 0.000s
I20260709 13:00:59.269616  1693 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:59.270594  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.270932  4050 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.271754  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1374) took 3920 ms. Trace:
I20260709 13:00:59.272266  1620 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:00:59.272368  4015 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.273770  1616 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:59.260119  4030 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.258605  4073 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:00:59.282799  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.284454  1617 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:59.287371  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:59.287813  2261 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:00:59.288203  1619 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:59.272109  1689 rpcz_store.cc:276] 0709 13:00:55.351281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.648945 (+2297664us) service_pool.cc:224] Handling call
0709 13:00:57.649708 (+   763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:57.650371 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.650402 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.662758 (+ 12356us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.953704 (+290946us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:57.983750 (+ 30046us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.039642 (+ 55892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.039807 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.268387 (+1228580us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:00:59.271381 (+  2994us) raft_consensus.cc:1685] finished
0709 13:00:59.271470 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.271592 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73805,"prepare.queue_time_us":264237,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":7109,"raft.queue_time_us":56153,"raft.run_cpu_time_us":599,"raft.run_wall_time_us":6603,"spinlock_wait_cycles":39464704,"thread_start_us":282878,"threads_started":2,"wal-append.queue_time_us":908694}
W20260709 13:00:59.291536  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 70115us
I20260709 13:00:59.292778  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:59.279182  4030 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.294561  4030 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.294991  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1387) took 1338 ms. Trace:
I20260709 13:00:59.295357  1690 rpcz_store.cc:276] 0709 13:00:57.956377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.071102 (+114725us) service_pool.cc:224] Handling call
0709 13:00:59.294776 (+1223674us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b540040e554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:59.294919 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545783168}
I20260709 13:00:59.297299  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1589) took 3787 ms. Trace:
I20260709 13:00:59.297348  2262 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.297844  1618 rpcz_store.cc:276] 0709 13:00:55.508930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.510805 (+3001875us) service_pool.cc:224] Handling call
0709 13:00:58.732255 (+221450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.732848 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.296396 (+563548us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400231250. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:59.296523 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506864896}
I20260709 13:00:59.283396  4073 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.301295  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:59.302918  4068 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.303068  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.303442  4068 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.303596  4142 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.303885  4068 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:59.304868  1512 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.894s (SENT)
I20260709 13:00:59.305284  4014 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.284466  3978 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:00:59.284549  3884 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:00:59.310150  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.585s (SENT)
I20260709 13:00:59.305322  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:59.311053  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.311781  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 84717.3us
I20260709 13:00:59.319607  1585 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.301862  1687 raft_consensus.cc:606] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.321859  1687 raft_consensus.cc:614] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:59.322054  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.323180  4014 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:59.323714  4014 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.324148  4014 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.329887  4049 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.330325  4068 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.331914  4162 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:59.338423  4126 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:59.339612  4166 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:59.340023  4166 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.340905  4166 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.341675  1696 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:59.342227  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 393) took 1777 ms. Trace:
I20260709 13:00:59.340907  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1294) took 1968 ms. Trace:
I20260709 13:00:59.342754  1613 rpcz_store.cc:276] 0709 13:00:57.372471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.303016 (+930545us) service_pool.cc:224] Handling call
0709 13:00:59.340725 (+1037709us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54002a7bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:59.340851 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753986816}
I20260709 13:00:59.341429  3884 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:59.343761  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.344033  3884 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:59.344601  1689 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.345114  3884 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.346267  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.346390  3884 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.347746  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.348398  1696 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.342268  4166 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:59.351644  1695 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:00:59.334481  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:59.352016  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.352835  1692 raft_consensus.cc:2410] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:00:59.353645  1693 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:59.353749  4165 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.353854  4090 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.354596  4090 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.355477  4144 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:59.357064  3947 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:59.357456  3947 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.357486  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.358594  1692 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:59.358433  3947 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.342044  4162 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:59.342659  2257 rpcz_store.cc:276] 0709 13:00:57.564328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.567738 (+  3410us) service_pool.cc:224] Handling call
0709 13:00:58.448317 (+880579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.785356 (+337039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.341312 (+555956us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54006f0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:00:59.342001 (+   689us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54006f0250. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:00:59.342125 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547360000}
W20260709 13:00:59.343899  4164 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.150s	user 0.000s	sys 0.003s
I20260709 13:00:59.362344  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.362669  4017 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.363333  1688 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:59.363658  4075 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.364591  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.365408  1693 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 4.
I20260709 13:00:59.364506  4144 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:59.366528  4144 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:59.367013  4144 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:00:59.368086  4144 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.369640  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.370407  1689 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:59.371651  1690 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:00:59.372124  1690 pending_rounds.cc:85] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 5
I20260709 13:00:59.372408  1690 pending_rounds.cc:107] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:00:59.372687  1690 raft_consensus.cc:2889] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:59.374832  2231 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.504s (SENT)
I20260709 13:00:59.375437  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.376374  4035 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:59.376843  2231 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.564s (SENT)
I20260709 13:00:59.377403  2231 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.380144  4035 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.335454  3892 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:59.398546  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.414892  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.416059  1618 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:59.379547  1444 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.419433  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.419705  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.418298  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.421324  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.421445  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.422991  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.385119  4144 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.425032  1622 raft_consensus.cc:2368] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:59.425179  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.428510  1619 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:59.418754  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.429003  2257 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:00:59.424046  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.426712  1687 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:00:59.427186  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50384us
I20260709 13:00:59.431429  1620 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:59.434374  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.434996  1617 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:00:59.435276  1694 raft_consensus.cc:2376] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6. Re-sending same reply.
I20260709 13:00:59.435936  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:00:59.437040  1691 raft_consensus.cc:2410] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:00:59.438670  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52796.8us
I20260709 13:00:59.440620  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.443503  1614 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:59.440491  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.445370  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.447106  1689 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:00:59.427515  3947 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.411510  4050 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:59.451503  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.452325  1615 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:00:59.454873  1696 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.425369  4142 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.454815  2231 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:59.456216  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.459210  1512 connection.cc:256] RPC call timeout handler was delayed by -1.4497082030000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3154s for a response
I20260709 13:00:59.461196  1615 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.463214  1617 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:00:59.434315  4017 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.468639  1614 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:59.482537  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:00:59.423795  4049 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:00:59.488014  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.486817  3955 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:59.451197  4012 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:00:59.459851  4126 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.469664  4122 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:00:59.484869  4090 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.484645  4027 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.430887  4030 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.496423  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.547662  2257 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:00:59.496542  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:00:59.548473  1695 raft_consensus.cc:606] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:59.548969  1695 raft_consensus.cc:614] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:59.471134  4035 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:59.537707  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:59.554031  1661 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.789s (SENT)
I20260709 13:00:59.497098  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.554561  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.496074  1615 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:59.490386  1444 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 6, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:00:59.510742  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.470907  4036 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.496160  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.497707  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.491405  4142 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:59.498960  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.504801  2263 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:00:59.540791  3886 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:00:59.540580  4050 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:59.501114  2258 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:00:59.498594  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:00:59.565595  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 73368.7us
W20260709 13:00:59.568593  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:59.563989  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 62360.4us
I20260709 13:00:59.492285  4017 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:00:59.487011  4162 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:00:59.501106  4048 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:00:59.560575  4068 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:59.504613  3806 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:00:59.582433  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 83580.1us
I20260709 13:00:59.583551  1444 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:00:59.585850  4014 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:00:59.599431  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.586520  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.586930  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.577157  4036 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.587591  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.588212  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.568077  3881 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.601960  3881 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.574425  3978 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.558171  4073 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.501858  4126 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.554241  4027 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.570557  4165 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:59.615916  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 123207us
I20260709 13:00:59.604329  2261 raft_consensus.cc:2368] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:59.573975  4149 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:59.632478  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.635833   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:59.637151  3881 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:00:59.638414  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.639048  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.639907  1538 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:59.604758  3955 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.642927  1621 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 2. Current term is 3. Ops: []
I20260709 13:00:59.639076  1545 raft_consensus.cc:2376] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:00:59.645130  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.633484  1444 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 7, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.648957  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.649792  1544 raft_consensus.cc:2376] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4. Re-sending same reply.
I20260709 13:00:59.652925  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.653548  2263 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.653437  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:00:59.654340  2262 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:59.662098  4179 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:59.663089  1540 raft_consensus.cc:2410] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:59.664026  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.664513  4150 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:59.664915  4150 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:59.665388  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.666074  1547 raft_consensus.cc:2376] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4. Re-sending same reply.
I20260709 13:00:59.665845  4150 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.668273  4027 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.668161  3955 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.718207  4150 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:59.719798  3955 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.669920  4073 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.671262  4017 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.672277  4126 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.672293  4030 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.674368  4036 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.677264  4097 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:59.721431  4097 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:59.722807  4097 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.680541  4142 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:00:59.680747  4180 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:59.630858  3978 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:00:59.628757  4068 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.727568  2263 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.735231  3978 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.736340  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.737532  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.738153  1540 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.683137  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:59.684234  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.642124  4049 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.684967  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.685484  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.686695  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.687848  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:59.688494  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.689239  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:00:59.696118  4171 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:00:59.638428  4014 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:00:59.700484  1541 raft_consensus.cc:2376] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7. Re-sending same reply.
I20260709 13:00:59.755261  2262 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:00:59.648376  1538 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:59.701462  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.758016  1544 raft_consensus.cc:2410] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:59.707733  1444 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:00:59.714932  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.646188   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:59.652983  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.704s (SENT)
I20260709 13:00:59.739185  1547 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:00:59.724709  4097 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.768363  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:59.768620  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79500.7us
I20260709 13:00:59.770648  1546 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.771710  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.772900  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.760021  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:00:59.764147  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 81166.7us
I20260709 13:00:59.777818  1538 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.778977  1510 leader_election.cc:400] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:00:59.779379  1510 leader_election.cc:403] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:59.781795  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.781797  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.784091  1660 leader_election.cc:400] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:00:59.784499  1660 leader_election.cc:403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:00:59.785962  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.787166  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.787142  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:00:59.786605  1541 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.790434  1542 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:59.791620  1444 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.794826  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.782451  1621 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.795503  1540 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:00:59.796744  2230 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.797384  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.801918  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.803769  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.777277  4142 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:59.806273  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.808502  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.786358  3955 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:00:59.786782  4050 consensus_queue.cc:1243] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:59.811913  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.798175  1538 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:59.814826  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.823613  2263 raft_consensus.cc:2393] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:00:59.821686  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:59.824992  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 172075us
I20260709 13:00:59.825109  1542 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.828080  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.822489  1444 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 4 to 6, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.803454  4144 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.831992  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:00:59.806249  4142 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:59.836277  2231 leader_election.cc:336] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.718s (SENT)
I20260709 13:00:59.836755  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:00:59.838955  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.821228  4162 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:59.842221  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 270088us
I20260709 13:00:59.842496  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.823836  4073 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.841638  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:00:59.843051  1659 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.849133  1541 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.852068  4073 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.854336  4073 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:00:59.839913  1444 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:00:59.857368  1444 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.846724  1545 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.863497  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.864148  1545 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:59.864975  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.865510  1545 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.867221  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.868346  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.869015  1538 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:59.869486  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:59.871063  1541 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:59.871990  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.873989  1541 raft_consensus.cc:2376] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5. Re-sending same reply.
I20260709 13:00:59.877616  1542 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.839061  4142 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.883211  1546 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:59.874027  1539 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.849946  4048 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
W20260709 13:00:59.890823  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49251.4us
I20260709 13:00:59.892529  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:00:59.847175  4162 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.895387  4181 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:59.895087  3886 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:59.896059  4181 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:59.896903  3886 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:59.897429  3886 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.897054  4181 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:00:59.897779  3886 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.894990  4186 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:59.899178  4186 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:00:59.895009  4048 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:59.911942  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.848405  3955 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:59.900810  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 57941us
I20260709 13:00:59.894915  4162 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:59.909399  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.917310  1542 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:00:59.910270  1538 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:00:59.912590  1539 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:59.918606  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.914538  1545 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.913266  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.900049  4186 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:00:59.920020  4068 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.926750  1546 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:00:59.927850  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.928494  1546 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:59.932996  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.933521  2263 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:59.933787  1542 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:00:59.909142  4050 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:59.936296  4050 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:59.936772  4050 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:59.938832  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 102582us
I20260709 13:00:59.939616  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:00:59.940007  2231 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.796s (SENT)
I20260709 13:00:59.940444  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:00:59.940757  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.941557  1538 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:00:59.941924  1613 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:59.942826  3955 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:59.946151  1695 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:59.946310  4036 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:59.946929  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.947300  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:00:59.947744  1545 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:59.947803  1689 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:59.948608  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.951578  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.949892  1539 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:00:59.939101  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:00:59.942427  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:00:59.960104  1547 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:00:59.954133  1622 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:00.047025  1689 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:00:59.968376  1546 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:00:59.966650  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:00:59.955621  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:00.074534  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.009090  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.060827  1545 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:00:59.965937  1544 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:00.001513  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.078950  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:00.079337  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.080045  1544 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:01:00.000047  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 72927.6us
I20260709 13:00:59.983065  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.075414  2262 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:01:00.061668  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:00.082945  1542 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:00.077634  1695 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:01:00.064114  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.080974  1540 raft_consensus.cc:2376] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8. Re-sending same reply.
I20260709 13:01:00.046396  4182 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:00.092837  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.093508  1544 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:00.084760  1538 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:01:00.085283  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 118760us
I20260709 13:01:00.050431  4189 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.104341  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.088886  1539 raft_consensus.cc:2376] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4. Re-sending same reply.
I20260709 13:01:00.084175  1546 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:00.078434  4027 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:00.113361  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.113580  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:00.120488  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.121254  1585 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:00.127112  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.129022  1540 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:00.094489  3961 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.086258  4073 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:00.092128  4182 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:00.133383  1544 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:01:00.095077  4017 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:00.134464  1546 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:01:00.136641  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 643225us
W20260709 13:01:00.131507  2231 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.185s (SENT)
I20260709 13:01:00.086781  3978 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:00.138432  3961 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.120852  4027 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:00.124002  4014 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.103649  4149 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:00.142527  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.138958  1547 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:00.143930  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.130307  4015 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:00.124313  4144 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
I20260709 13:01:00.143038  1542 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:00.156606  1541 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:00.156685  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.157752  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.159878  1621 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:00.138435  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:00.176393  1540 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:00.141490  3961 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:00.171747  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.181947  1547 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.138608  4177 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:00.182952  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.177886  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:00.129009  4142 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.193517  1542 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:00.193358  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.197227  1621 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:00.194761  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.920s (SENT)
I20260709 13:01:00.198372  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:00.111106  4189 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.177701  4049 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.206024  3961 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.203498  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.206467  3961 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.206883  3961 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.199061  3978 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:00.205762  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:00.207669  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 78798.8us
I20260709 13:01:00.209270  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:00.210886  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.211660  1547 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:00.212644  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.213459  1621 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:00.214264  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.206470  4049 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.217512  4049 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:00.217747  2262 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
I20260709 13:01:00.139498  4181 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:00.219652  4181 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.220290  4181 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:00.230163  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.230203  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.264740  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.232198  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.294426  1614 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:00.242775  1546 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:00.240125  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.231182  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:00.188318  4177 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:00.233219  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:00.252367  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.300508  1617 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 3: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:00.232726  1541 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:00.300935  1620 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:00.218070  4049 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.251308  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:00.306038  1547 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.262184  3955 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:01:00.285758  1545 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:00.174202  4014 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:00.296250  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65199.4us
W20260709 13:01:00.260912  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.273422  4166 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:01:00.142712  4073 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.243829  4182 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.313100  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.326026  4182 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.326956  4177 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.328385  4177 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.315068  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:00.315299  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.331574  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:00.290854  4017 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:00.268100  4027 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.319257  4189 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:00.319950  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.320463  4036 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:00.321585  3961 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.327422  4181 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:00.313737  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.301411  4185 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.301980  4097 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:00.329836  1613 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 2.
I20260709 13:01:00.338054  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:00.335512  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:00.344564  1689 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:00.344993  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:00.350800  1694 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.345031  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:00.290647  4162 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.345662  1542 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:00.354418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.328388  4142 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:00.357007  1621 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:00.358548  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:00.333473  4196 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.361194  1690 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:00.365180  1687 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:00.334218  4073 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:00.378952  4090 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:00.379181  4017 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.380463  4162 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:00.380220  4196 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.383005  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.383626  1690 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:00.384474  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.385838  1690 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:00.388019  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.388523  2262 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:00.388757  1542 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:00.390894  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.391603  1540 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:00.392952  4203 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.351029  4050 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:00.393986  4197 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:01:00.349090  4150 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:00.395179  1585 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:00.393491  4203 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.414072  1696 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 3.
W20260709 13:01:00.429607  2231 leader_election.cc:336] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.234s (SENT)
I20260709 13:01:00.367085  4097 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:00.431197  4199 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:00.431803  4199 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:00.431587  4097 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.369127  4181 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:00.456501  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.457916  1614 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:00.433785  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.459933  1547 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:00.461890  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:00.471328  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 81130.6us
I20260709 13:01:00.407176  4150 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.448455  3886 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.544s	user 0.004s	sys 0.008s
I20260709 13:01:00.362206  4185 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.508114  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:00.455302  4162 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.510360  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.431828  4014 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:00.455799  4196 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:00.513443  3886 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.554513  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.557370  1694 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:00.558791  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 203657us
I20260709 13:01:00.461640  4073 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:00.457263  4181 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.562131  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 227916us
I20260709 13:01:00.576380  4036 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:00.576860  4166 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:00.577667  4036 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:00.578176  4036 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:00.579830  4036 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:00.575311  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 116097us
I20260709 13:01:00.581710  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.584957  1546 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:00.588019  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:00.589360  1540 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.544466  4204 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.591044  1661 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.073s (SENT)
I20260709 13:01:00.508914  4150 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:00.513619  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:00.582106  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.594820  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.599859  1546 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:00.559657  4017 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.601557  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:00.608457  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.583950  4181 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:00.622882  1661 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.103s (SENT)
I20260709 13:01:00.624246  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:00.631691  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 122538us
I20260709 13:01:00.634104  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:00.634793  1622 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:00.634997  1694 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:00.629591  1693 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:00.574401  3955 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:01:00.573565  4162 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.584167  4073 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.556552  4199 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:00.600162  4204 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.608925  4166 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:00.905126  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.878130  1543 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
W20260709 13:01:00.762190  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.605916  4050 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:00.690531  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52849.7us
I20260709 13:01:00.640517  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:00.864647  4193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.002s	sys 0.009s
I20260709 13:01:00.687507  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:00.765270  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:00.904927  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 282298us
W20260709 13:01:00.916987  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 315700us
I20260709 13:01:00.673367  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:00.912709  1622 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
W20260709 13:01:00.880810  4191 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.682s	user 0.005s	sys 0.000s
W20260709 13:01:00.648587  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.906252  4195 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.767s	user 0.001s	sys 0.009s
I20260709 13:01:00.932749  1694 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:00.628280  4068 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:00.933673  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:00.638187  4036 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:00.939268  2263 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:01:00.904244  4185 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:00.990185  1693 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:00.919598  4166 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:01.019388  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:00.762943  4210 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:01:00.665678  3961 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:00.666047  4202 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:00.926574  4015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.014s	sys 0.010s
I20260709 13:01:00.950409  1546 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:00.951326  1696 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:00.954317  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:00.666385  4014 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.613031  4017 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:00.956427  3886 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:00.956696  1661 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.156s (SENT)
W20260709 13:01:00.957165  4209 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:01:00.959374  4214 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.076938  4214 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:00.965293  4177 consensus_meta.cc:287] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
I20260709 13:01:00.965515  4204 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:00.966773  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 430) took 1195 ms. Trace:
W20260709 13:01:00.936843  4193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.007s	sys 0.009s
W20260709 13:01:00.968818  4182 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260709 13:01:00.979651  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.113329  1542 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:00.982800  4162 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:00.992449  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.002388  1614 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:01:01.116864  1614 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
W20260709 13:01:00.759068  4198 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
I20260709 13:01:00.642068  4203 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:00.800019  4211 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.021982  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:01.027374  1540 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:01:01.036108  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80938.8us
I20260709 13:01:01.125110  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.048511  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:01.049176  4073 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.049520  4142 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:01.050042  1688 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:01.027210  4166 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:01.050734  4015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.015s	sys 0.010s
W20260709 13:01:01.152354  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 130492us
I20260709 13:01:01.089036  1616 rpcz_store.cc:276] 0709 13:00:59.771338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.771504 (+   166us) service_pool.cc:224] Handling call
0709 13:00:59.794192 (+ 22688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:59.803698 (+  9506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.803729 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:59.821144 (+ 17415us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.962383 (+141239us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.962445 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.962542 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.879928 (+917386us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:00.966465 (+ 86537us) raft_consensus.cc:1685] finished
0709 13:01:00.966485 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.966697 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4508,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6831,"spinlock_wait_cycles":27135360,"thread_start_us":124266,"threads_started":1,"wal-append.queue_time_us":296917}
W20260709 13:01:01.118605  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 269498us
I20260709 13:01:01.119087  1692 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:01.122480  2231 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.710s (SENT)
I20260709 13:01:01.129573  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.124179  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.154882  1542 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:01:01.078491  4014 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.125945  4203 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:01.156030  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.156967  1618 raft_consensus.cc:2410] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:01:01.128192  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 171554us
I20260709 13:01:01.132354  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:01.159058  1540 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.156486  4203 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.127568  1538 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 13:01:01.163671  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:01.121943  4217 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:01.168855  2230 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:01.170423  1619 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:01.171602  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:01.170688  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 48247.8us
I20260709 13:01:01.167675  1688 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.197463  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.198469  1618 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
W20260709 13:01:01.201996  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.132970  4142 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.058920  4202 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.223495  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 345) took 1401 ms. Trace:
I20260709 13:01:01.223945  1545 rpcz_store.cc:276] 0709 13:00:59.822648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.105324 (+282676us) service_pool.cc:224] Handling call
0709 13:01:00.177084 (+ 71760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.310806 (+133722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.223255 (+912449us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b5400107550. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:01.223403 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96764800}
I20260709 13:01:01.226089  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:01.227221  2259 raft_consensus.cc:2393] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:01:01.228428  1661 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.204s (SENT)
W20260709 13:01:01.229724  1661 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.245s (SENT)
I20260709 13:01:01.206427  4144 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.162191  3961 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:01.231845  4215 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:01.232379  3961 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:01.152855  4015 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:01.130462  4211 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.236137  4015 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.240442  1616 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:01.245589  4027 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.246449  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 414) took 1301 ms. Trace:
I20260709 13:01:01.247555  1691 rpcz_store.cc:276] 0709 13:00:59.945414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.950723 (+  5309us) service_pool.cc:224] Handling call
0709 13:00:59.951072 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.047890 (+ 96818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.047950 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.079915 (+ 31965us) log.cc:844] Serialized 52 byte log entry
0709 13:01:00.145684 (+ 65769us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:00.161793 (+ 16109us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.174534 (+ 12741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.174602 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.245754 (+1071152us) raft_consensus.cc:1685] finished
0709 13:01:01.245815 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.246278 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98420,"prepare.queue_time_us":15919,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":124493,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":18380,"thread_start_us":25084,"threads_started":1,"wal-append.queue_time_us":252887}
W20260709 13:01:01.217200  4181 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.000s
W20260709 13:01:01.219893  4150 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
W20260709 13:01:01.444587  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 343) took 1724 ms (client timeout 1892 ms). Trace:
I20260709 13:01:01.233870  3961 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.216331  1688 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
W20260709 13:01:01.259020  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.570s (SENT)
W20260709 13:01:01.230360  1661 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.500s (SENT)
I20260709 13:01:01.451283  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.451507  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:01.451737  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 221405us
I20260709 13:01:01.451983  1620 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:01.452162  1614 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:01.263197  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:01.453154  1696 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:01.453994  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 329031us
W20260709 13:01:01.273382  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5557655619999764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3033s for a response
W20260709 13:01:01.448683  1543 rpcz_store.cc:269] 0709 13:00:59.716704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.782832 (+ 66128us) service_pool.cc:224] Handling call
0709 13:01:01.303046 (+1520214us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400256f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:01.441409 (+138363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2469427072}
I20260709 13:01:01.274326  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:01.456751  1619 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:01.274562  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:01.457518  1687 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:01.275295  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.284277  4202 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.253459  4142 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.205228  4217 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:01.315485  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.336673  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 133680us
W20260709 13:01:01.410106  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 249886us
I20260709 13:01:01.465103  1696 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:01.252316  4162 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:01.439138  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1628) took 1210 ms. Trace:
I20260709 13:01:01.469013  1621 rpcz_store.cc:276] 0709 13:01:00.229106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.232951 (+  3845us) service_pool.cc:224] Handling call
0709 13:01:01.307296 (+1074345us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b5400116f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:01.439080 (+131784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130239744}
I20260709 13:01:01.440704  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 416) took 1095 ms. Trace:
I20260709 13:01:01.469992  1692 rpcz_store.cc:276] 0709 13:01:00.344902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.345061 (+   159us) service_pool.cc:224] Handling call
0709 13:01:00.345364 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.153992 (+808628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.306977 (+152985us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54001f5ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:01.440652 (+133675us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778716416}
W20260709 13:01:01.441080  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.442766  1540 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:01.221186  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:01.472020  1690 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.451535  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.459872  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.473048  1688 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:01.470147  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.473085  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:01.474049  2262 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:01:01.441906  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.475571  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.476644  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.478966  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.479651  1696 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:01.482146  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.480290  4221 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:01.499753  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1683) took 1161 ms. Trace:
I20260709 13:01:01.499938  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.500505  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:01.501281  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.501621  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:01.501785  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.502239  1696 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 3: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:01.502389  1687 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:01.504913  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.505422  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.505678  1619 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 3.
I20260709 13:01:01.500226  1547 rpcz_store.cc:276] 0709 13:01:00.338712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.962743 (+624031us) service_pool.cc:224] Handling call
0709 13:01:00.963074 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.963321 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:00.963635 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.446282 (+482647us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.499217 (+ 52935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.499270 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:01.499317 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.499391 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.499635 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":361,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":4481,"thread_start_us":318254,"threads_started":2,"wal-append.queue_time_us":515174}
I20260709 13:01:01.509160  1688 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:01.510079  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.510654  1688 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:01:01.527400  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.528147  1615 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:01.529645  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.530432  1620 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:01.537451  1511 leader_election.cc:400] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5.
W20260709 13:01:01.538765  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68747.7us
I20260709 13:01:01.506048  1692 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:01.540973  3886 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.467788  4211 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.448014  4181 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:01.547065  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64973.4us
I20260709 13:01:01.543347  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:01.548045  1687 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:01.483822  4202 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.549981  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:01.550635  1621 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.455199  4150 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:01.554934  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75902.7us
I20260709 13:01:01.555896  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:01.557889  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.559036  1619 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:01.511588  4199 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.581736  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.579821  4211 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.583248  4211 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:01.595340  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 336543us
I20260709 13:01:01.499428  4221 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.551414  4050 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.599450  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:01.550709  4202 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:01.599157  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60708.8us
I20260709 13:01:01.555008  3886 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:01.602249  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.607120  4017 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.607175  1621 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:01.591857  4204 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.618793  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.590893  4243 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.599874  4234 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.621656  1695 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
W20260709 13:01:01.630069  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 74278us
I20260709 13:01:01.624429  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.601998  4202 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.611327  4048 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.617693  4182 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.630605  2258 raft_consensus.cc:2368] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:01:01.653968  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:01.660290  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 64168.1us
W20260709 13:01:01.655862  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56931.7us
W20260709 13:01:01.669471  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70079.2us
I20260709 13:01:01.619302  3886 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.676743  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:01.678406  4228 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 13:01:01.652917  4027 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:01.652944  4177 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:01.678544  4238 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:01.652699  4162 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:01.682439  4017 raft_consensus.cc:2764] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:01.685170  4211 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.685767  4240 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.686282  4240 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.686688  4240 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:01.688825  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.678686  4150 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.667654  4204 raft_consensus.cc:2764] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:01:01.678791  4181 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.694072  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:01.710640  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:01.711032  2262 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:01.689785  1659 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:01.705257  4162 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.706125  3886 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.712373  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.722884  2257 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:01.721774  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:01.721755  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:01.656343  4182 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:01.730067  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48261.9us
I20260709 13:01:01.725893  4049 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.679617  4239 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:01.715433  4211 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.673491  4234 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:01:01.731453  4049 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.731398  4226 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:01.737998  4014 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.721071  4242 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:01.739248  4214 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.739373  4217 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.739593  4221 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.727969  3886 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:01.741266  4182 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:01.722934  4204 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:01.729598  4166 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:01:01.743204  4203 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.727084  4142 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.744395  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.745029  4027 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:01.748750  4240 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.753854  1690 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:01:01.755558  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 131212us
I20260709 13:01:01.763247  4239 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:01.762421  4049 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.778492  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:01.764458  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 163597us
I20260709 13:01:01.781232  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.765317  4036 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:01.793351  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.800150  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.774439  3886 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.774379  4204 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.805581  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.789131  4221 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.804319  4203 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:01.811581  4204 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.795526  4214 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.816871  4014 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:01.832545  4214 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.803828  4027 consensus_queue.cc:1243] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:01.814226  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.833750  4211 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:01.834683  4211 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:01.835034  4211 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:01.835932  4211 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.836238  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.837298  4211 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.820865  4203 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.838233  4223 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.839108  4223 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:01.839309  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.840183  1547 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:01.840350  4223 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.841859  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.842543  1547 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:01.844259  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.816395   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.845459  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.824146  4239 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:01.846220  1540 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:01.846988  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:01.847549  4239 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:01.848057  4239 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:01.849242  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.848969  4239 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.849829  1616 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:01.850250  4239 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.847589  1543 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:01.825524  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.851527  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:01.852058  1621 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:01.852185  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.853127  4247 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.853339  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:01.853871  4247 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.788230  4166 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.769482  4242 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:01.826416  4250 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:01.828574  4255 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:01.819399  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1689) took 1086 ms. Trace:
I20260709 13:01:01.830981  4245 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.831777  4142 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.767940  4226 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.832808  4014 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:01.837572  4017 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:01.838471  4203 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.826761  4252 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
W20260709 13:01:01.829893  4241 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:01:01.827950  4236 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:01:01.827090  4199 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:01.854415  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.901125  4213 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.907279  4017 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:01.907644  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 761) took 1399 ms. Trace:
I20260709 13:01:01.907512  4213 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.908087  2258 rpcz_store.cc:276] 0709 13:01:00.508091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.512115 (+  4024us) service_pool.cc:224] Handling call
0709 13:01:01.907416 (+1395301us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400634cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:01.907576 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2297404800}
I20260709 13:01:01.908370  4017 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.909968  4213 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.910100  4253 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:01.906858  4232 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.316s	user 0.005s	sys 0.000s
I20260709 13:01:01.910595  4253 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:01.879626  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.859527  1661 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 3.117s (SENT)
I20260709 13:01:01.807883  4217 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:01.844389  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:01.933569  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.870812  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:01.963387  1619 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.963526  1547 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:01.919063  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:01.964561  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 45638.8us
I20260709 13:01:01.804095  4185 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:01.855736  1689 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:01.855037  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2065) took 1556 ms (client timeout 1827 ms). Trace:
I20260709 13:01:01.884439  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:01.966890  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:01.915271  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 71105.8us
I20260709 13:01:01.809060  3886 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:01.971020  1695 rpcz_store.cc:269] 0709 13:01:00.298602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.298872 (+   270us) service_pool.cc:224] Handling call
0709 13:01:01.854817 (+1555945us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540012d4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:01.854949 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2980548864}
I20260709 13:01:01.971415  1618 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:01.965286  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:01.977804  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 118280us
I20260709 13:01:01.972182  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.962543  1539 rpcz_store.cc:276] 0709 13:01:00.733246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.733468 (+   222us) service_pool.cc:224] Handling call
0709 13:01:00.763074 (+ 29606us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:00.763475 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:00.763508 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:00.920064 (+156556us) log.cc:844] Serialized 52 byte log entry
0709 13:01:01.129006 (+208942us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.163624 (+ 34618us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.454416 (+290792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.454484 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.819078 (+364594us) raft_consensus.cc:1685] finished
0709 13:01:01.819107 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.819329 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39314,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":292093,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":9073,"thread_start_us":459270,"threads_started":2,"wal-append.queue_time_us":769798}
I20260709 13:01:01.935647  1621 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:01.855141  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:01.915522  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61185.6us
W20260709 13:01:01.990947  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 191006us
I20260709 13:01:01.991935  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.987015  4234 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:01.993113  4234 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.993491  4234 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:01.993561  4204 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:01.988201  4050 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:01.996141  3884 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:01.996428  4204 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:01.996590  3884 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.996979  3884 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:01.866820  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:01.997596  2259 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:01.999804  1615 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:02.002027  4214 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:02.002161  4226 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:01.854837  4221 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:02.002672  4214 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:02.003279  4214 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:01.893486  4182 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:02.005632  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:01.854529  4247 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.008833  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.011436  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:01.858249  4240 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:01.963845  4255 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.975281  4213 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:02.018481  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:02.019172  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.019858  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:02.017776  4255 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.989944  4217 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:02.036264  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.021653  4186 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.010562  4050 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:02.008750  4182 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:02.039762  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47073.6us
I20260709 13:01:02.015462  4027 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:02.018153  4213 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:02.046675  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.047394  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 385170us
I20260709 13:01:02.047672  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:02.037983  4068 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.035624  4177 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.042562  4050 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.073172  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:02.073751  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54709.9us
I20260709 13:01:02.073850  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2082) took 1147 ms. Trace:
I20260709 13:01:02.075249  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:02.120525  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45356.8us
I20260709 13:01:02.120056  1694 rpcz_store.cc:276] 0709 13:01:00.926596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.951687 (+ 25091us) service_pool.cc:224] Handling call
0709 13:01:01.036583 (+ 84896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.080284 (+ 43701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.080330 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.122164 (+ 41834us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.448233 (+326069us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:01.448272 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.448335 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:02.068388 (+620053us) raft_consensus.cc:1685] finished
0709 13:01:02.068407 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:02.073789 (+  5382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8235,"raft.queue_time_us":47450,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4460,"thread_start_us":281183,"threads_started":1,"wal-append.queue_time_us":500054}
I20260709 13:01:02.121457  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.038786  4240 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.078027  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.046182  4027 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.074399  4204 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:01.911515  4253 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.049042  4213 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:01.861003  4202 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.082849  4226 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:02.122490  1695 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:02.025462  4181 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:02.128985  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.142645  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.132400  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.133853  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.143529  1546 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:01:02.135561  1539 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:01:02.136587  4142 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.136875  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:02.144639  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68548.2us
I20260709 13:01:02.145183  1544 raft_consensus.cc:2410] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:02.137468  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.133091  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.145951  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.135411  4225 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:02.142925  1696 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:02.146660  1547 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:02.128903  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.134964  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.138788  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.123171  4050 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.148753  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:02.148064  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:02.149535  1696 raft_consensus.cc:2376] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5. Re-sending same reply.
I20260709 13:01:02.136940  4239 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.146546  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:02.131443  4027 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.163673  1585 leader_election.cc:400] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
I20260709 13:01:02.163990  1585 leader_election.cc:403] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:02.164793  1690 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:02.123616  4068 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:02.144611  1539 pending_rounds.cc:85] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 3
I20260709 13:01:02.165297  1539 pending_rounds.cc:107] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:01:02.165553  1539 raft_consensus.cc:2889] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.151940  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.159260  1613 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:02.131222  4204 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.160300  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.168268  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.162489  4239 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:02.163942  1620 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:02.082870  4234 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.151852  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.176406  4214 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:02.176775  4263 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:01:02.149816  4225 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.146404  4181 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.048134  4014 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.167279  1613 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.173427  1688 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:02.178427  1696 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:02.158224  4252 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:02.186528  1587 leader_election.cc:336] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.827s (SENT)
I20260709 13:01:02.202040  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.181401  4225 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.172204  4253 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.207537  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:02.171205  4204 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.168099  4185 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.174291  4268 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.151877  4142 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.235241  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.181839  4181 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.211797  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:02.259425  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.224401  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:02.208897  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.297039  1696 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:02.140897  4182 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.276376  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:02.201314  4233 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.322726  1694 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:02.321658  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:02.321579  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 105558us
I20260709 13:01:02.323264  1619 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:01:02.323335  1696 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:02.327085  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 205700us
W20260709 13:01:02.217641  4243 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.579s	user 0.003s	sys 0.007s
W20260709 13:01:02.334749  2231 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.852s (SENT)
I20260709 13:01:02.337842  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:02.214380  3978 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.342366  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.342893  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:02.347319  1688 raft_consensus.cc:2376] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8. Re-sending same reply.
I20260709 13:01:02.215287  4017 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.276393  2261 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:02.349210  2231 leader_election.cc:336] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.959s (SENT)
I20260709 13:01:02.149259  4217 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.208416  4267 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:02.339519  4049 consensus_meta.cc:287] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:01:02.389544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:02.392998  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50719.1us
I20260709 13:01:02.328316  4199 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4.
W20260709 13:01:02.398844  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49677us
I20260709 13:01:02.399066  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.406379  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:02.413414  1694 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:02.414322  1696 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:02.342391  4097 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.417416  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.424902  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.348902  4243 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:02.343411  4166 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:02.322454  4177 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:01:02.428231  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.428478  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.440800  1539 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:02.432229  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:02.432428  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 50050.1us
I20260709 13:01:02.441754  1543 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:02.439338  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.441942  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.443768  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.212946  4252 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.339407  3886 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.352499  4185 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:01:02.418886  4242 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:02.432171  4239 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.380774  3978 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.449832  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:02.328783  4268 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.438218  4240 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.468004  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.416639  4049 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:02.481474  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 278189us
I20260709 13:01:02.454984  4166 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:02.483079  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70176.3us
I20260709 13:01:02.339219  4233 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.406869  4068 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.454545  4202 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:02.407536  4267 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:02.481691  4257 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:01:02.469331  4211 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.001s
I20260709 13:01:02.488648  1585 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.498606  4272 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:02.499116  4267 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:02.499301  4216 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.499773  4216 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:02.501053  4269 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:01:02.501965  4216 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:02.506757  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.482730  4271 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:02.507995  4252 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:02.508332  4266 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:01:02.511006  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:02.513247  2259 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.001s
I20260709 13:01:02.513628  2259 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:02.514810  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.515753  4268 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:02.516170  4142 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.500674  4270 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:01:02.518004  3978 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:02.499485  4272 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.498835  4202 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:02.540602  1542 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:02.541796  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.542472  1542 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
W20260709 13:01:02.549494  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 150493us
I20260709 13:01:02.556743  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.557755  1542 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:02.558883  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.559885  1542 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:01:02.560829  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.561455  1542 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.572381  4282 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:02.572620  4017 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.573133  4017 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:02.573559  4017 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.573784  4272 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.506795  2260 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:02.577133  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62374.6us
I20260709 13:01:02.582942  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:02.590656  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:02.607766  4233 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.595317  4014 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:02.610261  4287 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:02.612908  4049 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.625406  4282 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:02.626819  4282 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:02.628355  4282 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.631489  4285 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:02.633672  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.642076  4234 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:02.645191  4264 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.508s	user 0.001s	sys 0.000s
I20260709 13:01:02.655969  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 417) took 2300 ms. Trace:
I20260709 13:01:02.671535  1689 rpcz_store.cc:276] 0709 13:01:00.355804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:00.355971 (+   167us) service_pool.cc:224] Handling call
0709 13:01:01.855234 (+1499263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:01.970711 (+115477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:02.655718 (+685007us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540012d4d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:02.655871 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3428051328}
I20260709 13:01:02.656839  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:02.657712  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.673877  1544 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:02.658517  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.674686  1547 raft_consensus.cc:2376] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
I20260709 13:01:02.675554  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.676076  1547 raft_consensus.cc:2376] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
W20260709 13:01:02.676362  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 194109us
I20260709 13:01:02.676875  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.677587  1547 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:02.678361  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.659618  1541 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:01:02.679842  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.680269  1541 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5. Re-sending same reply.
W20260709 13:01:02.676888  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 86337.6us
I20260709 13:01:02.662025  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:02.683488  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:02.685768  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.692360  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:02.694118  1613 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:02.610038  4289 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:02.663436  4262 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.487s	user 0.003s	sys 0.000s
I20260709 13:01:02.697175  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.697980  1544 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:02.694993  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.698767  1541 raft_consensus.cc:2376] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
I20260709 13:01:02.686722  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:02.658583  4255 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.000s
I20260709 13:01:02.653381  4202 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:02.701349  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:02.646473  1542 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:02.702003  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:02.705071  1622 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:02.706252  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:02.709810  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:02.685114  4073 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.690975  4162 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:02.715410  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:02.715512  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 164174us
I20260709 13:01:02.722694  1547 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:01:02.633733  4285 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:01:02.726177  2261 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:02.726733  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 637) took 1034 ms. Trace:
I20260709 13:01:02.727555  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.726486  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:02.728142  1544 raft_consensus.cc:2376] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
I20260709 13:01:02.728356  1542 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:02.727255  2261 rpcz_store.cc:276] 0709 13:01:01.691944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.703209 (+ 11265us) service_pool.cc:224] Handling call
0709 13:01:02.207376 (+504167us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:01:02.726680 (+519304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7321984}
I20260709 13:01:02.725457  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:02.708527  4202 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:02.730412  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:02.732314  1613 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:02.665108  4204 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.708411  4267 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:02.737668  4267 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:02.738796  4295 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.738557  4267 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.740695  4017 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.711812  4255 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.743002  4014 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:02.743453  4027 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 13:01:02.743927  4027 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.744786  4255 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.745954  1692 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:02.748345  1619 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:02.751777  1622 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:01:02.753026  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:02.730741  1547 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5. Re-sending same reply.
I20260709 13:01:02.731349  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:02.724534  4073 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:02.736658  4288 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.736944  4275 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:02.767899  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:02.726454  4162 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.767658  3886 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:02.787388  4204 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:02.767542  4073 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:02.713594  4289 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.794232  1540 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:02.725795  4247 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:02.794667  4202 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:02.737746  4203 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.729s	user 0.010s	sys 0.002s
I20260709 13:01:02.776855  1618 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:02.745965  4027 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:02.844501  4277 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:01:02.847395  1613 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:02.767614  4288 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.846737  4203 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:01:02.872706  3884 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.875s	user 0.015s	sys 0.001s
I20260709 13:01:03.017385  3884 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:02.777779  4275 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.795946  4162 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:02.873203  4245 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.000s	sys 0.029s
I20260709 13:01:02.881295  4073 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:02.886745  3886 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.023782  4275 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.054780  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.854646  4050 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260709 13:01:03.197122  2262 raft_consensus.cc:2368] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
W20260709 13:01:03.085536  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.900242  4288 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.201906  4186 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.159s	user 0.006s	sys 0.005s
W20260709 13:01:03.207517  4213 consensus_meta.cc:287] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.047s	user 0.007s	sys 0.003s
W20260709 13:01:03.228649  4245 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.004s	sys 0.053s
I20260709 13:01:03.245198  4253 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.268560  4186 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.272642  4150 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:03.399215  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 667955us
I20260709 13:01:03.399323  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.401547  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:03.402928  1620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.026s	sys 0.070s
W20260709 13:01:03.402827  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 666256us
W20260709 13:01:03.403309  1620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.026s	sys 0.070s
I20260709 13:01:03.403654  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:03.403540  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.404417  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.404757  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:03.405026  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.399323  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:03.409258  1544 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:03.274408  4213 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.340951  4253 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.418109  1613 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.249585  4050 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.420614  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.390040  4150 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.426983  4150 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.429242  1613 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:03.430603  4213 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.442596  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.406416  4017 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:03.443840  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.405995  4027 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:03.406566  3886 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:03.449121  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.417145  4289 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:03.435509  4225 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.228s	user 0.010s	sys 0.001s
W20260709 13:01:03.417482  4234 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.017s	sys 0.012s
I20260709 13:01:03.458498  1693 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
I20260709 13:01:03.399392  4202 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.473536  4234 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.017s	sys 0.012s
I20260709 13:01:03.484057  3884 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.482892  4203 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.493645  4186 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:03.456920  4027 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.465440  3886 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.472005  4225 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.482592  4213 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:03.491582  4300 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:03.511440  4073 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.509964  4017 raft_consensus.cc:2764] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:03.508507  4304 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:03.517442  4144 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:03.531529  4181 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.190s	user 0.012s	sys 0.002s
I20260709 13:01:03.527233  4300 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:03.551311  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:03.546337  4304 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:03.547072  4300 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.543403  4144 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.578567  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:03.579417  2261 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:03.582142  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:03.583642  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 134620us
I20260709 13:01:03.585099  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:03.585682  2261 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.586740  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 491935us
I20260709 13:01:03.589476  4203 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:03.589988  4203 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.596480  2261 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:03.599139  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:03.568506  4253 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.545790  4181 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.614880  4225 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.616632  4181 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:03.599411  4204 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:03.617475  4204 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.602872  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.605757  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:03.606506  4303 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:01:03.607151  4301 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:03.607589  4304 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.582443  4213 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.620502  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.643360  2257 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:03.602561  4186 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:03.648633  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 247162us
I20260709 13:01:03.626555  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:03.645015  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:03.655046  1620 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:01:03.625236  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 220542us
I20260709 13:01:03.656426  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:03.671833  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:03.673808  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:03.674937  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:03.675714  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:03.676954  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:03.677665  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:03.681655  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 82725.6us
I20260709 13:01:03.681026  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.622896  4253 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:03.637277  4036 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:01:03.668442  4186 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:03.671079  4050 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:03.673015  4315 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.697091  1620 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:03.673309  4225 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:03.668473  4314 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.699860  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:03.679526  4017 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.681291  4282 raft_consensus.cc:2764] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:03.705269  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.647974  4213 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.693836  4027 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.701225  4313 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:03.708756  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.709458  1613 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 4: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:03.709288  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:03.712903  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 128449us
I20260709 13:01:03.729751  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.718314  4315 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.734894  4324 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:03.721709  4282 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:03.714277  3886 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.737342  4282 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.737887  4282 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:03.740285  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 764) took 1529 ms (client timeout 1815 ms). Trace:
W20260709 13:01:03.740860  2262 rpcz_store.cc:269] 0709 13:01:02.211293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.211454 (+   161us) service_pool.cc:224] Handling call
0709 13:01:03.740016 (+1528562us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54006aead4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:03.740206 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100990720}
I20260709 13:01:03.742776  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1328) took 1051 ms. Trace:
I20260709 13:01:03.718765  4316 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:03.743732  4316 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:03.743362  1618 rpcz_store.cc:276] 0709 13:01:02.691820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.692043 (+   223us) service_pool.cc:224] Handling call
0709 13:01:03.742524 (+1050481us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b54002cae54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:03.742694 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126443776}
I20260709 13:01:03.744345  4316 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:03.745018  4295 consensus_meta.cc:287] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.006s	user 0.009s	sys 0.002s
I20260709 13:01:03.745445  4295 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.746163  1622 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:03.746709  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.730803  4313 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:03.716938  4309 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:03.748776  4319 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:03.749013  4313 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.749970  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1648) took 1064 ms. Trace:
I20260709 13:01:03.750171  4144 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.750747  4144 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.735170  4186 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.751353  4144 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.710780  4314 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:03.716099  4321 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.711031  4311 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.717051  4017 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:03.763636  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1336) took 1060 ms. Trace:
I20260709 13:01:03.764081  1616 rpcz_store.cc:276] 0709 13:01:02.702829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.412769 (+709940us) service_pool.cc:224] Handling call
0709 13:01:03.417914 (+  5145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.676406 (+258492us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:03.676538 (+   132us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.677285 (+   747us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.729726 (+ 52441us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.729761 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.729826 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.763401 (+ 33575us) raft_consensus.cc:1685] finished
0709 13:01:03.763422 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.763578 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104026,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5005,"thread_start_us":285535,"threads_started":2,"wal-append.queue_time_us":76130}
I20260709 13:01:03.750352  1617 rpcz_store.cc:276] 0709 13:01:02.685255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.685369 (+   114us) service_pool.cc:224] Handling call
0709 13:01:02.708660 (+ 23291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.402324 (+693664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.402444 (+   120us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.424130 (+ 21686us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.598985 (+174855us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:03.599038 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.599502 (+   464us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.749753 (+150251us) raft_consensus.cc:1685] finished
0709 13:01:03.749771 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.749915 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15424,"raft.queue_time_us":28229,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":577604,"threads_started":2,"wal-append.queue_time_us":184286}
I20260709 13:01:03.761647  4321 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.763306  4213 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:03.764322  4017 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.773895  4321 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.775401  4316 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.776611  1618 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:03.777168  4275 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:01:03.777686  4316 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.777596  4275 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.778507  4325 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.778580  4321 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.779088  4325 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.779203  4321 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.743654  4203 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.712123  4225 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.753315  4314 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:03.784946  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 101686us
I20260709 13:01:03.786732  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:03.792027  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62365.1us
I20260709 13:01:03.787482  1616 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:03.794998  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.795996  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.797370  1616 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:03.799860  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.782451  4234 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:03.801911  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.803386  4283 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:03.804435  4322 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:03.811264  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:03.812937  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 135287us
I20260709 13:01:03.829161  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.815940  4234 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.820948  4321 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.832084  2257 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:03.832165  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:03.842973  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:03.831483  1616 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:03.807663  1511 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:39685 timed out after 1.602s (SENT) [suppressed 50 similar messages]
I20260709 13:01:03.769652  4311 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.825729  4325 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:03.858126  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.867180  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56112.9us
I20260709 13:01:03.869859  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:03.859813  4073 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:03.860186  4309 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:03.831545  4322 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.868491  4186 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:03.879987  1587 connection.cc:256] RPC call timeout handler was delayed by -1.161255342000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:01:03.875254  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.888146  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:03.871061  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.840569  4234 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:03.892795  3886 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.828979  4327 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:03.893767  3886 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:03.894531  4327 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.896871  4327 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.898918  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:03.899586  2257 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:03.902098  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.902699  1661 connection.cc:256] RPC call timeout handler was delayed by -1.5343169479999688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:03.881772  4027 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:03.910841  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.861508  4329 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.882489  4162 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.004s
W20260709 13:01:03.915949  4254 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.955s	user 0.017s	sys 0.023s
I20260709 13:01:03.920802  4309 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:03.922683  4275 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:03.875964  4144 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.868333  4225 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.928519  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:03.928558  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.931660  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.909173  4322 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:03.925269  4017 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.914810  4073 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:03.936817  4324 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.942690  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.947203  4324 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.948055  4309 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.948505  1689 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:01:03.949831  4324 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:03.940132  4288 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.672s	user 0.013s	sys 0.000s
I20260709 13:01:03.935199  4327 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.950773  1688 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:03.950941  4288 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.951149  4327 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:03.932561  4162 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.953154  4288 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.953226  4327 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.953871  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 425) took 2682 ms. Trace:
I20260709 13:01:03.954697  4162 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:03.955673  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:03.956473  1690 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:03.957319  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:03.928292  4313 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:03.932396  4329 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:03.960991  4329 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:03.967193  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:03.954221  1691 rpcz_store.cc:276] 0709 13:01:01.271203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.536737 (+265534us) service_pool.cc:224] Handling call
0709 13:01:01.557211 (+ 20474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:01.582050 (+ 24839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:01.582080 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:01.601356 (+ 19276us) log.cc:844] Serialized 26 byte log entry
0709 13:01:01.676733 (+ 75377us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:01.676774 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.676846 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:03.915372 (+2238526us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:03.946797 (+ 31425us) raft_consensus.cc:1685] finished
0709 13:01:03.946817 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:03.947089 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2744,"raft.queue_time_us":29342,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5756,"spinlock_wait_cycles":9273728,"thread_start_us":38769,"threads_started":1,"wal-append.queue_time_us":142271}
W20260709 13:01:04.034555  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.935529  4027 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:03.939446  4221 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:04.044766  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 237237us
I20260709 13:01:04.048372  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:04.053198  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:04.055751  4324 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:04.056170  4324 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.056449  4311 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.056533  4324 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.057627  4073 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:04.042138  4291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.237s	user 0.009s	sys 0.057s
W20260709 13:01:04.058848  4291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.009s	sys 0.058s
W20260709 13:01:04.061208  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 117852us
I20260709 13:01:04.061636  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.057618  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.063549  1621 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:04.065304  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.042254  4313 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.068143  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:04.068965  1587 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.534s (SENT)
W20260709 13:01:04.054457  4333 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:04.069150  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1330) took 1376 ms. Trace:
I20260709 13:01:04.069437  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:03.940550  4234 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.075173  1619 rpcz_store.cc:276] 0709 13:01:02.692527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.693113 (+   586us) service_pool.cc:224] Handling call
0709 13:01:02.693371 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.748753 (+ 55382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.068934 (+1320181us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b5400160dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:04.069096 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126004480}
I20260709 13:01:04.063944  4327 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.094689  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.094645  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.096146  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.096319  1621 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:04.096772  1538 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:03.945842  4017 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.099057  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.099603  1544 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.103358  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.105127  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:03.959240  4300 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.052999  4027 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.091506  4338 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.076635  4144 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:04.108037  4325 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.111799  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.109932  4311 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:01:04.114099  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.114538  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.114686  1547 raft_consensus.cc:2376] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7. Re-sending same reply.
I20260709 13:01:04.115839  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.116201  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.116778  1540 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.118997  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.119252  1545 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:04.120100  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.120406  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.121097  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.122008  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.122635  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.122797  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.125157  4202 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.125558  4202 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:04.125919  4202 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.126806  4177 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:04.121402  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.131939  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.132660  1545 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.134145  4291 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.133987  4202 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.092780  4327 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:04.141767  4322 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:04.142249  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.143210  4291 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.146992  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.148176  4017 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.148321  4291 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.135469  4256 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.143787  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 767) took 1920 ms. Trace:
I20260709 13:01:04.156641  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.145676  4282 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.146193  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 448) took 2276 ms. Trace:
I20260709 13:01:04.170205  1614 rpcz_store.cc:276] 0709 13:01:01.869622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.898422 (+ 28800us) service_pool.cc:224] Handling call
0709 13:01:01.900668 (+  2246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.738582 (+1837914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.738642 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:03.738689 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:03.738728 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.145881 (+407153us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54002c7ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:04.145939 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.146090 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4226690944}
I20260709 13:01:04.149551  1543 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.149911  1541 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:04.172780  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.175055  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:04.174873  4247 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:01:04.184947  4247 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.185461  4247 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:04.186507  4247 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.188066  4247 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.122114  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.191817  1546 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:04.192853  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.193492  1546 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.195561  1695 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:04.196250  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:04.197000  1621 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:04.197796  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.198469  1621 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:04.154922  2260 rpcz_store.cc:276] 0709 13:01:02.223417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.223567 (+   150us) service_pool.cc:224] Handling call
0709 13:01:02.223962 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.581549 (+357587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.143502 (+1561953us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54005055d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:04.143723 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606867200}
I20260709 13:01:04.203915  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.206571  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:04.208089  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:04.208855  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2097) took 2077 ms (client timeout 1534 ms). Trace:
W20260709 13:01:04.209286  1693 rpcz_store.cc:269] 0709 13:01:02.131921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.132062 (+   141us) service_pool.cc:224] Handling call
0709 13:01:04.208619 (+2076557us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540012cfd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:04.208758 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3016257920}
I20260709 13:01:04.209653  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:04.211189  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1335) took 1510 ms. Trace:
I20260709 13:01:04.211566  1622 rpcz_store.cc:276] 0709 13:01:02.700804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.400457 (+699653us) service_pool.cc:224] Handling call
0709 13:01:04.211028 (+810571us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400341cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:04.211125 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":739617152}
I20260709 13:01:04.213055  1622 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:04.217535  1544 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:04.164786  4311 consensus_queue.cc:1243] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:04.166126  4322 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:04.146212  4327 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.166318  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:04.223304  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57091.4us
I20260709 13:01:04.225550  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:04.167471  4323 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:04.227147  4323 consensus_queue.cc:1243] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:04.228477  4211 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:04.228754  1694 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.228933  4211 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.164476  4331 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.176826  1690 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:04.177754  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.229900  4296 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.230340  4296 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:04.222560  4326 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:04.231042  4326 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:04.231069  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.231134  4296 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.231971  1687 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:04.232295  4296 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.232023  4326 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.232956  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.233388  4326 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.233510  1687 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:01:04.178838  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.236826  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:04.237082  3886 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:04.237653  3886 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.179342  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1635) took 2742 ms. Trace:
I20260709 13:01:04.238788  1615 rpcz_store.cc:276] 0709 13:01:01.436724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:01.545870 (+109146us) service_pool.cc:224] Handling call
0709 13:01:01.999620 (+453750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:02.000264 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.179027 (+2178763us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000f96d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:04.179164 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042739456}
I20260709 13:01:04.239328  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:04.239820  3886 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.240064  1541 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:04.240422  3886 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.240556  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:04.241416  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.241691  4166 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:04.242573  4323 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.176520  4177 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.200433  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:04.201085  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.203979  4282 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.205353  1619 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:04.205471  4341 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 13:01:04.211859  1621 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:04.220088  4274 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.997s	user 0.008s	sys 0.017s
I20260709 13:01:04.153369  1540 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:04.148976  4256 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:04.226303  4311 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:04.229382  4211 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:04.178270  4186 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.239493  4281 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.242015  1541 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.234448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.163997  4275 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:04.175832  4325 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.244771  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:04.331421  1613 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:04.246708  4027 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.246801  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.332726  1690 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.247511  4166 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:04.169574  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.337007  1538 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:04.247582  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:04.338997  1620 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:04.248384  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:04.340462  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 92165.4us
I20260709 13:01:04.282328  4177 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.341410  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.248764  4182 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.181906  4315 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.242241  4308 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.210491  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.199628  4283 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.254699  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.256758  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:04.159929  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54870us
W20260709 13:01:04.258399  4280 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.520s	user 0.004s	sys 0.022s
I20260709 13:01:04.260648  1539 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:04.379696  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.380461  1539 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:04.381524  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.382197  1539 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:01:04.078894  2231 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.730s (SENT)
I20260709 13:01:04.272871  1545 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:01:04.383178  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 304311us
I20260709 13:01:04.383688  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.384580  1545 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:04.276557  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.277637  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:04.277856  1614 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 4: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:04.287179  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.259573  4300 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.289500  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:04.276330  4314 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.282639  4144 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.281734  4203 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.305966  1546 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:04.360379  4027 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:04.278048  4323 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.288161  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:04.288956  4311 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.328131  4186 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.367391  1690 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:04.334784  4204 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.371675  1541 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:04.336748  4166 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:04.374745  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.386142  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.463804  1539 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:04.387742  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:04.464491  1538 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.343551  4287 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.415529  1540 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:04.330699  1687 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 3.
I20260709 13:01:04.335153  4275 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.431011  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.805510  1545 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:04.431660  1542 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:04.337263  4325 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.811448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.811985  4234 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:04.802960  4339 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.433s	user 0.009s	sys 0.000s
I20260709 13:01:04.812668  4325 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.443254  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.813903  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.444741  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:04.418231  4267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.677s	user 0.020s	sys 0.020s
I20260709 13:01:04.442093  4311 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:04.452883  4300 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.437239  4203 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.446921  4027 raft_consensus.cc:697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:04.458783  1692 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:01:04.473645  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.824761  1692 pending_rounds.cc:85] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 7
I20260709 13:01:04.825114  1692 pending_rounds.cc:107] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:04.825400  1692 raft_consensus.cc:2889] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:04.825754  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.447564  4283 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:04.498188  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 113639us
W20260709 13:01:04.770367  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 395844us
W20260709 13:01:04.832612  2231 connection.cc:256] RPC call timeout handler was delayed by -1.3778541600000267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2298s for a response
W20260709 13:01:04.833105  2231 connection.cc:256] RPC call timeout handler was delayed by -1.2994395069999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 13:01:04.833799  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:04.835528  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:04.434325  4314 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.514694  4221 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:04.417183  4256 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.437623  4144 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:04.725437  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 436048us
I20260709 13:01:04.527215  4202 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:04.773403  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.775424  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.823961  4356 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.779603  4344 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.335s	user 0.005s	sys 0.004s
I20260709 13:01:04.780403  1538 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:04.781876  4211 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.781445  4166 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.782790  4036 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:04.783582  4340 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.354s	user 0.000s	sys 0.009s
I20260709 13:01:04.783893  4177 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:04.784426  4280 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.342s	user 0.003s	sys 0.009s
W20260709 13:01:04.788049  4347 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.261s	user 0.002s	sys 0.010s
I20260709 13:01:04.791178  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:04.796366  4247 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.608s	user 0.015s	sys 0.008s
I20260709 13:01:04.855506  4036 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:04.857372  4027 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.862035  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:04.862305  4211 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:04.862792  2258 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:04.797919  4323 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:04.798749  4342 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.283s	user 0.005s	sys 0.007s
W20260709 13:01:04.800884  4327 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.009s
I20260709 13:01:04.865567  4327 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:04.771588  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:04.808391  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:04.814538  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:04.815644  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:04.814904  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1342) took 1026 ms. Trace:
W20260709 13:01:04.816915  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 372270us
I20260709 13:01:04.818594  1540 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:04.811504  4324 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.754s	user 0.020s	sys 0.000s
I20260709 13:01:04.771581  1691 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:04.817922  4267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.076s	user 0.020s	sys 0.021s
I20260709 13:01:04.813534  4275 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:04.831311  1542 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.813683  4235 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.818248  4325 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:04.839560  1545 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:01:04.830938  4326 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.010s
W20260709 13:01:04.849268  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.839478  4315 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:04.839157  4234 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.862124  4036 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.849225  4346 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.853972  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:04.854763  1616 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:04.857870  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:04.826475  4300 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:04.860198  1694 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:04.859333  4233 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:01:04.796664  4296 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.010s
I20260709 13:01:05.200657  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.202608  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2181) took 1083 ms. Trace:
I20260709 13:01:05.203198  1545 rpcz_store.cc:276] 0709 13:01:04.119270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.823079 (+703809us) service_pool.cc:224] Handling call
0709 13:01:04.839237 (+ 16158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.201940 (+362703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.202538 (+   598us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:05.204470  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.205556  1690 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:05.206838  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 392375us
I20260709 13:01:04.866969  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.209339  1617 rpcz_store.cc:276] 0709 13:01:03.788361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.788506 (+   145us) service_pool.cc:224] Handling call
0709 13:01:03.819004 (+ 30498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.826424 (+  7420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.826473 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.829618 (+  3145us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.090506 (+260888us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:04.090544 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.090607 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.814697 (+724090us) raft_consensus.cc:1685] finished
0709 13:01:04.814718 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.814844 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6700,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":2003,"thread_start_us":210111,"threads_started":1,"wal-append.queue_time_us":490422}
I20260709 13:01:05.210906  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2177) took 1092 ms. Trace:
W20260709 13:01:04.998937  1546 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.019s
W20260709 13:01:05.212656  1546 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.003s	sys 0.024s
W20260709 13:01:05.238317  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.198997  1695 raft_consensus.cc:2376] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
W20260709 13:01:05.244278  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 390444us
I20260709 13:01:05.211699  1540 rpcz_store.cc:276] 0709 13:01:04.118367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.818033 (+699666us) service_pool.cc:224] Handling call
0709 13:01:04.818364 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.210669 (+392305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.210855 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.249635  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2179) took 1130 ms. Trace:
I20260709 13:01:05.244217  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2106) took 1008 ms. Trace:
I20260709 13:01:05.250679  1695 rpcz_store.cc:276] 0709 13:01:04.235384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.771327 (+535943us) service_pool.cc:224] Handling call
0709 13:01:05.244155 (+472828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:04.849864  4283 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:05.251428  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.259189  1690 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:05.260967  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.335021  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2112) took 1098 ms. Trace:
I20260709 13:01:05.335454  1690 rpcz_store.cc:276] 0709 13:01:04.236965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.815395 (+578430us) service_pool.cc:224] Handling call
0709 13:01:05.334938 (+519543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.261816  4287 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:05.261848  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.251173  4216 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:05.176616  4308 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:01:04.850526  4356 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.243767  4177 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:05.007824  4073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.010s	sys 0.014s
I20260709 13:01:05.270263  1544 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:05.270975  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.359040  1695 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.859395  4256 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:05.036629  4048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.019s	sys 0.050s
I20260709 13:01:05.121905  4225 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.323158  1694 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:05.366099  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2125) took 1123 ms. Trace:
I20260709 13:01:05.273254  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1411) took 1320 ms. Trace:
I20260709 13:01:05.328684  4253 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.324126  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.366602  1689 rpcz_store.cc:276] 0709 13:01:03.953055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.962774 (+  9719us) service_pool.cc:224] Handling call
0709 13:01:04.061705 (+ 98931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.062118 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.062147 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.062518 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.765270 (+702752us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:05.272356 (+507086us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.272776 (+   420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.272887 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.272950 (+    63us) raft_consensus.cc:1685] finished
0709 13:01:05.272970 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.273166 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75932,"prepare.queue_time_us":109443,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":48708,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":19159,"spinlock_wait_cycles":46080,"thread_start_us":866508,"threads_started":2,"wal-append.queue_time_us":724193}
I20260709 13:01:05.366462  1694 rpcz_store.cc:276] 0709 13:01:04.242456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.769544 (+527088us) service_pool.cc:224] Handling call
0709 13:01:05.366040 (+596496us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:05.292868  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 92305.9us
I20260709 13:01:05.346307  4181 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.302071  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.250169  1542 rpcz_store.cc:276] 0709 13:01:04.118821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.817751 (+698930us) service_pool.cc:224] Handling call
0709 13:01:04.831146 (+ 13395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.249324 (+418178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.249567 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:04.865790  4144 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.244480  4315 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.949357  4221 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:04.932559  4166 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:04.949556  4281 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:05.335553  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 74653.7us
I20260709 13:01:05.261673  4233 consensus_queue.cc:1243] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:01:05.395622  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.336869  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.397189  1690 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:05.398216  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1430) took 1336 ms. Trace:
I20260709 13:01:05.126304  4314 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:05.262133  4326 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.343348  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.046s
I20260709 13:01:05.039573  4322 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:05.351773  4289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.018s	sys 0.022s
I20260709 13:01:05.269161  4275 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.281997  4036 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.251804  4235 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.321003  4316 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.415074  4316 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.416567  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.417235  1542 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:05.417659  4316 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.418154  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:05.289150  1539 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:05.372473  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:05.418916  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1712) took 1304 ms. Trace:
I20260709 13:01:05.419317  1543 rpcz_store.cc:276] 0709 13:01:04.115060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.122393 (+  7333us) service_pool.cc:224] Handling call
0709 13:01:05.418766 (+1296373us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b54002dda54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:05.418867 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60620672}
I20260709 13:01:05.346488  4287 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.420306  4287 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.420540  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:05.423672  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1714) took 1308 ms. Trace:
I20260709 13:01:05.423928  4186 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:05.424074  1547 rpcz_store.cc:276] 0709 13:01:04.115661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.150748 (+ 35087us) service_pool.cc:224] Handling call
0709 13:01:05.423502 (+1272754us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54000852d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:05.423613 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342795648}
I20260709 13:01:05.425451  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.426112  4369 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.418478  4316 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.426862  4369 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.427356  4316 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.429533  4316 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.381078  4315 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.253441  4324 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:05.364604  4073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.014s	sys 0.018s
W20260709 13:01:05.367940  4048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.019s	sys 0.052s
I20260709 13:01:05.389801  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.467635  1689 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:05.468156  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2110) took 1231 ms. Trace:
I20260709 13:01:05.468231  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1720) took 1351 ms. Trace:
I20260709 13:01:05.468521  1689 rpcz_store.cc:276] 0709 13:01:04.236462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.374326 (+1137864us) service_pool.cc:224] Handling call
0709 13:01:05.468100 (+ 93774us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:05.399540  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.014s	sys 0.046s
W20260709 13:01:05.470016  2231 connection.cc:256] RPC call timeout handler was delayed by -1.2193395070000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:01:05.470461  2231 connection.cc:256] RPC call timeout handler was delayed by -1.01503950700004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
I20260709 13:01:05.471655  2231 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.391378  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.398794  1690 rpcz_store.cc:276] 0709 13:01:04.061572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.336520 (+1274948us) service_pool.cc:224] Handling call
0709 13:01:05.398080 (+ 61560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.473021  1615 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.473310  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.473955  1690 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:05.474387  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2118) took 1235 ms. Trace:
W20260709 13:01:05.272646  4323 consensus_queue.cc:1175] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:01:05.252384  4346 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.366441  4177 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:05.408766  4289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.019s	sys 0.022s
I20260709 13:01:05.415596  4300 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.418823  1542 raft_consensus.cc:2376] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
I20260709 13:01:05.429595  4369 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.400622  4283 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.408286  4326 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.435386  4314 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.436267  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 436) took 2002 ms. Trace:
I20260709 13:01:05.435861  4322 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.411388  4353 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.373780  1545 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:05.369189  1510 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:05.370704  4253 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.437557  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.376420  4181 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.374608  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.410259  1614 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:05.474800  1690 rpcz_store.cc:276] 0709 13:01:04.238474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.473076 (+1234602us) service_pool.cc:224] Handling call
0709 13:01:05.474336 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.411360  4275 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.408876  4027 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.475512  4321 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.476253  4296 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:05.374186  4225 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.480363  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.398348  4221 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.410120  4281 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.588886  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.621706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.623665  1613 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:05.623917  1690 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.574569  1615 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:05.621793  1694 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:05.624713  1692 rpcz_store.cc:276] 0709 13:01:03.434272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.434429 (+   157us) service_pool.cc:224] Handling call
0709 13:01:03.434729 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.825954 (+1391225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.436025 (+610071us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000b31d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:05.436209 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2354389760}
W20260709 13:01:05.623713  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 186250us
I20260709 13:01:05.626456  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.626639  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.489605  1543 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:05.587527  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:05.623139  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 254057us
W20260709 13:01:05.625409  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1416) took 1670 ms (client timeout 2222 ms). Trace:
I20260709 13:01:05.621986  1689 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:05.535073  1585 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.815s (SENT)
I20260709 13:01:05.631525  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.630227  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:05.630297  1694 rpcz_store.cc:269] 0709 13:01:03.954591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.374333 (+1419742us) service_pool.cc:224] Handling call
0709 13:01:05.625357 (+251024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.633150  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:05.612473  4311 consensus_meta.cc:287] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.002s
I20260709 13:01:05.636032  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1423) took 1582 ms. Trace:
I20260709 13:01:05.481731  4356 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:05.588586  4048 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:05.620391  4275 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.586699  4216 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:05.639905  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 104916us
I20260709 13:01:05.638458  1689 rpcz_store.cc:276] 0709 13:01:04.053905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.469651 (+1415746us) service_pool.cc:224] Handling call
0709 13:01:05.635974 (+166323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.640914  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:05.612341  4308 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.627668  4346 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.645234  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.671625  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.649740  1690 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:05.675338  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:05.677747  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.652999  1695 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:05.682459  1542 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.682860  1620 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:05.683328  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2111) took 1446 ms. Trace:
I20260709 13:01:05.645694  4300 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.676424  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.631619  4211 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.629218  4253 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.629323  4181 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:05.679940  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 420916us
I20260709 13:01:05.702261  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1721) took 1584 ms. Trace:
I20260709 13:01:05.702708  1541 rpcz_store.cc:276] 0709 13:01:04.117531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.446675 (+329144us) service_pool.cc:224] Handling call
0709 13:01:04.447017 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:04.447359 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:04.447386 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.809714 (+362328us) log.cc:844] Serialized 26 byte log entry
0709 13:01:05.279618 (+469904us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:05.279677 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.279778 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.702041 (+422263us) raft_consensus.cc:1685] finished
0709 13:01:05.702062 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.702193 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13328,"raft.run_cpu_time_us":11695,"raft.run_wall_time_us":306830,"thread_start_us":444454,"threads_started":1,"wal-append.queue_time_us":768780}
I20260709 13:01:05.704593  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.705399  1541 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:05.684945  1617 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:05.682941  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1418) took 1727 ms (client timeout 2164 ms). Trace:
W20260709 13:01:05.706720  1695 rpcz_store.cc:269] 0709 13:01:03.955195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.270690 (+1315495us) service_pool.cc:224] Handling call
0709 13:01:05.682887 (+412197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.707213  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.707582  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.708943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:05.631045  4017 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:05.687455  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.712546  1689 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:05.712992  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2113) took 1475 ms. Trace:
I20260709 13:01:05.684759  4300 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.690663  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1427) took 1635 ms. Trace:
I20260709 13:01:05.718214  1694 rpcz_store.cc:276] 0709 13:01:04.055102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.637074 (+1581972us) service_pool.cc:224] Handling call
0709 13:01:05.690566 (+ 53492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.630295  4027 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.713447  1689 rpcz_store.cc:276] 0709 13:01:04.237234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.687102 (+1449868us) service_pool.cc:224] Handling call
0709 13:01:05.712922 (+ 25820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.688862  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.635762  4296 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.714250  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.647274  4369 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.633800  4314 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.688813  4364 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.677423  4372 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.716874  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.717300  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.740899  1622 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.684196  1690 rpcz_store.cc:276] 0709 13:01:04.236715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.621438 (+1384723us) service_pool.cc:224] Handling call
0709 13:01:05.683274 (+ 61836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.742204  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.742939  1690 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:05.691347  4211 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:05.723671  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.702760  4375 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:05.709209  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1426) took 1654 ms. Trace:
I20260709 13:01:05.747354  1695 rpcz_store.cc:276] 0709 13:01:04.054819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.707381 (+1652562us) service_pool.cc:224] Handling call
0709 13:01:05.709155 (+  1774us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.748473  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.749141  1695 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.750818  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.735899  1541 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:05.752534  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.753273  1541 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:05.644843  4311 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:05.743098  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.635924  4353 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.675508  4048 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.712832  4324 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.745609  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.737381  4316 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:05.721254  4300 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.755764  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:05.755898  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 264017us
I20260709 13:01:05.784862  1695 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:05.719415  4233 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.689293  4287 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:05.791472  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 1.43127e+06us
I20260709 13:01:05.761437  4211 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.719655  4017 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:05.719797  4177 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.796424  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:05.796869  1692 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:05.797317  1615 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:05.771157  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.771360  1617 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:05.773028  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 90345.2us
I20260709 13:01:05.774986  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1422) took 1721 ms. Trace:
I20260709 13:01:05.798856  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.798995  1689 rpcz_store.cc:276] 0709 13:01:04.053504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.721941 (+1668437us) service_pool.cc:224] Handling call
0709 13:01:05.774927 (+ 52986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.776932  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.766173  4369 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.783214  1542 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:05.785462  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 444) took 1679 ms. Trace:
I20260709 13:01:05.688119  4308 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.788426  1622 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:05.754441  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.792719  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.745262  4372 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:05.759076  4325 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.808768  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.814402  4225 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.815128  4225 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:05.815598  4225 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:05.816490  4225 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.819253  4376 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:05.784945  4352 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:05.819012  4017 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.806318  1541 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:05.828946  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.829972  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.830600  1541 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:05.831799  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.826875  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.831893  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.803908  1695 rpcz_store.cc:276] 0709 13:01:04.106282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.748182 (+1641900us) service_pool.cc:224] Handling call
0709 13:01:05.785403 (+ 37221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.834357  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.835577  1695 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:05.842404  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:05.844272  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:05.846016  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.846913  1692 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:05.849035  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.850715  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.851465  1695 raft_consensus.cc:2410] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:05.805202  4369 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.851950  4369 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.779893  4364 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:01:05.807560  4324 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:05.855162  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1428) took 1799 ms. Trace:
I20260709 13:01:05.861277  1695 rpcz_store.cc:276] 0709 13:01:04.055397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.850458 (+1795061us) service_pool.cc:224] Handling call
0709 13:01:05.855111 (+  4653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.821954  4325 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.862882  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.863507  1695 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.870064  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.870736  1694 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:01:05.872519  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 121883us
I20260709 13:01:05.873988  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:05.821035  4372 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.827796  4239 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:05.775031  4216 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.858901  4186 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:05.853358  4326 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.853199  4036 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:05.850260  3886 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.848042  4374 raft_consensus.cc:2764] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:05.858422  4356 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.799629  4233 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.866902  4324 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.871165  4325 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.896966  4073 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:05.899505  4221 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.902550  4322 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.903591  4027 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.905632  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1723) took 1787 ms. Trace:
I20260709 13:01:05.922039  1539 rpcz_store.cc:276] 0709 13:01:04.118125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.514867 (+396742us) service_pool.cc:224] Handling call
0709 13:01:04.768748 (+253881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.418956 (+650208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.905423 (+486467us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54002e0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:05.905578 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196293888}
I20260709 13:01:05.923622  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.924389  1539 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:05.867300  4377 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:05.907401  1541 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:05.909330  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.936180  1620 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:05.909258  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 213600us
I20260709 13:01:05.937383  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:05.913990  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 118432us
I20260709 13:01:05.940583  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.941183  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:05.915589  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.931581  3886 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.942754  4382 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:01:05.945847  4382 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:05.946103  4233 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.946177  4382 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.946791  4382 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.953356  4203 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.911336  4281 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.954937  4281 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:05.955305  4281 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:05.955178  4177 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.955999  4353 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.956183  3886 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.956722  3886 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.959266  4177 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:05.959647  4177 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:05.960407  4177 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.961472  4177 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:05.962242  4166 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260709 13:01:05.956187  4281 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.963879  4281 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.964274  4308 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.965255  4287 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.911265  4356 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:05.965935  4356 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:05.965703  4315 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:05.968235  4315 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.944520  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.969413  1694 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:05.970315  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:05.971169  1694 raft_consensus.cc:2376] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5. Re-sending same reply.
I20260709 13:01:05.971311  1620 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:05.934419  1539 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:05.972383  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2183) took 1852 ms. Trace:
I20260709 13:01:05.940294  4221 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:05.917163  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:05.976028  1538 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:05.908486  1695 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:05.977144  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.972801  1539 rpcz_store.cc:276] 0709 13:01:04.119736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.925201 (+1805465us) service_pool.cc:224] Handling call
0709 13:01:05.925556 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.972161 (+ 46605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.972332 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:05.908732  4239 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:05.911798  4375 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:05.914800  4324 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:05.987942  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:05.988703  1539 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:05.937747  4036 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.979846  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:05.982180  3886 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:05.984992  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 434) took 3759 ms. Trace:
I20260709 13:01:05.985118  4369 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.986344  4203 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:05.986414  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:05.980870  4379 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:05.976802  4256 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.001s
I20260709 13:01:05.991988  1696 rpcz_store.cc:276] 0709 13:01:02.225088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.415257 (+190169us) service_pool.cc:224] Handling call
0709 13:01:02.415626 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:02.578386 (+162760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:02.578423 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:04.230841 (+1652418us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b2c0003e668. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:01:04.231273 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:01:04.440231 (+208958us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:05.028056 (+587825us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.029159 (+  1103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.029281 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:05.983133 (+953852us) spinlock_profiling.cc:243] Waited 8.38 ms on lock 0x7b180045c040. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:05.984759 (+  1626us) raft_consensus.cc:1685] finished
0709 13:01:05.984783 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.984932 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34811,"prepare.queue_time_us":413359,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":135782,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":61221,"spinlock_wait_cycles":24523264,"thread_start_us":570923,"threads_started":3,"wal-append.queue_time_us":561404}
W20260709 13:01:05.997949  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 124038us
I20260709 13:01:06.188256  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:06.188407  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 342426us
I20260709 13:01:06.190021  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:05.998059  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:05.998970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:06.190903  1694 raft_consensus.cc:2376] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
I20260709 13:01:05.468691  1546 rpcz_store.cc:276] 0709 13:01:04.117279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.435467 (+318188us) service_pool.cc:224] Handling call
0709 13:01:04.435804 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:04.436040 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:05.246463 (+810423us) log.cc:844] Serialized 14 byte log entry
0709 13:01:05.467880 (+221417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:05.467929 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:05.467975 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.468058 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:05.468161 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330,"prepare.queue_time_us":79218,"prepare.run_cpu_time_us":11565,"prepare.run_wall_time_us":253624,"raft.queue_time_us":333,"thread_start_us":997037,"threads_started":2}
I20260709 13:01:06.002203  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1348) took 1936 ms. Trace:
I20260709 13:01:05.970966  4374 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.006179  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.191665  1616 rpcz_store.cc:276] 0709 13:01:04.065308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.065466 (+   158us) service_pool.cc:224] Handling call
0709 13:01:04.065713 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.199488 (+1133775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.001933 (+802445us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400232154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:06.002145 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814225280}
I20260709 13:01:06.186575  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:06.193930  1587 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.713s (SENT)
I20260709 13:01:05.936751  4181 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.015883  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:06.079836  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.017019  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:05.988432  4381 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:05.981211  4373 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:06.184226  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.170535  1539 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:06.202834  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:06.203171  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 371455us
I20260709 13:01:06.012806  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.012037  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.001653  4203 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:06.001912  2266 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:06.206512  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 653) took 1377 ms. Trace:
I20260709 13:01:06.013814  4267 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:05.988655  4311 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:05.987222  4211 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:05.996097  4036 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.027168  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:06.194773  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.226357  1538 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:06.206987  2266 rpcz_store.cc:276] 0709 13:01:04.829159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.829301 (+   142us) service_pool.cc:224] Handling call
0709 13:01:05.986271 (+1156970us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:01:06.206453 (+220182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3400576}
I20260709 13:01:06.203646  1539 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:06.215378  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.156724  2260 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:06.213891  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:06.230239  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.232950  2265 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 4.
I20260709 13:01:06.185842  3886 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.149282  4316 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:06.149494  4186 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:06.240464  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:06.240888  1694 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.035689  4379 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:06.236788  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 295078us
I20260709 13:01:06.235800  1690 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:06.066510  4235 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.200675  4374 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:06.206269  4073 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.252252  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:06.279361  1538 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:06.229694  4369 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.211422  4221 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:01:06.258785  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 442) took 2163 ms (client timeout 1743 ms). Trace:
I20260709 13:01:06.259253  4390 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.202368  4382 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.260905  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:06.206334  4373 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.264848  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1413) took 2311 ms. Trace:
W20260709 13:01:06.293114  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79305.5us
I20260709 13:01:06.292311  1696 rpcz_store.cc:276] 0709 13:01:03.953702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.199906 (+2246204us) service_pool.cc:224] Handling call
0709 13:01:06.200244 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.200689 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.200730 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.201263 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.263254 (+ 61991us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:06.263294 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.263360 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.264655 (+  1295us) raft_consensus.cc:1685] finished
0709 13:01:06.264673 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.264794 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":955,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":25539,"thread_start_us":19543,"threads_started":1,"wal-append.queue_time_us":31209}
I20260709 13:01:06.265618  4048 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:06.267619  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2115) took 2029 ms (client timeout 2085 ms). Trace:
W20260709 13:01:06.294047  1692 rpcz_store.cc:269] 0709 13:01:04.237739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.626382 (+1388643us) service_pool.cc:224] Handling call
0709 13:01:06.267460 (+641078us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540029ca54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.267564 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389787392}
I20260709 13:01:06.293970  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.269182  4296 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:06.295539  1692 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:06.269832  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1414) took 2315 ms (client timeout 1851 ms). Trace:
W20260709 13:01:06.296264  1691 rpcz_store.cc:269] 0709 13:01:03.954012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.065045 (+111033us) service_pool.cc:224] Handling call
0709 13:01:06.269650 (+2204605us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b540040ef54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.269750 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":814455680}
I20260709 13:01:06.271085  4311 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:06.271754  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 81826.5us
I20260709 13:01:06.297648  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.277020  1616 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:06.035423  4275 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.255493  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1419) took 2279 ms. Trace:
W20260709 13:01:06.288142  1693 rpcz_store.cc:269] 0709 13:01:04.095861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.210269 (+114408us) service_pool.cc:224] Handling call
0709 13:01:06.258548 (+2048279us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54001306d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.258713 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279661440}
I20260709 13:01:06.298943  1694 rpcz_store.cc:276] 0709 13:01:03.962253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.230901 (+2268648us) service_pool.cc:224] Handling call
0709 13:01:06.240658 (+  9757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.241396 (+   738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.241563 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.259677  4388 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.016557  4375 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.253330  4225 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:06.273655  4332 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:06.309859  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1420) took 2333 ms. Trace:
I20260709 13:01:06.310492  1692 rpcz_store.cc:276] 0709 13:01:03.962601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.295103 (+2332502us) service_pool.cc:224] Handling call
0709 13:01:06.295371 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.295865 (+   494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.296029 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.301954  1538 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:06.302991  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:06.279136  4073 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.346541  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.313457  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:06.285208  4283 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.316147  4392 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:06.229449  4203 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.367384  4203 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.367005  4379 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.368337  4382 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.243861  4289 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:01:06.315047  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:06.281651  4374 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.309928  4332 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.364424  4211 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:06.366309  4300 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.000s
I20260709 13:01:06.249300  3886 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.371757  1688 raft_consensus.cc:2368] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6.
W20260709 13:01:06.371903  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74343.5us
W20260709 13:01:06.372102  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58762us
I20260709 13:01:06.361212  4073 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:06.372977  1587 leader_election.cc:336] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.823s (SENT)
I20260709 13:01:06.416846  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:06.373597  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 438) took 2301 ms. Trace:
I20260709 13:01:06.305437  4373 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:06.384189  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 168916us
I20260709 13:01:06.418257  1692 rpcz_store.cc:276] 0709 13:01:04.072307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.311345 (+2239038us) service_pool.cc:224] Handling call
0709 13:01:06.373104 (+ 61759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.373272 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.373296 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.373333 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.373368 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.373422 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.373532 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.316069  4235 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:06.398588  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.311370  4225 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:06.372479  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.413164  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.414343  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2191) took 2278 ms. Trace:
I20260709 13:01:06.361579  4256 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.419687  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.348155  4372 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.421593  1543 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:06.423383  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.396507  4311 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:06.378855  4392 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.397575  4283 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:06.424666  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51716.7us
I20260709 13:01:06.442952  4275 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:06.443187  1587 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.881s (SENT)
I20260709 13:01:06.430249  4211 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:06.444464  2258 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:06.444557  4392 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.445715  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:06.446573  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2109) took 2210 ms (client timeout 1881 ms). Trace:
W20260709 13:01:06.447142  1688 rpcz_store.cc:269] 0709 13:01:04.236195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.257947 (+1021752us) service_pool.cc:224] Handling call
0709 13:01:06.446367 (+1188420us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003665d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.446491 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308990848}
I20260709 13:01:06.429641  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.429302  1546 rpcz_store.cc:276] 0709 13:01:04.121758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.206323 (+2084565us) service_pool.cc:224] Handling call
0709 13:01:06.206679 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.207078 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.207120 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.227730 (+ 20610us) log.cc:844] Serialized 52 byte log entry
0709 13:01:06.309581 (+ 81851us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:06.392291 (+ 82710us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.399605 (+  7314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.399676 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.399713 (+    37us) raft_consensus.cc:1685] finished
0709 13:01:06.399725 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.399852 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44831,"prepare.queue_time_us":108090,"raft.queue_time_us":14109,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":31996,"spinlock_wait_cycles":8228736,"thread_start_us":34893,"threads_started":2,"wal-append.queue_time_us":134501}
I20260709 13:01:06.432850  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:06.347316  4364 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:06.434091  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.316586  4388 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.438938  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1725) took 2187 ms. Trace:
I20260709 13:01:06.424017  4382 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:06.439075  2259 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:06.347493  4186 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.451009  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:06.427469  4225 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.475937  1545 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.476542  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2197) took 2224 ms. Trace:
I20260709 13:01:06.476838  1545 rpcz_store.cc:276] 0709 13:01:04.252317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.475462 (+2223145us) service_pool.cc:224] Handling call
0709 13:01:06.475777 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.476316 (+   539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.476492 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.478009  1545 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.453832  1688 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:06.478947  3886 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.479281  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2108) took 2243 ms. Trace:
I20260709 13:01:06.420255  4356 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.481500  4356 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.452418  2257 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:06.482524  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:06.483206  4325 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
W20260709 13:01:06.451009  4393 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:01:06.437963  4289 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:06.424257  4300 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.458793  4181 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:06.438520  4235 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.494890  4379 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:01:06.495618  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2117) took 2257 ms (client timeout 1745 ms). Trace:
I20260709 13:01:06.495200  4235 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.496232  4383 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:06.496593  4300 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:06.498346  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 47454.7us
I20260709 13:01:06.465783  4373 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.438271  4332 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.469178  4311 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.505605  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:06.469923  4211 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.470769  4036 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.514480  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:06.514889  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:06.514725  4311 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.515509  1614 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:06.516166  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:06.471020  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:06.517268  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46337.5us
I20260709 13:01:06.424438  4315 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:01:06.518194  4315 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:06.518514  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.518703  4315 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.519666  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.519608  4315 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.520344  4395 raft_consensus.cc:2764] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:06.520820  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.521005  4395 raft_consensus.cc:2764] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:01:06.472519  4372 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:06.521831  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.522248  4166 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:06.522646  4166 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:06.473135  1693 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:01:06.523411  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1429) took 2467 ms (client timeout 2930 ms). Trace:
W20260709 13:01:06.523819  1690 rpcz_store.cc:269] 0709 13:01:04.055673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.743762 (+1688089us) service_pool.cc:224] Handling call
0709 13:01:06.523227 (+779465us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002f4ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.523356 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001860864}
I20260709 13:01:06.524132  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:06.525154  1690 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:06.525279  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1421) took 2562 ms. Trace:
I20260709 13:01:06.473950  4388 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:06.483661  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.525681  4399 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:06.526712  4399 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:06.479648  1688 rpcz_store.cc:276] 0709 13:01:04.235943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.448344 (+2212401us) service_pool.cc:224] Handling call
0709 13:01:06.448661 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.479050 (+ 30389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.479231 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.527709  1688 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.527755  1696 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:06.528405  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2119) took 2289 ms. Trace:
I20260709 13:01:06.528442  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2116) took 2290 ms. Trace:
I20260709 13:01:06.528885  1688 rpcz_store.cc:276] 0709 13:01:04.240743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.527263 (+2286520us) service_pool.cc:224] Handling call
0709 13:01:06.527537 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.528153 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.528350 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.457464  1543 rpcz_store.cc:276] 0709 13:01:04.251071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.421114 (+2170043us) service_pool.cc:224] Handling call
0709 13:01:06.421414 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.438675 (+ 17261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.438883 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.532399  1543 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:06.533042  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1728) took 1193 ms. Trace:
I20260709 13:01:06.533349  1543 rpcz_store.cc:276] 0709 13:01:05.339305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.531752 (+1192447us) service_pool.cc:224] Handling call
0709 13:01:06.532097 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.532809 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.532983 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.491161  2258 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:06.534552  4283 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.525683  1693 rpcz_store.cc:276] 0709 13:01:03.962999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.299753 (+2336754us) service_pool.cc:224] Handling call
0709 13:01:06.300037 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.523266 (+223229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.525063 (+  1797us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540040f454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:06.525228 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397561728}
W20260709 13:01:06.536695  4404 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:01:06.537201  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2124) took 2295 ms. Trace:
I20260709 13:01:06.537580  1693 rpcz_store.cc:276] 0709 13:01:04.242161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.536468 (+2294307us) service_pool.cc:224] Handling call
0709 13:01:06.536749 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.536903 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.536928 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.536962 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:06.536989 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.537037 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:06.537150 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.493911  4327 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:06.495985  1687 rpcz_store.cc:269] 0709 13:01:04.238227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.804902 (+566675us) service_pool.cc:224] Handling call
0709 13:01:06.495413 (+1690511us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003ae654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.495552 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3321889152}
I20260709 13:01:06.421146  4316 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:06.457803  4275 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:06.505962  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:06.553318  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2185) took 2423 ms (client timeout 2085 ms). Trace:
I20260709 13:01:06.506734  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:06.469409  4364 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:06.504848  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:06.507161  1619 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:06.511413  4211 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.525688  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2114) took 2288 ms. Trace:
I20260709 13:01:06.484292  1695 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:06.528956  1696 rpcz_store.cc:276] 0709 13:01:04.237992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.527180 (+2289188us) service_pool.cc:224] Handling call
0709 13:01:06.527450 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.528213 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.528388 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.488672  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:06.478510  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 377) took 1626 ms. Trace:
I20260709 13:01:06.557463  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:06.559134  1545 rpcz_store.cc:276] 0709 13:01:04.852536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.477587 (+1625051us) service_pool.cc:224] Handling call
0709 13:01:06.477865 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.478302 (+   437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.478463 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.483950  4177 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.560456  2261 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:06.530488  1688 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.505318  1616 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.539794  1543 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:06.503927  4324 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:01:06.540576  1692 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:06.543061  1687 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:01:06.553802  1544 rpcz_store.cc:269] 0709 13:01:04.120251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.222699 (+102448us) service_pool.cc:224] Handling call
0709 13:01:06.543561 (+2320862us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b5400106154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:06.543699 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006278400}
I20260709 13:01:06.589381  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1433) took 1736 ms. Trace:
I20260709 13:01:06.557571  1690 rpcz_store.cc:276] 0709 13:01:04.237482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.524590 (+2287108us) service_pool.cc:224] Handling call
0709 13:01:06.524881 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.525477 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.525644 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.589792  1687 rpcz_store.cc:276] 0709 13:01:04.853022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.538999 (+1685977us) service_pool.cc:224] Handling call
0709 13:01:06.542820 (+  3821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.589147 (+ 46327us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.589329 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.507299  4400 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:06.543270  4390 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.562721  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:06.591904  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:06.595477  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2122) took 2353 ms. Trace:
I20260709 13:01:06.592167  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1731) took 1252 ms. Trace:
I20260709 13:01:06.558399  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:06.498204  4325 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.593073  1545 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:06.591320  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:06.604175  1690 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
W20260709 13:01:06.593382  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.504228  4267 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:01:06.596340  1688 rpcz_store.cc:276] 0709 13:01:04.241574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.530028 (+2288454us) service_pool.cc:224] Handling call
0709 13:01:06.530331 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.594229 (+ 63898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.594913 (+   684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.597146  1543 rpcz_store.cc:276] 0709 13:01:05.340091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.534035 (+1193944us) service_pool.cc:224] Handling call
0709 13:01:06.534342 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.588882 (+ 54540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.592088 (+  3206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.598062  1696 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:06.592859  4324 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.553375  4275 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:06.610519  1687 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:06.610967  1616 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:06.545437  4399 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.615340  4233 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.623709  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:06.637974  1545 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.543385  4379 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:06.629585  4275 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:06.643878  1542 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:06.560040  4211 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:06.592612  4329 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.592640  4327 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:06.587318  4391 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:06.557974  4364 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:06.616468  4253 consensus_meta.cc:287] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.904s	user 0.009s	sys 0.002s
I20260709 13:01:06.539163  4383 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:01:06.728835  1540 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:06.730288  1538 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:06.593438  4177 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.742801  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:06.746157  1545 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:06.561388  4395 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.167s
I20260709 13:01:06.727998  4235 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:01:06.734716  4225 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:06.610553  4390 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.729200  4375 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.657313  4233 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:07.732875  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 1.17023e+06us
I20260709 13:01:06.795297  1693 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:07.769598  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:01:07.667223  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 369142us
I20260709 13:01:07.771202  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:07.002103  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:07.772411  1616 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.772414  1689 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:07.774333  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2137) took 1219 ms. Trace:
I20260709 13:01:07.011286  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:07.774730  1689 rpcz_store.cc:276] 0709 13:01:06.555271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.001711 (+446440us) service_pool.cc:224] Handling call
0709 13:01:07.774279 (+772568us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.776307  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2131) took 1231 ms. Trace:
I20260709 13:01:07.776676  1687 rpcz_store.cc:276] 0709 13:01:06.544657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.590538 (+ 45881us) service_pool.cc:224] Handling call
0709 13:01:07.776162 (+1185624us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b540040e054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:07.776255 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33548672}
I20260709 13:01:07.777861  1545 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:07.778707  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1733) took 2009 ms (client timeout 2573 ms). Trace:
W20260709 13:01:07.779191  1541 rpcz_store.cc:269] 0709 13:01:05.769451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.848785 (+ 79334us) service_pool.cc:224] Handling call
0709 13:01:07.777576 (+1928791us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b5400046ad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:07.778576 (+  1000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132528000}
W20260709 13:01:07.742367  1587 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.955s (SENT)
I20260709 13:01:07.780398  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:06.778986  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:06.817560  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.781654  1696 raft_consensus.cc:2368] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
W20260709 13:01:06.989969  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.768247  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:07.785562  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2127) took 1244 ms. Trace:
I20260709 13:01:07.786063  1690 rpcz_store.cc:276] 0709 13:01:06.541472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.752249 (+210777us) service_pool.cc:224] Handling call
0709 13:01:07.785483 (+1033234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.792888  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2126) took 1251 ms. Trace:
I20260709 13:01:07.793550  1696 rpcz_store.cc:276] 0709 13:01:06.541140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.778740 (+237600us) service_pool.cc:224] Handling call
0709 13:01:07.792797 (+1014057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.779565  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 440) took 3703 ms. Trace:
I20260709 13:01:07.795264  1692 rpcz_store.cc:276] 0709 13:01:04.076297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.430452 (+2354155us) service_pool.cc:224] Handling call
0709 13:01:06.540416 (+109964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.588844 (+ 48428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.779387 (+1190543us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002f4ed0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:07.779515 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252231552}
I20260709 13:01:07.797595  1692 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:06.776325  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:07.799764  1688 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:07.800303  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2133) took 1255 ms. Trace:
I20260709 13:01:07.800664  1688 rpcz_store.cc:276] 0709 13:01:06.545215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.776045 (+230830us) service_pool.cc:224] Handling call
0709 13:01:07.800243 (+1024198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:07.548627  4392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.020s	sys 0.007s
W20260709 13:01:07.621795  4391 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.866s	user 0.004s	sys 0.006s
W20260709 13:01:07.371057  4409 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
W20260709 13:01:07.300212  4315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.008s
I20260709 13:01:06.743101  4327 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:07.379652  4406 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.909s	user 0.005s	sys 0.009s
W20260709 13:01:07.650542  4399 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.922s	user 0.007s	sys 0.000s
I20260709 13:01:07.796329  4144 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.735491  4329 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:06.890908  4375 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:07.732479  4373 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:06.769058  4177 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:07.654595  4275 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.922s	user 0.006s	sys 0.002s
I20260709 13:01:06.783231  4324 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:06.769716  4371 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:06.792109  4225 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:07.828835  4315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.010s	sys 0.008s
I20260709 13:01:07.831460  1689 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:07.877734  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2129) took 1335 ms. Trace:
I20260709 13:01:07.878252  1689 rpcz_store.cc:276] 0709 13:01:06.542050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.821456 (+1279406us) service_pool.cc:224] Handling call
0709 13:01:07.831124 (+  9668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.877357 (+ 46233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.877653 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:06.891741  4374 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.002564  4211 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:06.972904  4384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.006s
I20260709 13:01:06.784384  4390 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:06.786024  4325 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:07.246872  4395 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:07.542495  4416 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.844044  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1432) took 2991 ms. Trace:
W20260709 13:01:07.812865  4073 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.389s	user 0.012s	sys 0.009s
I20260709 13:01:07.799216  4235 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.827788  4392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.021s	sys 0.010s
I20260709 13:01:06.938258  4364 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.898869  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:07.863977  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2128) took 1322 ms. Trace:
I20260709 13:01:07.899636  1692 rpcz_store.cc:276] 0709 13:01:06.541780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.796948 (+1255168us) service_pool.cc:224] Handling call
0709 13:01:07.797228 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.863582 (+ 66354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.863898 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:07.846416  1512 connection.cc:256] RPC call timeout handler was delayed by -1.247655941000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29300000000000004s for a response
I20260709 13:01:06.750468  4253 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.832427  4391 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.887955  1543 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:07.888942  1693 rpcz_store.cc:276] 0709 13:01:04.852736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.538440 (+1685704us) service_pool.cc:224] Handling call
0709 13:01:06.540252 (+  1812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.769782 (+1229530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.832997 (+ 63215us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540023b4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:07.843930 (+ 10933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586005376}
I20260709 13:01:07.896136  1689 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:01:07.889251  4384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.007s	sys 0.013s
I20260709 13:01:07.903867  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2130) took 1359 ms. Trace:
I20260709 13:01:07.907896  1689 rpcz_store.cc:276] 0709 13:01:06.544344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.879362 (+1335018us) service_pool.cc:224] Handling call
0709 13:01:07.895818 (+ 16456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.903623 (+  7805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.903814 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.901962  1692 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:01:07.905220  1544 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.912268  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2134) took 1366 ms. Trace:
W20260709 13:01:07.889254  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 118127us
I20260709 13:01:07.914855  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:07.887955  4225 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:07.894333  4281 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:07.847959  4399 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.944918  1547 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:07.854718  4144 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:07.877375  4275 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.906428  4325 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.952854  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 472) took 1690 ms. Trace:
I20260709 13:01:07.967037  2263 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:07.896267  4395 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:07.967187  1622 rpcz_store.cc:276] 0709 13:01:06.274916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.275058 (+   142us) service_pool.cc:224] Handling call
0709 13:01:06.275379 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.275598 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.275620 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.285546 (+  9926us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.407196 (+121650us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:06.407236 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.407309 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:06.950503 (+543194us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:07.948446 (+997943us) raft_consensus.cc:1685] finished
0709 13:01:07.948481 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.952786 (+  4305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31510400,"thread_start_us":56503,"threads_started":1,"wal-append.queue_time_us":140390}
I20260709 13:01:07.889829  4421 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:07.913985  4371 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:07.969935  4390 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.971045  4233 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:07.953658  4384 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:07.978678  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 226041us
I20260709 13:01:07.912905  1692 rpcz_store.cc:276] 0709 13:01:06.545457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.900626 (+1355169us) service_pool.cc:224] Handling call
0709 13:01:07.900998 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.911942 (+ 10944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.912197 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:07.898344  4073 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:07.947467  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:07.917876  4364 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:07.902431  4235 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:07.911656  4315 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:08.017246  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:07.948194  4225 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.018903  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:08.019990  1616 raft_consensus.cc:2410] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:08.021661  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:08.022324  1616 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:08.023713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:08.024345  1616 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:08.026525  1616 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:01:08.029265  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:08.031064  1622 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:08.031498  1662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.050s	sys 0.052s
I20260709 13:01:08.028770  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:07.896425  4416 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:07.954046  4316 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.034109  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.981920  4371 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.053886  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:08.034065  1662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.050s	sys 0.052s
I20260709 13:01:07.987794  4373 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:08.049435  1621 raft_consensus.cc:2368] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6.
I20260709 13:01:07.979568  4421 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:08.068032  1512 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.222s (SENT)
I20260709 13:01:07.980830  4325 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.032553  4281 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.048063  4177 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:08.103968  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 205157us
I20260709 13:01:08.048300  4384 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:08.016292  4390 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.059059  4371 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.045267  4225 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.110293  1622 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:08.025501  4415 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:01:08.051213  4275 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:08.115820  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 168478us
I20260709 13:01:08.053086  4316 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:08.136140  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79127.9us
I20260709 13:01:08.082966  4421 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:08.074751  4434 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:08.035949  4315 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.140187  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:08.107030  4426 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:08.130497  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:08.092868  4373 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.117487  4144 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.107713  4281 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:08.264484  4414 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:01:08.116187  4177 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.236348  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:08.219301  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.297341  2264 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:08.298453  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:08.210407  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:08.210978  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.220896  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.236934  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:08.219036  4439 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:01:08.304052  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.304818  2265 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:08.306001  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.306922  2265 raft_consensus.cc:2410] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:01:08.307893  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:08.309991  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 73150us
I20260709 13:01:08.129472  4430 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:08.137998  4441 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:08.140937  4417 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.262424  4391 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.236519  4428 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.146946  4423 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.272182  2260 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:08.321466  4441 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.221086  4374 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.278285  4332 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.234948  4253 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.279139  4443 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:08.142755  4329 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.246443  4424 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.311065  4399 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:08.256410  4446 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.251096  4390 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:08.233987  4436 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:08.186679  4211 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.170969  4233 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.322351  4275 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:08.318842  4430 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.246498  4435 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:01:08.334942  4427 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:01:08.332788  4441 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:08.335271  4325 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.332729  4448 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.186275  4429 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.185s
I20260709 13:01:08.328941  4417 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.314286  4426 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.256647  4437 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:01:08.336522  4443 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:08.329767  4391 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.472036  4315 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.473012  4315 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.354035  4424 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.384282  4448 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.431854  1620 raft_consensus.cc:2410] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:08.432613  1585 leader_election.cc:336] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.800s (SENT)
I20260709 13:01:08.433131  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:08.319487  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 270514us
I20260709 13:01:08.220626  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:08.146422  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 95595.7us
W20260709 13:01:08.315347  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 184928us
I20260709 13:01:08.440807  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:08.315485  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:08.348608  4073 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.293553  4166 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.442890  4177 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:08.352221  4281 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.352246  4316 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.349282  4374 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:08.296682  4384 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.350473  4395 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.353368  4416 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.387778  4417 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.331089  4423 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.388087  4426 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:08.330058  4428 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.359782  4430 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:08.387890  4438 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:01:08.353459  4436 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.349928  4446 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.464550  4373 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.467527  4434 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:07.525568   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:08.472157  2259 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:08.438463  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 125982us
I20260709 13:01:08.473810  4315 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:08.480744  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2203) took 2282 ms. Trace:
I20260709 13:01:08.556367  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 770) took 2270 ms. Trace:
I20260709 13:01:08.516156  4443 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:08.554188  1692 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:09.011740  4166 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.013643  4436 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:08.453715  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 142188us
I20260709 13:01:09.009559  2261 rpcz_store.cc:276] 0709 13:01:06.285658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.285801 (+   143us) service_pool.cc:224] Handling call
0709 13:01:06.286063 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.560878 (+274815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.555744 (+1994866us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54006a2054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:08.556128 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630543744}
I20260709 13:01:08.558370  2262 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:08.521206  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 88811.5us
I20260709 13:01:08.565387  4036 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.017031  2262 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:08.810251  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 280769us
W20260709 13:01:08.529633  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1734) took 2759 ms (client timeout 2206 ms). Trace:
I20260709 13:01:08.760354  4364 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:08.552716  1694 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:08.508313  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2206) took 2295 ms. Trace:
I20260709 13:01:08.567842  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:08.530774  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 474) took 2253 ms. Trace:
I20260709 13:01:08.478322  4424 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.534080  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:08.634666  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:09.003885  4421 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.009s
W20260709 13:01:08.806468  4371 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.010s
I20260709 13:01:08.532048  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1661) took 2029 ms. Trace:
I20260709 13:01:08.508986  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2199) took 2766 ms. Trace:
I20260709 13:01:08.626396  1689 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:08.502048  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 75320.1us
I20260709 13:01:09.013664  1693 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:08.478253  4448 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:08.514065  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2186) took 4393 ms. Trace:
I20260709 13:01:08.534653  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:09.013777  1692 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.015421  1543 rpcz_store.cc:276] 0709 13:01:06.198534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.805838 (+1607304us) service_pool.cc:224] Handling call
0709 13:01:07.810735 (+  4897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.902861 (+ 92126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.480089 (+577228us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b540018abd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:08.480483 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167883648}
W20260709 13:01:08.555063  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1434) took 3701 ms (client timeout 4315 ms). Trace:
I20260709 13:01:09.036160  1541 rpcz_store.cc:276] 0709 13:01:06.212826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.477788 (+2264962us) service_pool.cc:224] Handling call
0709 13:01:08.478447 (+   659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.507804 (+ 29357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.507850 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:08.507905 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:08.507936 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.507989 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.508101 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:08.534740  4391 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:09.074189  2231 connection.cc:256] RPC call timeout handler was delayed by -3.9372104610000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:01:09.037206  1513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.017s	sys 0.027s
I20260709 13:01:09.131747  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.036836  1615 rpcz_store.cc:276] 0709 13:01:06.277709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.277865 (+   156us) service_pool.cc:224] Handling call
0709 13:01:06.302867 (+ 25002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.306212 (+  3345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.306258 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:06.306319 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:06.306367 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.530182 (+2223815us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5400230854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:08.530260 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.530535 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7116544}
I20260709 13:01:09.076195  2266 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.105803  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.171754  1544 rpcz_store.cc:276] 0709 13:01:05.741946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.589484 (+847538us) service_pool.cc:224] Handling call
0709 13:01:06.589764 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.911651 (+1321887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.508381 (+596730us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540038a754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:08.508718 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025027968}
W20260709 13:01:09.057965  1585 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.853s (SENT) [suppressed 32 similar messages]
W20260709 13:01:09.033339  1542 rpcz_store.cc:269] 0709 13:01:05.769867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.803699 (+ 33832us) service_pool.cc:224] Handling call
0709 13:01:08.529137 (+2725438us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b540013ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:08.529385 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871835008}
I20260709 13:01:09.173262  1621 rpcz_store.cc:276] 0709 13:01:06.502685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.504609 (+  1924us) service_pool.cc:224] Handling call
0709 13:01:08.531608 (+2026999us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000f9bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:08.531796 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3435032448}
I20260709 13:01:09.171258  1540 rpcz_store.cc:276] 0709 13:01:04.120509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.057138 (+1936629us) service_pool.cc:224] Handling call
0709 13:01:06.057936 (+   798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.744770 (+686834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.513374 (+1768604us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54000474d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:08.513799 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542595840}
I20260709 13:01:09.131547  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:08.354070  4275 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:09.198184  1513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.415s	user 0.019s	sys 0.029s
I20260709 13:01:09.093978  2262 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.135986  4327 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.205811  1617 raft_consensus.cc:2410] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:01:09.092041  4390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.007s	sys 0.022s
I20260709 13:01:09.132997  4314 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:09.219277  4390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.046s
I20260709 13:01:09.221989  4446 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.222512  4428 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:09.223188  4395 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.223385  2262 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.223881  4395 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.228462  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:09.230755  2266 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:09.130900  4452 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.236146  4452 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:09.172276  1695 rpcz_store.cc:269] 0709 13:01:04.853306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.976902 (+1123596us) service_pool.cc:224] Handling call
0709 13:01:08.554555 (+2577653us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b540023b754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:08.554835 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163348224}
I20260709 13:01:09.247902  4423 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:08.860285  4441 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.250744  4441 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:09.252974  4452 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.226431  4395 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:09.254982  4471 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:09.261353  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 222938us
I20260709 13:01:09.135753  4315 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:09.284767  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 185854us
I20260709 13:01:08.850435  4027 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.394s
W20260709 13:01:09.306800  4332 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.929s	user 0.008s	sys 0.013s
I20260709 13:01:09.303567  4275 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:08.479700  4233 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.193612  4421 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.120771  4364 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.296599  2261 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:01:09.310848  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 66240.9us
I20260709 13:01:09.390895  2259 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:09.307351  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.107475  4435 consensus_queue.cc:1243] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:09.355633  2262 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:09.197793  4371 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.255712  4471 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.370230  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 780) took 2911 ms. Trace:
I20260709 13:01:09.352079  1688 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:09.096752  4434 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.400804  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 670) took 1082 ms. Trace:
W20260709 13:01:09.402098  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 105484us
I20260709 13:01:09.396991  2263 rpcz_store.cc:276] 0709 13:01:06.458985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.540872 (+ 81887us) service_pool.cc:224] Handling call
0709 13:01:06.541141 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.968697 (+1427556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.369664 (+1400967us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54004a9a54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:09.370021 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3279141760}
I20260709 13:01:09.402343  2262 rpcz_store.cc:276] 0709 13:01:08.314167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.557211 (+243044us) service_pool.cc:224] Handling call
0709 13:01:08.557885 (+   674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.395725 (+837840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.396041 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.327118  4452 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.407842  4036 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.411419  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:09.412101  4036 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.412644  4452 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.413825  4311 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.414446  4311 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.415035  4452 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.411572  2264 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:09.360105  4395 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:01:09.416895  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 946571us
I20260709 13:01:09.310995  4441 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:01:09.418993  2265 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:09.420231  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2208) took 3205 ms. Trace:
I20260709 13:01:09.420327  4256 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.422465  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:09.422219  4424 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:09.423049  4416 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.423861  4323 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:09.430805  4323 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.430882  4311 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.431205  4323 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.427690  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.431479  4417 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:09.432071  1542 raft_consensus.cc:2368] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8.
I20260709 13:01:09.432085  4417 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:09.429430  4256 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:09.432986  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.433589  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.434130  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.433496  4417 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.434845  4256 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:09.435750  4407 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 2.966s	user 0.002s	sys 0.016s
W20260709 13:01:09.436065  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.436620  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.418406  4036 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.437665  4375 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.400038  4027 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:09.444451  1540 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:09.447244  4447 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:09.451124  1540 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:09.425140  1539 rpcz_store.cc:276] 0709 13:01:06.213447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.481739 (+2268292us) service_pool.cc:224] Handling call
0709 13:01:08.482501 (+   762us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:08.483331 (+   830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.483359 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:08.484439 (+  1080us) log.cc:844] Serialized 78 byte log entry
0709 13:01:08.879273 (+394834us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:09.210576 (+331303us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.217611 (+  7035us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.417755 (+200144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.417808 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.417834 (+    26us) raft_consensus.cc:1685] finished
0709 13:01:09.417841 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.418477 (+   636us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197929,"prepare.queue_time_us":317179,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":175079,"raft.run_cpu_time_us":500,"raft.run_wall_time_us":503,"thread_start_us":509066,"threads_started":2,"wal-append.queue_time_us":542524}
I20260709 13:01:09.454819  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.463446  1616 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:09.430552  4416 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.465294  4471 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.471458  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.465951  4416 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.477530  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.467031  4371 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:09.479161  1622 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:01:09.502960  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 50459.6us
I20260709 13:01:09.481770  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.511464  1613 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:09.512001  1622 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:09.512704  1613 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.513186  1622 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:09.484338  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.515048  1614 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:09.506247  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.442379  4430 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.517220  2257 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:09.517833  4395 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:09.518582  4395 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:09.520143  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89248.7us
I20260709 13:01:09.507490  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.497702  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.522243  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.522971  1617 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:09.523154  2260 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:09.523481  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:09.524673  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 99622.9us
I20260709 13:01:09.508447  4364 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.509635  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.519214  4430 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:09.528294  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.526186  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.490444  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.526635  4376 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:01:09.531136  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.531473  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.532248  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.533110  1613 raft_consensus.cc:2410] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:09.533681  1585 leader_election.cc:336] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.541s (SENT)
I20260709 13:01:09.533895  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.534916  1614 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:09.535080  4376 consensus_queue.cc:1243] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:09.535538  4375 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:09.536708  1510 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:09.538107  1617 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:09.546418  1688 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 4.
I20260709 13:01:09.546345  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.549189  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.543885  4416 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.561161  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.550958  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 451) took 1238 ms. Trace:
I20260709 13:01:09.559870  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:09.563097  1688 rpcz_store.cc:276] 0709 13:01:08.308900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.533464 (+224564us) service_pool.cc:224] Handling call
0709 13:01:09.547124 (+1013660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:09.557252  2260 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:09.547586  4447 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:01:09.572512  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.573534  2260 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:09.575153  4421 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.575860  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2200) took 3833 ms. Trace:
I20260709 13:01:09.576287  1545 rpcz_store.cc:276] 0709 13:01:05.742176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.760028 (+1017852us) service_pool.cc:224] Handling call
0709 13:01:07.777684 (+1017656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.778257 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.575433 (+1797176us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400046ad0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.575654 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2339539328}
W20260709 13:01:09.579411  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 376) took 4727 ms (client timeout 2134 ms). Trace:
W20260709 13:01:09.579914  1547 rpcz_store.cc:269] 0709 13:01:04.852281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:05.425115 (+572834us) service_pool.cc:224] Handling call
0709 13:01:09.578561 (+4153446us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b5400083ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.579230 (+   669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5791892736}
I20260709 13:01:09.579540  1546 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.581334  2261 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:09.582443  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.555374  4166 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.583484  2261 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:09.583412  4166 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.584708  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.586071  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.500079  4323 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:09.587766  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 60929.2us
I20260709 13:01:09.520776  4395 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.588291  1539 raft_consensus.cc:2368] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
I20260709 13:01:09.587431  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1724) took 5336 ms. Trace:
I20260709 13:01:09.592686  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 431) took 1383 ms. Trace:
I20260709 13:01:09.591425  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:09.590126  4235 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:09.710593  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.709131  4378 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 3.809s	user 0.006s	sys 0.012s
I20260709 13:01:09.587478  4233 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:09.711663  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2983866319999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:01:09.715011  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2884866319999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:01:09.715459  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2542866319999462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:01:09.715780  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1741866319999872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:01:09.712291  4447 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.717236  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.717545  4225 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:09.718063  4225 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:09.717820  4447 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.720016  4447 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.720449  4451 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:09.720655  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 433) took 1510 ms. Trace:
I20260709 13:01:09.720816  4435 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.719179  4225 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.721065  2257 rpcz_store.cc:276] 0709 13:01:08.209792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.210709 (+   917us) service_pool.cc:224] Handling call
0709 13:01:09.720420 (+1509711us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.720592 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795951488}
I20260709 13:01:09.721480  4435 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.712201  2259 rpcz_store.cc:276] 0709 13:01:08.209151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.210081 (+   930us) service_pool.cc:224] Handling call
0709 13:01:09.592451 (+1382370us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54005fd054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.592608 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395646848}
I20260709 13:01:09.712488  1538 rpcz_store.cc:276] 0709 13:01:04.250815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.399352 (+2148537us) service_pool.cc:224] Handling call
0709 13:01:06.400001 (+   649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.745189 (+345188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.587019 (+2841830us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001c07d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:09.587281 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":758822144}
W20260709 13:01:09.618220  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 59998.4us
I20260709 13:01:09.588305  4417 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.589721  4323 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.586562  4166 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.587910  4036 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.574553  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.593118  4275 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.748478  4417 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:09.748569  4036 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.749155  4417 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.749541  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.750393  4275 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.720937  4451 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:09.750851  4036 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.734731  4225 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:09.754458  1585 leader_election.cc:336] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.995s (SENT)
I20260709 13:01:09.591821  4416 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.764101  4435 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.764878  1544 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:09.760336  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.768774  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.769816  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 438) took 1208 ms. Trace:
I20260709 13:01:09.769937  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.755576  4447 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:01:09.770346  2265 rpcz_store.cc:276] 0709 13:01:08.561057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.131089 (+570032us) service_pool.cc:224] Handling call
0709 13:01:09.769607 (+638518us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400668354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.769764 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398640896}
I20260709 13:01:09.770680  2260 raft_consensus.cc:2376] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
I20260709 13:01:09.788111  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.788224  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.789870  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.789938  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.771469  4416 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.773689  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.791148  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:09.793515  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.797317  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:09.798326  4434 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:09.798468  4375 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:09.798717  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:09.771410  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 435) took 1536 ms (client timeout 1828 ms). Trace:
W20260709 13:01:09.813678  2264 rpcz_store.cc:269] 0709 13:01:08.235377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.298216 (+ 62839us) service_pool.cc:224] Handling call
0709 13:01:09.771193 (+1472977us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54005d11d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.771358 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547959680}
I20260709 13:01:09.785699  4431 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:09.822494  4315 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:09.826380  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.831185  2265 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:09.824232  4431 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:09.837527  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.838452  4431 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.840003  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.840745  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2196) took 5588 ms. Trace:
I20260709 13:01:09.841274  4166 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.841220  1546 rpcz_store.cc:276] 0709 13:01:04.252082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.449554 (+2197472us) service_pool.cc:224] Handling call
0709 13:01:09.579199 (+3129645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.580854 (+  1655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.840519 (+259665us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b5400083ed0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:09.840690 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7197267200}
I20260709 13:01:09.841919  4166 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:09.838981  4233 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.840835  4036 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.842787  4235 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:09.843277  4431 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.846264  4235 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.847333  4166 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.848259  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.848757  4235 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.849426  4424 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.849839  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.850159  4424 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.852136  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.852562  4424 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:09.852777  1538 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:09.853525  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.837226  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.775101  4451 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.854993  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.855957  4323 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.856812  4323 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.842562  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.862084  1546 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:09.863626  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:09.864068  4323 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:09.865096  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:09.866127  4435 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:09.866532  4435 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:09.866933  4435 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:09.868278  4490 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:01:09.869037  2263 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:09.869565  4434 raft_consensus.cc:2764] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:09.843035  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.828665  4315 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:09.850543  1542 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:09.832113  4375 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:09.873675  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.866568  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:09.875728  4375 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:09.888845  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:09.889297  4375 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:09.893910  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.872363  4036 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:09.890516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:09.895666  1690 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:09.894304  4417 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:09.887547  2261 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:01:09.962543  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.887879  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:09.947866  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:09.919423  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:09.895972  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.964736  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.887835  1688 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:09.897289  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:09.998250  2265 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:09.999358  1542 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:09.896309  1545 raft_consensus.cc:2376] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:09.997964  2264 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:09.896064  4447 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:10.002435  4447 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:10.003005  4447 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.004874  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:09.888374  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.009792  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:09.874190  4315 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:10.014029  1539 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.014961  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.017818  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.017951  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.019920  1543 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:10.021934  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:10.020679  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 609503us
I20260709 13:01:10.022568  1547 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:10.031011  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.031685  1687 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:10.031984  2259 raft_consensus.cc:2410] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:09.896013  4233 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.034967  1544 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.036079  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.036929  1547 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:10.037395  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:10.039251  4483 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:10.039702  1510 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:10.040552  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 446) took 1691 ms. Trace:
I20260709 13:01:10.041078  4424 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.041561  4424 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.042112  4424 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.042229  4423 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:10.043412  4417 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.043812  4423 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:10.044579  4375 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.045882  4423 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.046289  4423 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.025725  4225 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:10.046826  4441 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:10.047930  4225 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:10.041535  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:10.049618  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 337) took 21155 ms (client timeout 15000 ms). Trace:
I20260709 13:01:10.042245  4036 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:10.049770  2265 raft_consensus.cc:2410] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:10.048326  4225 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:10.051178  4443 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.052127  4225 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.053593  4225 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.010289  4027 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:10.057847  1546 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:10.018563  4323 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:01:10.056926  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:10.060164  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 45511.9us
I20260709 13:01:09.920040  4385 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:01:10.063408  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.058243  4423 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.066205  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:10.069542  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 124542us
W20260709 13:01:10.076107  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.104816  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.140491  2263 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:10.041025  1691 rpcz_store.cc:276] 0709 13:01:08.298110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.298247 (+   137us) service_pool.cc:224] Handling call
0709 13:01:08.298517 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:08.528509 (+229992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:08.528570 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:09.103977 (+575407us) log.cc:844] Serialized 26 byte log entry
0709 13:01:09.243290 (+139313us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:09.394818 (+151528us) log.cc:844] Serialized 14 byte log entry
0709 13:01:09.784107 (+389289us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800388360. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:09.974681 (+190574us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800388360. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:01:09.974888 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.974990 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:09.975047 (+    57us) raft_consensus.cc:1685] finished
0709 13:01:09.975066 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:09.989935 (+ 14869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1847,"prepare.queue_time_us":44343,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":425,"raft.queue_time_us":609767,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":2096,"spinlock_wait_cycles":10263680,"thread_start_us":270053,"threads_started":2,"wal-append.queue_time_us":403666}
I20260709 13:01:10.108474  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.040550  4186 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:01:10.078068  4390 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:01:10.130990  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 115572us
W20260709 13:01:10.129630  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.075089  1542 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.147639  2264 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:01:10.154978  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.154670  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:10.155426  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.156418  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:10.161734  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.162544  2261 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:01:10.152984  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 91859.9us
W20260709 13:01:10.163614  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 97544.7us
I20260709 13:01:10.158908  4423 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.167502  4451 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.168708  4423 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.169528  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:10.161586  4454 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:10.175076  4454 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:10.176036  4454 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.177268  4454 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.179406  2265 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:10.152745  4027 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.179011  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:10.188251  2263 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.183277  1539 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:10.189981  1542 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:01:10.190936  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 161765us
W20260709 13:01:10.191479  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.195271  1695 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:10.195990  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 64602.2us
W20260709 13:01:10.050089  1444 rpcz_store.cc:269] 0709 13:00:48.894145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.894378 (+   233us) service_pool.cc:224] Handling call
0709 13:01:10.049335 (+21154957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:00.064006 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:00.172266 (+108260us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:00.172332 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:01:00.172350 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:00.173556 (+  1206us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:00.187810 (+ 14254us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:00.194246 (+  6436us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:00.211927 (+ 17681us) tablet.cc:701] Row locks acquired
0709 13:01:00.211990 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:01:00.212204 (+   214us) write_op.cc:270] Start()
0709 13:01:00.212390 (+   186us) write_op.cc:276] Timestamp: P: 1783602060212124 usec, L: 0
0709 13:01:00.212414 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:00.213302 (+   888us) log.cc:844] Serialized 3617 byte log entry
0709 13:01:00.763626 (+550324us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b
0709 13:01:01.675669 (+912043us) op_driver.cc:464] REPLICATION: finished
0709 13:01:02.109206 (+433537us) write_op.cc:301] APPLY: starting
0709 13:01:02.127832 (+ 18626us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:02.136322 (+  8490us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:02.136368 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:02.418557 (+282189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:02.495180 (+ 76623us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:01:02.502262 (+  7082us) write_op.cc:312] APPLY: finished
0709 13:01:02.502756 (+   494us) log.cc:844] Serialized 71 byte log entry
0709 13:01:02.572067 (+ 69311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.572331 (+   264us) write_op.cc:454] Released schema lock
0709 13:01:02.572408 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:02.572937 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:02.572972 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30387,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":386980,"apply.run_cpu_time_us":10113,"apply.run_wall_time_us":463669,"num_ops":9,"prepare.queue_time_us":142250,"prepare.run_cpu_time_us":20602,"prepare.run_wall_time_us":1062706,"raft.queue_time_us":543063,"raft.run_cpu_time_us":24866,"raft.run_wall_time_us":341025,"replication_time_us":1434723,"spinlock_wait_cycles":59436928,"thread_start_us":1645449,"threads_started":5,"wal-append.queue_time_us":982145,"wal-append.run_cpu_time_us":111980,"wal-append.run_wall_time_us":2384195}]]}
I20260709 13:01:10.200340  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 447) took 1900 ms. Trace:
I20260709 13:01:10.200874  1544 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:10.161319  4375 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.200747  1689 rpcz_store.cc:276] 0709 13:01:08.299491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.299636 (+   145us) service_pool.cc:224] Handling call
0709 13:01:08.571988 (+272352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:09.170953 (+598965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.190731 (+1019778us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540023b750. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:10.200287 (+  9556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313882880}
W20260709 13:01:10.238068  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.182451  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:10.253636  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.254935  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:10.213945  4315 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:10.263124  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 225971us
I20260709 13:01:10.265074  4390 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.265861  4390 consensus_queue.cc:1243] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:10.269344  4390 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.269846  4390 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.198980  4323 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:10.273502  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 91142.5us
I20260709 13:01:10.275250  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:10.259944  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:10.273799  4417 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:10.183337  4452 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:01:10.189486  4036 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:01:10.293229  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 101629us
I20260709 13:01:10.183589  4385 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:01:10.305765  4416 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:10.306310  4416 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.306772  4416 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.295197  4166 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:10.310902  4392 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:10.292057  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.318287  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 154934us
W20260709 13:01:10.328925  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 124089us
I20260709 13:01:10.330518  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:10.317418  4454 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:10.366686  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 112479us
I20260709 13:01:10.322896  4027 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.350944  4454 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:10.392618  4435 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.006s
W20260709 13:01:10.413280  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 121348us
W20260709 13:01:10.412676  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 74181.9us
I20260709 13:01:10.421952  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.421885  4506 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.422158  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.422856  1619 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:10.413069  4454 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.428282  2260 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:10.429096  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.431852  4500 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.432075  4499 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:10.432503  4500 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.434248  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.436336  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.413905  4436 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.416291  4390 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.435837  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.453751  1614 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:10.466233  1620 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:10.467195  1616 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:10.466307  2259 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:10.441617  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:10.470542  1660 leader_election.cc:400] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6.
I20260709 13:01:10.477538  1660 leader_election.cc:403] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.478955  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:10.482575  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.483855  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.484848  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:10.485510  4499 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.475106  4423 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.443104  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.486240  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.486392  4423 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.487231  1687 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.488449  4422 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:10.488912  4423 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.489445  4423 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.487061  1615 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:10.489671  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.491848  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.492117  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:10.492408  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:10.493278  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.493361  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.485518  1618 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:10.485737  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:10.495239  1620 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.491001  4423 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.498099  4423 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.491963  4424 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.488927  4422 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:10.493299  4375 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:10.499198  4375 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:10.499627  4422 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.500444  4424 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.500110  4375 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.500698  4422 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.501303  4375 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.414335  4435 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.486240  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.504669  1614 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:10.498132  2261 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:10.509536  4235 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:10.511139  4435 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:10.513464  4504 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:01:10.439174  4036 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:10.539242  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 97805us
I20260709 13:01:10.541028  1621 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:10.475814  4502 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:10.544766  4385 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:10.546198  4452 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.556246  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.547132  4435 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:10.549677  4506 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.441738  4392 consensus_queue.cc:1243] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:10.538866  2258 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:01:10.558835  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 494492us
I20260709 13:01:10.510520  4395 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.514608  4275 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:10.560006  1622 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.568605  1620 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:10.569471  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.584043  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:10.558085  4417 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:10.589664  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.593708  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:10.563573  4385 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:10.539354  4436 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.570647  4235 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:10.596989  1587 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.596s (SENT)
I20260709 13:01:10.601600  1695 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:01:10.602386  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 271981us
I20260709 13:01:10.603250  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.569898  4275 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:10.612846  1661 connection.cc:256] RPC call timeout handler was delayed by -2.4333507640000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 13:01:10.613353  1661 connection.cc:256] RPC call timeout handler was delayed by -2.4135507639999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
W20260709 13:01:10.613819  1661 connection.cc:256] RPC call timeout handler was delayed by -2.3739507639999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:01:10.614180  1661 connection.cc:256] RPC call timeout handler was delayed by -2.351450763999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:01:10.614537  1661 connection.cc:256] RPC call timeout handler was delayed by -2.3217507640000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 13:01:10.614931  1661 connection.cc:256] RPC call timeout handler was delayed by -2.2893507640000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:01:10.615224  1661 connection.cc:256] RPC call timeout handler was delayed by -2.2326507640000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:01:10.615582  1661 connection.cc:256] RPC call timeout handler was delayed by -2.1552507640000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 13:01:10.615957  1661 connection.cc:256] RPC call timeout handler was delayed by -1.9644507639999915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:01:10.616308  1661 connection.cc:256] RPC call timeout handler was delayed by -1.9167507639999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22850000000000004s for a response
W20260709 13:01:10.616683  1661 connection.cc:256] RPC call timeout handler was delayed by -1.3974507639999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2862s for a response
W20260709 13:01:10.616986  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1733507640000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31110000000000004s for a response
W20260709 13:01:10.617352  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1661507640000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31190000000000007s for a response
W20260709 13:01:10.617723  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0383507639999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32610000000000006s for a response
I20260709 13:01:10.587091  4390 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.628947  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:10.631593  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.633615  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:10.592453  4429 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.636906  1696 raft_consensus.cc:2376] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:10.611964  4388 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:10.643730  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:10.643601  4388 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.644814  4235 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:10.647935  4275 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.607270  4416 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:10.650192  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.651530  4416 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:10.651849  4417 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.652415  4429 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.618786  4392 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:10.653610  4392 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.653987  4392 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:10.654683  4036 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:10.655277  4036 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:10.656229  4500 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.656292  4036 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.657047  4390 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.624547  4443 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:10.659222  4443 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:10.670770  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.623190  4423 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.677124  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.619083  4431 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:01:10.638926  4225 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:10.672504  4443 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:10.692978  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:10.691579  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 118770us
W20260709 13:01:10.695073  1587 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.624s (SENT)
I20260709 13:01:10.695518  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:10.688611  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:10.693813  1696 raft_consensus.cc:2376] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:10.703799  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:10.701438  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 101563us
I20260709 13:01:10.682339  4225 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:10.720774  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.721452  1691 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:10.723444  1695 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:10.725654  1620 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:10.726658  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:10.727692  4424 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:10.728117  4424 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.728418  1544 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:10.730160  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.681042  4423 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.726542  4454 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.738003  1696 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:01:10.741741  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.742910  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.737051  4275 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.746562  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.747324  1693 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:10.737241  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.724328  4431 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:01:10.899150  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.818305  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.819357  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:10.837342  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.914143  4517 log.cc:927] Time spent T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
I20260709 13:01:10.815486  4509 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:10.798810  4443 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.914875  4454 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.914891  4509 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:10.917336  4509 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:10.919083  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.883489  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.815793  4505 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.280s
W20260709 13:01:10.769073  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.728699  4507 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:10.887020  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:10.920828  2263 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.001s
I20260709 13:01:10.931051  2263 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:10.728963  4235 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:10.817492  1544 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:10.921681  1689 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:10.922822  4225 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:10.924749  4423 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:10.911474  4518 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:01:10.819028  4516 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:01:10.755756  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.937955  4527 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.939211  1546 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:10.811975  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.937351  1542 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:10.884029  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.778875  1691 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:10.806205  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 111118us
I20260709 13:01:10.930114  1693 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:10.850977  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.728439  4424 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:10.909611  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 180073us
I20260709 13:01:10.748068  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.932476  1687 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:10.933106  4507 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.751897  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.798903  2231 leader_election.cc:400] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8.
I20260709 13:01:10.945173  1692 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:10.938478  4527 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:10.963739  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:10.964401  1687 raft_consensus.cc:2376] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6. Re-sending same reply.
W20260709 13:01:10.965198  1587 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.633s (SENT)
I20260709 13:01:10.966389  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:10.971884  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:10.972441  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.946420  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.946332  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.973869  1689 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:10.871342  4436 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.935765  4416 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:10.972112  1547 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:10.952548  4233 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.953508  1688 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:10.954099  4434 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:10.981386  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.984248  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.911067  4388 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:10.886646  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.821897  4390 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:10.754784  4521 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:10.961217  1690 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:10.966892  4507 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.975271  1691 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:10.976132  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.976790  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.978607  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:10.980203  1694 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:10.985152  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.987515  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.987669  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:11.002393  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.988025  1538 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:10.990564  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:10.974103  4447 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.970s	user 0.008s	sys 0.008s
I20260709 13:01:11.056692  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:10.992128  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:11.003736  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.058477  1618 raft_consensus.cc:2410] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:11.058858  1689 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:01:11.058050  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55834us
I20260709 13:01:10.994047  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:11.056458  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 301134us
I20260709 13:01:10.997361  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.060510  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:11.004195  1693 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:10.994249  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:10.997561  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:10.994375  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48590us
I20260709 13:01:10.994575  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.127194  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.095072  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.989430  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2210) took 1150 ms. Trace:
I20260709 13:01:11.075129  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.000198  1622 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:11.136194  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.137049  1538 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:11.139089  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:10.986888  4499 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6.
I20260709 13:01:10.987834  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.142872  1620 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:11.135619  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 75197.2us
W20260709 13:01:11.075384  1512 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.627s (SENT)
I20260709 13:01:11.102064  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:11.061872  1690 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:11.141116  1692 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.141713  1618 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:11.153463  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.154922  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.155123  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.155591  1616 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:10.992172  4527 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:11.065374  4375 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.004s
I20260709 13:01:11.155241  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.164218  1543 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:11.162274  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 86951.8us
I20260709 13:01:11.165122  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.162413  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:11.165958  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.156198  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.174397  1622 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.166630  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 88183.6us
I20260709 13:01:11.162832  1618 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.162408  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.133841  1540 rpcz_store.cc:276] 0709 13:01:09.838882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:09.850705 (+ 11823us) service_pool.cc:224] Handling call
0709 13:01:09.851073 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:09.865748 (+ 14675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:09.865783 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:10.445013 (+579230us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b2c00000658. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:01:10.480381 (+ 35368us) log.cc:844] Serialized 52 byte log entry
0709 13:01:10.586033 (+105652us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:10.732647 (+146614us) log.cc:844] Serialized 14 byte log entry
0709 13:01:10.732850 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:10.732921 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:10.981938 (+249017us) raft_consensus.cc:1685] finished
0709 13:01:10.989234 (+  7296us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:10.989373 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13874,"prepare.queue_time_us":360825,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":81164,"raft.run_cpu_time_us":470,"raft.run_wall_time_us":79265,"spinlock_wait_cycles":13805952,"thread_start_us":227916,"threads_started":2,"wal-append.queue_time_us":196474}
I20260709 13:01:11.175732  1621 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:10.987634  4434 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:11.184934  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.185791  1693 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.169523  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.171408  1687 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:11.174484  1512 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.630s (SENT)
I20260709 13:01:10.996258  4315 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.173591  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.189921  1546 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:11.183554  1613 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:10.990777  4435 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.184602  1540 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:11.190060  1691 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.175370  1618 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:11.193408  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 194955us
W20260709 13:01:11.200176  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 45019.3us
I20260709 13:01:11.003214  4416 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.207454  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.155766  4512 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.209692  1543 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:11.210896  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.218516  1693 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.065805  4447 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.214184  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.212422  1690 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:11.216498  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.210237  1538 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:11.223428  1687 raft_consensus.cc:2376] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7. Re-sending same reply.
I20260709 13:01:11.226872  1540 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:11.229815  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:11.185439  4434 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:11.234879  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 60448.5us
I20260709 13:01:11.203058  4499 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:10.994879  4392 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:11.244055  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.249188  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.249930  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.244791  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:11.245440  1544 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.247071  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 113057us
I20260709 13:01:11.248445  1540 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:11.217345  4512 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.252143  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.253410  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.254195  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.255169  1617 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:11.191666  4527 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:11.203671  4435 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:11.254333  1587 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.745s (SENT)
I20260709 13:01:11.243245  1618 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.260878  1618 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.261480  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:11.264994  1540 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:11.271915  1691 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.264313  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.299283  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.299810  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.300496  1691 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:11.300951  1545 raft_consensus.cc:2368] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6.
I20260709 13:01:11.252588  4390 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:11.309121  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:11.256356  4512 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.315670  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.257841  4434 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:11.310165  4531 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:01:11.317390  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.308794  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:11.316059  1687 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:11.324693  1540 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:11.326660  1692 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:11.292073  4521 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.329555  1538 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:01:11.331451  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 77143.5us
I20260709 13:01:11.334141  1544 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:11.334828  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.335695  1691 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:11.330687  1543 raft_consensus.cc:2376] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7. Re-sending same reply.
W20260709 13:01:11.356365  1587 leader_election.cc:336] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.800s (SENT)
I20260709 13:01:11.356833  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.358896  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.359611  1687 raft_consensus.cc:2368] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:11.361083  1694 raft_consensus.cc:2376] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:11.363891  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.365131  1540 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:11.369787  1690 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.371058  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:11.353658  4395 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.000s
W20260709 13:01:11.373863  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 125275us
I20260709 13:01:11.375182  1538 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.341288  4509 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:11.342420  4534 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.376123  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.379436  1691 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 5: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.339793  4390 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:11.386726  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.394749  4384 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:11.395206  4388 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.396023  4388 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:11.397030  1616 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:01:11.398216  4388 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:11.395258  4384 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:11.399184  4384 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.400251  4384 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:11.403380  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.404502  1619 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:11.404615  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.405229  1695 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:11.405866  1619 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:11.405987  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.407389  4385 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:11.411135  4385 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:11.412120  4522 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.412051  4385 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:11.412578  4522 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:11.413131  4385 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.413566  4522 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.413961  4514 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:01:11.407684  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.406594  1695 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:11.416733  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.417488  1695 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.417009  1442 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:11.418257  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:11.420581  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.421379  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.419384  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.423127  1695 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.423885  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.424399  1695 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:11.424490  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 432) took 3215 ms (client timeout 2209 ms). Trace:
W20260709 13:01:11.424943  2258 rpcz_store.cc:269] 0709 13:01:08.209482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:08.217442 (+  7960us) service_pool.cc:224] Handling call
0709 13:01:11.424236 (+3206794us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400574254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:11.424408 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3889018752}
W20260709 13:01:11.425644  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.426275  4499 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.428890  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.412623  4447 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:11.403286  4036 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:11.433607  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 43496.7us
W20260709 13:01:11.434222  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.425191  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:11.742456  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.801923  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:11.581598  1696 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.635s	user 0.007s	sys 0.002s
I20260709 13:01:11.539465  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.535398  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.808941  1691 raft_consensus.cc:2376] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9. Re-sending same reply.
I20260709 13:01:11.809577  1694 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:11.809839  1695 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:11.562749  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:11.496590  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.810902  1538 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:11.811556  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.442410  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:11.812165  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.563131  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.674037  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:11.813474  1543 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:11.676631  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.813810  1539 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.539551  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.707875  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 497) took 1270 ms. Trace:
I20260709 13:01:11.814926  1687 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.806725  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 576985us
I20260709 13:01:11.697079  1618 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:01:11.806991  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 266426us
I20260709 13:01:11.816277  1618 pending_rounds.cc:85] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:01:11.696491  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.808629  1696 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:11.817126  1692 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
W20260709 13:01:11.817344  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.678365  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2139) took 1138 ms. Trace:
I20260709 13:01:11.817958  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1449) took 1066 ms. Trace:
W20260709 13:01:11.723132  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.821285  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.812721  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.818291  1688 rpcz_store.cc:276] 0709 13:01:10.540003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.540154 (+   151us) service_pool.cc:224] Handling call
0709 13:01:11.678104 (+1137950us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400002154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:11.678262 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856069504}
W20260709 13:01:11.822274  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.820688  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.822901  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.819344  1690 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.825029  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1462) took 1070 ms. Trace:
W20260709 13:01:11.523767  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49974.5us
I20260709 13:01:11.815286  1617 rpcz_store.cc:276] 0709 13:01:10.437510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.437619 (+   109us) service_pool.cc:224] Handling call
0709 13:01:10.456696 (+ 19077us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.255641 (+798945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.707564 (+451923us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54002b66d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:11.707774 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835929344}
I20260709 13:01:11.377822  4509 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.820320  1696 rpcz_store.cc:276] 0709 13:01:10.751236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.799355 (+ 48119us) service_pool.cc:224] Handling call
0709 13:01:11.817907 (+1018552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1720576}
W20260709 13:01:11.833937  1587 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.820s (SENT)
I20260709 13:01:11.644878  1693 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:11.842639  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:11.616613  1622 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.371429  4528 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:11.835213  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:11.543574  4507 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:01:11.862636  2263 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:11.860513  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:11.866721  1613 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.847908  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:11.694844  4539 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
W20260709 13:01:11.808069  1585 leader_election.cc:336] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.709s (SENT)
I20260709 13:01:11.825426  1690 rpcz_store.cc:276] 0709 13:01:10.754546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.379028 (+624482us) service_pool.cc:224] Handling call
0709 13:01:11.824973 (+445945us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:11.872165  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:11.873914  1512 leader_election.cc:336] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.667s (SENT)
W20260709 13:01:11.855576  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2854056689999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4425s for a response
W20260709 13:01:11.699942  4315 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.503s	user 0.002s	sys 0.008s
I20260709 13:01:11.413556  4225 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.816749  1618 pending_rounds.cc:107] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:11.883287  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.525051  1442 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 5, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.883384  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.884105  1691 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:11.884238  1694 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:01:11.544668  4424 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:01:11.831796  4388 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:11.860440  1616 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:11.891268  1616 pending_rounds.cc:85] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:01:11.891525  1616 pending_rounds.cc:107] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:11.891769  1616 raft_consensus.cc:2889] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.860642  4267 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:11.895227  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.895896  1690 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:11.896843  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.376820  4521 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:11.697363  4323 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.677619  4431 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.560578  4512 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:11.907940  4417 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:11.905207  4323 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:11.908874  1689 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.910012  4267 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:11.910100  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.910495  4267 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:11.910950  1621 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:11.911111  1442 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 7, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.911433  4267 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.912293  1621 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:11.913039  4267 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.913264  4546 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:11.912920  1442 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 8, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:11.532256  4533 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:01:11.914687  4546 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:11.915118  4546 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:11.875089  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.823738  4522 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.916025  4546 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.916754  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:11.917693  4384 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:11.918110  4384 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.441833  4452 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.918546  4384 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:11.919008  4452 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:11.919696  4385 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.000s
I20260709 13:01:11.920217  4546 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.921339  4452 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:11.885514  4506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.286s	user 0.029s	sys 0.032s
W20260709 13:01:11.922865  4506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.030s	sys 0.032s
I20260709 13:01:11.880398  1539 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:11.861855  4507 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:11.924569  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.881304  1687 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.883035  1547 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:11.883566  1618 raft_consensus.cc:2889] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.547821  4416 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:11.741659  4429 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:11.464994  4233 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:11.946238  4233 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:11.946707  4233 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.942749  4166 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.947540  4166 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:11.894896  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:11.820437  4443 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:11.885478  1544 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:11.387872  4534 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.887562  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:11.883061  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:11.964156  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 151601us
I20260709 13:01:11.564890  4392 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:11.526788  4535 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.852322  4509 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:11.894431  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 86404.5us
I20260709 13:01:11.971972  2231 leader_election.cc:400] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
I20260709 13:01:11.972347  2231 leader_election.cc:403] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:11.972384  1585 leader_election.cc:336] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 2.007s (SENT)
I20260709 13:01:11.851523  4036 consensus_queue.cc:1243] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:11.899694  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.563898  4435 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:11.900599  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.978554  1692 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:11.901559  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:11.979863  1538 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:11.905205  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.897583  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1457) took 1144 ms. Trace:
I20260709 13:01:11.981231  1690 rpcz_store.cc:276] 0709 13:01:10.753329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.896533 (+1143204us) service_pool.cc:224] Handling call
0709 13:01:11.897527 (+   994us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:11.878552  4235 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.931s	user 0.012s	sys 0.000s
I20260709 13:01:11.907189  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:11.907645  2264 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:11.908154  4431 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:11.874714  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:11.925237  1694 raft_consensus.cc:2376] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
I20260709 13:01:11.925956  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1456) took 1172 ms. Trace:
I20260709 13:01:11.903620  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:11.993361  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89875us
I20260709 13:01:11.994303  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:11.929165  1442 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 4, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:11.911424  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:11.939128  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:11.997877  2259 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:11.983318  1585 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.942516  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1743) took 1118 ms. Trace:
I20260709 13:01:11.992542  1687 rpcz_store.cc:276] 0709 13:01:10.753053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.431012 (+677959us) service_pool.cc:224] Handling call
0709 13:01:11.925883 (+494871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103296}
I20260709 13:01:11.998587  1539 rpcz_store.cc:276] 0709 13:01:10.805590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.806111 (+   521us) service_pool.cc:224] Handling call
0709 13:01:11.673868 (+867757us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800002a98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5eee 0000000000375939 00007f7f1f8291e0 00007f7f1f8f20c4 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:01:11.924087 (+250219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592896}
I20260709 13:01:11.885967  4423 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:11.879520  4447 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:01:11.886027  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.006013  1587 leader_election.cc:336] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.995s (SENT)
I20260709 13:01:12.006472  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:11.966300  1691 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:11.967944  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2156) took 1044 ms. Trace:
I20260709 13:01:12.007602  1689 rpcz_store.cc:276] 0709 13:01:10.923969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.140296 (+216327us) service_pool.cc:224] Handling call
0709 13:01:11.967740 (+827444us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54001f77d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:11.967884 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686310656}
I20260709 13:01:11.910892  4512 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:11.982944  1541 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:11.989547  1695 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:11.990047  1693 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:11.972770  4388 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:11.990830  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1758) took 1100 ms. Trace:
I20260709 13:01:12.012187  1547 rpcz_store.cc:276] 0709 13:01:10.890004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.995712 (+105708us) service_pool.cc:224] Handling call
0709 13:01:11.988487 (+992775us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54000479d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:11.990743 (+  2256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1722608512}
W20260709 13:01:11.969094  4451 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:01:11.995148  1696 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:12.014578  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1470) took 1060 ms. Trace:
I20260709 13:01:11.940786  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.014935  1696 rpcz_store.cc:276] 0709 13:01:10.953833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.972957 (+1019124us) service_pool.cc:224] Handling call
0709 13:01:12.014520 (+ 41563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:11.999753  1687 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:12.015867  1689 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:01:12.014330  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51992us
I20260709 13:01:12.016187  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1467) took 1166 ms. Trace:
I20260709 13:01:12.016593  1687 rpcz_store.cc:276] 0709 13:01:10.849829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.999264 (+1149435us) service_pool.cc:224] Handling call
0709 13:01:11.999538 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.015941 (+ 16403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.016135 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:11.899597  4424 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:12.000218  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:12.015497  1543 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:12.021958  1692 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:11.548672  4390 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:11.961440  4436 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:12.003328  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:12.011529  2258 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:12.014345  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:12.044301  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1461) took 1290 ms. Trace:
I20260709 13:01:11.994437  4235 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:12.020054  1442 catalog_manager.cc:5697] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.023849  1693 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:12.050009  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2163) took 1124 ms. Trace:
I20260709 13:01:12.024034  1695 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:12.025974  1691 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [3.2-7.4]
I20260709 13:01:12.031414  1692 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:12.051247  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2159) took 1126 ms. Trace:
I20260709 13:01:12.051354  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2164) took 1125 ms. Trace:
I20260709 13:01:12.014046  4388 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.038861  4392 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:12.013700  4315 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:12.046761  1540 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:12.048547  1687 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 13:01:12.024813  4524 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
I20260709 13:01:12.051571  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2166) took 1122 ms. Trace:
I20260709 13:01:12.023061  4435 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.044644  1694 rpcz_store.cc:276] 0709 13:01:10.754301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.001910 (+1247609us) service_pool.cc:224] Handling call
0709 13:01:12.044240 (+ 42330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.030747  4447 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.051626  1695 rpcz_store.cc:276] 0709 13:01:10.924845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.009775 (+1084930us) service_pool.cc:224] Handling call
0709 13:01:12.023697 (+ 13922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.050997 (+ 27300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.051192 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17792}
W20260709 13:01:12.052732  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 80383.4us
W20260709 13:01:12.103688  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.103926  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2168) took 1156 ms. Trace:
W20260709 13:01:12.053776  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47801.4us
I20260709 13:01:12.015547  4423 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:12.050350  1693 rpcz_store.cc:276] 0709 13:01:10.925968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.010412 (+1084444us) service_pool.cc:224] Handling call
0709 13:01:12.023631 (+ 13219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.049682 (+ 26051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.049952 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:12.060768  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.024s	sys 0.057s
W20260709 13:01:12.112999  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.024s	sys 0.057s
W20260709 13:01:12.074775  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51755.3us
I20260709 13:01:12.114199  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.115715  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:11.989228  4535 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.094774  1442 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 5, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.051719  1691 rpcz_store.cc:276] 0709 13:01:10.926222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.013891 (+1087669us) service_pool.cc:224] Handling call
0709 13:01:12.016722 (+  2831us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:12.051098 (+ 34376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.051293 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.104460  1687 rpcz_store.cc:276] 0709 13:01:10.947380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.024659 (+1077279us) service_pool.cc:224] Handling call
0709 13:01:12.048184 (+ 23525us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:12.100169 (+ 51985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.103856 (+  3687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.101652  1692 rpcz_store.cc:276] 0709 13:01:10.929224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.022716 (+1093492us) service_pool.cc:224] Handling call
0709 13:01:12.023058 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.051260 (+ 28202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.051504 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.105552  1690 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:12.121986  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1469) took 1168 ms. Trace:
I20260709 13:01:12.099540  1613 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:12.122433  1690 rpcz_store.cc:276] 0709 13:01:10.953396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.043470 (+1090074us) service_pool.cc:224] Handling call
0709 13:01:12.100813 (+ 57343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.121653 (+ 20840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.121917 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.110706  2259 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:12.019513  4505 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:01:12.117063  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:12.076174  4388 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:12.124982  1585 leader_election.cc:336] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.769s (SENT)
W20260709 13:01:12.096947  4537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.011s	sys 0.024s
W20260709 13:01:12.174995  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 62580.1us
I20260709 13:01:12.175467  1693 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:12.140798  1442 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.168655  1694 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:12.040184  4548 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
W20260709 13:01:12.169870  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52840.4us
I20260709 13:01:12.183724  1694 pending_rounds.cc:85] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 3
I20260709 13:01:12.186872  1687 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:12.159479  1659 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:12.046013  4436 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.100279  4036 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:12.196919  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55663.9us
I20260709 13:01:12.200671  1442 catalog_manager.cc:5697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:01:12.173338  4537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.012s	sys 0.024s
I20260709 13:01:12.198642  1694 pending_rounds.cc:107] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:12.198602  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.139770  4532 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:12.203084  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.205005  1694 raft_consensus.cc:2889] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:12.118480  4315 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:12.187047  4544 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:01:12.211632  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.214043  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 338989us
W20260709 13:01:12.213537  1585 leader_election.cc:336] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.933s (SENT)
W20260709 13:01:12.216414  1585 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.976s (SENT)
I20260709 13:01:12.196851  4429 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:12.220733  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1479) took 1242 ms. Trace:
I20260709 13:01:12.221140  1694 rpcz_store.cc:276] 0709 13:01:10.978744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.102848 (+1124104us) service_pool.cc:224] Handling call
0709 13:01:12.139784 (+ 36936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.220488 (+ 80704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.220679 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:12.224498  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:12.225737  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.169121  4506 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:01:12.168579  4375 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:01:12.207090  4532 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.226647  1442 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.217504  4385 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.217907  4524 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:12.217712  4435 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.250481  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.171701  4431 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.253793  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:12.220880  4429 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:12.237440  4543 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:01:12.231063  4507 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:12.258839  1587 leader_election.cc:400] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:12.272079  1587 leader_election.cc:403] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:12.219676  4447 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:12.240792  4532 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:12.236202  4522 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:12.273607  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 399743us
W20260709 13:01:12.281633  1512 leader_election.cc:336] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.828s (SENT)
I20260709 13:01:12.282330  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:12.237259  4541 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:12.268841  4429 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:12.269891  4225 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.269373  4537 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:12.289227  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:12.303362  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44738.8us
W20260709 13:01:12.317126  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.317732  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 469896us
I20260709 13:01:12.318676  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:12.276161  4534 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:12.320865  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1762) took 1329 ms. Trace:
I20260709 13:01:12.258211  4385 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.257256  4435 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:12.274477  4452 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:12.281165  4522 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:12.321768  4505 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:12.325204  1546 rpcz_store.cc:276] 0709 13:01:10.991158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.195602 (+204444us) service_pool.cc:224] Handling call
0709 13:01:11.221111 (+ 25509us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:11.230751 (+  9640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.230821 (+    70us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:11.254876 (+ 24055us) log.cc:844] Serialized 78 byte log entry
0709 13:01:11.671029 (+416153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:12.059021 (+387992us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.311913 (+252892us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.313059 (+  1146us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.320534 (+  7475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.320610 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.320651 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:12.320661 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.320810 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48568,"prepare.queue_time_us":563993,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1767,"raft.queue_time_us":166720,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":29330,"thread_start_us":712723,"threads_started":3,"wal-append.queue_time_us":612397}
I20260709 13:01:12.326229  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:12.339325  4235 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:01:12.380798  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76965.6us
I20260709 13:01:12.283336  4542 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:01:12.343041  4431 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.243705  4423 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.382148  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2155) took 1458 ms. Trace:
I20260709 13:01:12.345337  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.325887  1442 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 5, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:12.396750  1585 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.925s (SENT)
I20260709 13:01:12.325387  4225 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:12.310487  4424 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:12.437697  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1409) took 1375 ms. Trace:
W20260709 13:01:12.428702  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 114966us
I20260709 13:01:12.339098  4166 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:12.430094  1512 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.561s (SENT)
I20260709 13:01:12.315306  4528 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:01:12.365084  4522 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.434777  1689 rpcz_store.cc:276] 0709 13:01:10.923708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.008442 (+1084734us) service_pool.cc:224] Handling call
0709 13:01:12.010643 (+  2201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.016214 (+  5571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.381886 (+365672us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b54000b3bd0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:12.382076 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4136320}
W20260709 13:01:12.435338  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.435626  1442 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:12.435457  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 276076us
I20260709 13:01:12.462822  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:12.431690  4544 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:12.455593  1614 rpcz_store.cc:276] 0709 13:01:11.062476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.205287 (+142811us) service_pool.cc:224] Handling call
0709 13:01:11.205789 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.227989 (+ 22200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.228037 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.256693 (+ 28656us) log.cc:844] Serialized 26 byte log entry
0709 13:01:11.387933 (+131240us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:11.387984 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:11.388047 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.437493 (+1049446us) raft_consensus.cc:1685] finished
0709 13:01:12.437513 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.437644 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21232,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5620,"thread_start_us":64583,"threads_started":1,"wal-append.queue_time_us":81313}
W20260709 13:01:12.492146  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62097.8us
W20260709 13:01:12.487828  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.487756  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.504726  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.303488  4315 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:12.504914  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47058.7us
I20260709 13:01:12.505820  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:12.506764  4560 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.508212  4225 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.445066  4535 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:12.514962  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:12.453310  4506 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:12.516747  1442 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:01:12.521143  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 194852us
W20260709 13:01:12.521942  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.540650  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.541138  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.530376  1539 raft_consensus.cc:2376] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
W20260709 13:01:12.536710  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.485503  4499 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:12.553207  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 234671us
W20260709 13:01:12.569103  1587 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.085s (SENT)
I20260709 13:01:12.555311  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.557667  1540 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [4.4-6.5]
W20260709 13:01:12.614280  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.617822  1442 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 2 to 4, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:12.626823  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.636312  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.636683  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.493543  4559 raft_consensus.cc:2764] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:12.637681  1538 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:12.636538  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.637104  1547 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:12.641081  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:12.642411  2231 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.645404  2262 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a0c52190de849839b129a0fa6099693"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:51160
I20260709 13:01:12.646216  2262 raft_consensus.cc:606] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:12.646552  2262 raft_consensus.cc:614] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.648036  4510 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:12.648501  4510 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:12.649338  4510 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:12.651335  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:12.638288  1545 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:12.434650  4547 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.304s
W20260709 13:01:12.663329  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 109459us
W20260709 13:01:12.668853  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 99807.2us
I20260709 13:01:12.670200  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:12.528899  4436 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:12.677973  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.672756  1540 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7. Re-sending same reply.
I20260709 13:01:12.677992  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:12.650506  4510 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:12.685792  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:12.685817  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:12.689258  4544 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:01:12.642428  4506 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:12.717898  1547 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:12.695195  4472 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:12.721401  4267 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.002s
I20260709 13:01:12.701495  4559 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:12.771066  4385 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:12.794581  4556 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:12.773976  4499 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:12.775664  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:12.826819  1689 raft_consensus.cc:606] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:12.827315  1689 raft_consensus.cc:614] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.776145  4532 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.776388  4472 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:12.721347  4578 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:12.690725  4521 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:12.855762  4565 log.cc:927] Time spent T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:01:12.855491  4521 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:12.857057  4499 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.857818  4521 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:12.858686  4385 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.859229  4385 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:12.727661  4384 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.002s
I20260709 13:01:12.741792  4323 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:12.782074  4550 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260709 13:01:12.715507  4560 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:12.789155  4549 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:01:12.801740  4546 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.881s	user 0.004s	sys 0.006s
I20260709 13:01:12.721689  4580 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:12.727847  4512 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:12.802855  4233 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.856s	user 0.010s	sys 0.001s
I20260709 13:01:12.803212  4559 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.803529  4506 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:12.804657  4435 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:12.822381  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 157115us
W20260709 13:01:12.773697  4509 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.001s
I20260709 13:01:12.830078  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 456) took 1021 ms. Trace:
I20260709 13:01:12.852638  1544 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:12.809607  4522 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.861454  4541 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.878611  2257 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
W20260709 13:01:12.880184  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.900092  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.913023  4580 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:13.170892  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1745) took 2354 ms (client timeout 1871 ms). Trace:
W20260709 13:01:13.296224  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.296118  1541 rpcz_store.cc:269] 0709 13:01:10.817152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:10.818727 (+  1575us) service_pool.cc:224] Handling call
0709 13:01:13.170581 (+2351854us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540003b954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:13.170777 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2440148224}
W20260709 13:01:13.172077  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.152482  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.004s	sys 0.006s
W20260709 13:01:13.297725  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.292966  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 650636us
I20260709 13:01:12.921914  1691 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:01:13.294658  2261 rpcz_store.cc:276] 0709 13:01:11.808207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.808341 (+   134us) service_pool.cc:224] Handling call
0709 13:01:11.808657 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:11.855223 (+ 46566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.855267 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:11.864006 (+  8739us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.207021 (+343015us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.207056 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.207124 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:12.829844 (+622720us) raft_consensus.cc:1685] finished
0709 13:01:12.829864 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:12.830017 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7700,"raft.queue_time_us":31344,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":26805,"spinlock_wait_cycles":770816,"thread_start_us":324104,"threads_started":1,"wal-append.queue_time_us":872588}
W20260709 13:01:13.072352  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 512777us
I20260709 13:01:13.312310  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1495) took 1752 ms. Trace:
I20260709 13:01:13.133615  4532 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:13.123836  4472 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.300314  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:13.293147  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 146713us
I20260709 13:01:13.115103  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:13.300796  4541 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:13.315692  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.009s	sys 0.011s
I20260709 13:01:13.105466  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2165) took 2179 ms. Trace:
I20260709 13:01:13.315367  1689 raft_consensus.cc:606] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.316905  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1480) took 2318 ms. Trace:
I20260709 13:01:13.317217  1689 raft_consensus.cc:614] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.872694  4384 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:12.921191  4512 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.317546  1695 rpcz_store.cc:276] 0709 13:01:10.999005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.103442 (+1104437us) service_pool.cc:224] Handling call
0709 13:01:12.158918 (+ 55476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.197536 (+ 38618us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:12.362283 (+164747us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.316319 (+954036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.316426 (+   107us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:13.316493 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.316719 (+   226us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.316854 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":506139,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":992523,"threads_started":2}
I20260709 13:01:13.319203  4384 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:13.319576  4512 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:13.315119  4585 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.316704  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:13.159929  4388 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.974s	user 0.010s	sys 0.003s
I20260709 13:01:13.320595  1620 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.320667  4388 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.316448  1696 rpcz_store.cc:276] 0709 13:01:10.926478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.015671 (+1089193us) service_pool.cc:224] Handling call
0709 13:01:12.023089 (+  7418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.077482 (+ 54393us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:12.346090 (+268608us) log.cc:844] Serialized 14 byte log entry
0709 13:01:12.719602 (+373512us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.826580 (+106978us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.061961 (+235381us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:13.062017 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.062115 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.105219 (+ 43104us) raft_consensus.cc:1685] finished
0709 13:01:13.105260 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.105401 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3681,"prepare.queue_time_us":563909,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":455293,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":24694,"spinlock_wait_cycles":42624,"thread_start_us":502648,"threads_started":2,"wal-append.queue_time_us":492653}
I20260709 13:01:13.298146  4510 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:13.322922  4388 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:13.322964  4510 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.323549  4541 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.325083  4510 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.326220  2231 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.312753  1691 rpcz_store.cc:276] 0709 13:01:11.560190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.140144 (+579954us) service_pool.cc:224] Handling call
0709 13:01:12.879654 (+739510us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:12.879946 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.312036 (+432090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.312257 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61445888}
I20260709 13:01:13.331967  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:13.333017  1695 raft_consensus.cc:606] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.331634  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.315177  4423 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.042938  4233 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.337412  2264 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:13.305323  4556 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:13.064594  4429 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.723s	user 0.028s	sys 0.044s
I20260709 13:01:13.333609  1695 raft_consensus.cc:614] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:13.328234  1620 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:13.335306  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:13.117257  4443 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.166s	user 0.011s	sys 0.000s
I20260709 13:01:13.338037  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.382040  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.155614  4385 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.383117  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.390345  1614 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:13.042838  4323 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.388945  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.388949  1695 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:13.298173  4559 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.340416  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.392320  1692 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:13.305467  4499 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.390749  1689 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:13.395083  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.403403  1613 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:13.400050  1691 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:13.410074  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.410158  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.410989  1687 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:13.411448  1696 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:13.412564  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.413291  1693 raft_consensus.cc:2376] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:13.415710  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.422335  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.422732  2258 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 457) took 1591 ms. Trace:
I20260709 13:01:13.423061  1694 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:13.423079  2258 rpcz_store.cc:276] 0709 13:01:11.831725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.863853 (+ 32128us) service_pool.cc:224] Handling call
0709 13:01:13.415684 (+1551831us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b54003a4654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:13.422668 (+  6984us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142911744}
I20260709 13:01:13.424623  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.431828  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.434306  1614 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:13.341564  4541 raft_consensus.cc:2764] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:13.390398  4527 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.435184  1620 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:13.305717  4509 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:13.437665  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 106545us
I20260709 13:01:13.334575  4225 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:01:13.446488  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 106167us
I20260709 13:01:13.373873  4436 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:01:13.453240  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:13.453891  1687 raft_consensus.cc:606] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:13.431207  4575 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.395141  4510 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:01:13.338755  4521 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:01:12.920855  4560 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.391275  4556 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.341344  4423 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.339116  4581 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:01:13.402398  4429 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.444783  4385 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:13.468302  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.463402  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:13.458776  4575 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.468078  4589 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.485674  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.487747  2260 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.456305  4527 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.486577  1620 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:13.494148  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.490382  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.483494  1690 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7. Re-sending same reply.
I20260709 13:01:13.482890  4575 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.533812  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.483994  4472 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.539353  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:13.542223  1687 raft_consensus.cc:606] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.487385  4588 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:13.542601  1687 raft_consensus.cc:614] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:13.481911  4385 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:13.530778  4553 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:13.479311  4559 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:01:13.503153  4388 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.543756  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.591472  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:13.491930  4570 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.504170  4443 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 13:01:13.599275  4596 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:01:13.600169  4385 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.541815  4436 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.601511  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:13.602910  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59231.1us
I20260709 13:01:13.604727  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.487645  4589 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.609098  2265 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:01:13.612277  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.613526  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.613637  2266 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:13.614990  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:13.615419  4509 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:13.616645  4603 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:01:13.617714  4598 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:01:13.618784  4606 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:01:13.619442  4423 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.620162  4566 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.620571  4429 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.620671  4566 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.591316  4390 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.627774  1687 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:13.627952  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1761) took 2637 ms. Trace:
W20260709 13:01:13.600244  4593 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:01:13.591085  4233 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.589809  4588 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:13.630577  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.622535  2266 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
W20260709 13:01:13.630282  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 147408us
I20260709 13:01:13.628362  1542 rpcz_store.cc:276] 0709 13:01:10.990823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.194521 (+203698us) service_pool.cc:224] Handling call
0709 13:01:11.215967 (+ 21446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:11.247791 (+ 31824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:11.247840 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:11.300790 (+ 52950us) log.cc:844] Serialized 52 byte log entry
0709 13:01:12.113530 (+812740us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:12.369518 (+255988us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.265952 (+896434us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b1800492d60. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:13.611875 (+345923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.611949 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.611989 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:13.627718 (+ 15729us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.627887 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1242062,"prepare.queue_time_us":173575,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":1255162,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":5226,"spinlock_wait_cycles":32841984,"thread_start_us":950881,"threads_started":2,"wal-append.queue_time_us":968307}
I20260709 13:01:13.604744  4570 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.634778  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:13.639945  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.640476  2265 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:13.591876  4587 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.610113  4585 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:13.639472  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.639712  4602 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:01:13.613390  4522 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.622740  4235 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:13.651511  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.615419  4556 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:13.652912  1695 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:13.630290  4541 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:13.629992  4390 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.658531  2265 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:13.635075  4580 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.643226  4570 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.637848  4510 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:13.662649  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.652344  4585 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.664985  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:13.642535  4388 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.663204  2266 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 3 LEARNER]: Advancing to term 5
I20260709 13:01:13.668704  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.669350  1691 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:13.642880  4566 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.647516  4417 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.657932  4315 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.674532  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.629877  4609 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:13.657776  4587 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:13.669936  4521 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:13.680312  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.663565  4581 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.670979  4390 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.663739  4541 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:13.739804  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.740383  1690 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.740258  4541 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.741547  4541 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.688421  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.742872  4452 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:13.743129  1695 raft_consensus.cc:2376] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
I20260709 13:01:13.743721  2266 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:13.743968  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.675132  4585 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:13.744701  1695 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:13.745059  2264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 689) took 1241 ms. Trace:
I20260709 13:01:13.745528  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.746210  1695 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:13.678112  4522 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.746474  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.718899  4417 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.723376  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:13.724745  4591 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
I20260709 13:01:13.724982  4610 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:13.725543   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:01:13.725912  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.746811  4522 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:13.758144  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.758363  4522 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.690841  4588 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.726892  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:13.769327  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 100723us
I20260709 13:01:13.770052  2259 raft_consensus.cc:2410] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:01:13.727449  4595 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:01:13.752400  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2233) took 1241 ms. Trace:
W20260709 13:01:13.728271  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1496) took 2167 ms (client timeout 1776 ms). Trace:
W20260709 13:01:13.728471  4612 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:13.729012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.776307  1540 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:13.730072  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.774760  1546 rpcz_store.cc:276] 0709 13:01:12.511005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.511161 (+   156us) service_pool.cc:224] Handling call
0709 13:01:12.511502 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.638886 (+1127384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.638916 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.652247 (+ 13331us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.715145 (+ 62898us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:13.715206 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.715308 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.752099 (+ 36791us) raft_consensus.cc:1685] finished
0709 13:01:13.752117 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.752343 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1145789,"raft.queue_time_us":1134683,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":1243,"thread_start_us":36383,"threads_started":1,"wal-append.queue_time_us":44613}
I20260709 13:01:13.730937  4424 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.731146  4613 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.777130  4613 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.777745  4613 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.724840  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 463) took 1507 ms. Trace:
I20260709 13:01:13.728426  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:13.732824  4573 log.cc:927] Time spent T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.934s	user 0.006s	sys 0.009s
I20260709 13:01:13.733521  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 504) took 1911 ms. Trace:
I20260709 13:01:13.678727  4510 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.735942  4235 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.736667  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:13.792794  1689 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:13.737170  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.738595  4443 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.743958  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:13.721627  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49496.8us
I20260709 13:01:13.746587  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:13.716192  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:13.745391  2264 rpcz_store.cc:276] 0709 13:01:12.503621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.504773 (+  1152us) service_pool.cc:224] Handling call
0709 13:01:12.551250 (+ 46477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.337859 (+786609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.744852 (+406993us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400668354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:13.745009 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800483200}
I20260709 13:01:13.747990  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:13.750820  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:13.751127  2258 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:13.756294  1544 raft_consensus.cc:2368] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:13.756291  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:13.725986  4566 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.760686  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.747776  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.755561  4521 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:13.759333   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:13.811429  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 50840.6us
I20260709 13:01:13.770321  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.771342  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.812610  1622 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:13.727679  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:13.814090  1543 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:13.773746  1688 rpcz_store.cc:269] 0709 13:01:11.560481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.874858 (+314377us) service_pool.cc:224] Handling call
0709 13:01:13.728036 (+1853178us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400453dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:13.728184 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166733568}
I20260709 13:01:13.810302  4611 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.775066  4580 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:13.730369  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:13.781098  2263 rpcz_store.cc:276] 0709 13:01:12.217659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.217800 (+   141us) service_pool.cc:224] Handling call
0709 13:01:13.168574 (+950774us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:13.168823 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.169206 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.169237 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.169712 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.267656 (+ 97944us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:13.267692 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.267751 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.721352 (+453601us) raft_consensus.cc:1685] finished
0709 13:01:13.721370 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.724756 (+  3386us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2701568,"thread_start_us":97579,"threads_started":1,"wal-append.queue_time_us":171469}
I20260709 13:01:13.678004  4388 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.818754  4505 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.818987  1545 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:13.820032  4510 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.820407  4388 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:13.821779  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51570.1us
I20260709 13:01:13.789141  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.790711  1615 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:13.792083  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.822860  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.823235  1620 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.717456  4384 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:01:13.783990  1619 rpcz_store.cc:276] 0709 13:01:11.822376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.823345 (+   969us) service_pool.cc:224] Handling call
0709 13:01:11.860980 (+ 37635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:11.861180 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:12.158071 (+296891us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.729948 (+1571877us) spinlock_profiling.cc:243] Waited 42 ms on lock 0x7b18002675e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a
0709 13:01:13.733185 (+  3237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:13.733240 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:13.733293 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.733360 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.733470 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3022,"prepare.queue_time_us":464405,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":3822,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":96608128,"thread_start_us":521848,"threads_started":2,"wal-append.queue_time_us":528076}
I20260709 13:01:13.711768  4315 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.802902  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.804883  2258 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:13.805847  2262 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:13.808504  2266 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:13.747262  1695 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:13.726936  4608 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:01:13.815294  4611 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.815891  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:13.823266  1616 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:13.836516  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.837906  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.839715  1546 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:13.822000  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:13.840889  2259 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:13.842521  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.845520  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.846557  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.849901  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.850593  1542 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:13.852109  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.856647  1661 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.857481  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.859163  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.815358  4580 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:13.859825  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.830120  4416 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.860595  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:13.864547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.759712  4581 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.792017  4424 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.835853  4233 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.845510  4566 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.897878  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.845315  4510 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:13.845842  4509 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.820914  4443 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.855866  4556 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.925241  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:13.925732  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 69174us
I20260709 13:01:13.926652  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:13.850137  4589 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.928860  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:13.929380  2257 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 690) took 1376 ms (client timeout 1607 ms). Trace:
W20260709 13:01:13.932025  2257 rpcz_store.cc:269] 0709 13:01:12.553406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.553640 (+   234us) service_pool.cc:224] Handling call
0709 13:01:13.929191 (+1375551us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400634cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:13.929321 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521012480}
I20260709 13:01:13.937670  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.865219  4610 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:13.866950  4548 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:13.939846  4611 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:13.941696  4581 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:13.942824  4423 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:13.867432  4563 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.942731  4521 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:13.945084  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:13.958269  1690 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:13.945713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.924871  4233 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.846545  4587 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:13.898900  4609 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:13.947707  1546 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:13.947640  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:13.936861  4614 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:13.982543  1622 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:01:13.951588  1661 leader_election.cc:400] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:13.902324  4510 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.912262  4436 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:13.949990  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.861733  4388 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:13.958628  1538 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:13.970530  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:13.973711  1620 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:13.949245  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.952183  4589 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:13.954085  4509 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:13.984447  1661 leader_election.cc:403] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:14.003266  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:13.985682  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.994649  1542 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6. Re-sending same reply.
I20260709 13:01:13.995268  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:14.007593  1585 connection.cc:256] RPC call timeout handler was delayed by -1.1508152540000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 13:01:14.011718  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:13.960634  4563 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.015493  1538 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:13.970660  4610 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:14.017890  4610 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.018731  4563 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.021646  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:14.003907  1622 pending_rounds.cc:85] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
I20260709 13:01:14.023633  1622 pending_rounds.cc:107] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:01:14.025142  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:14.023952  1622 raft_consensus.cc:2889] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.026105  1542 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:13.985288  4548 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:13.984068  4614 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.938405  4585 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:14.000130  4510 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.014796  4435 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.023268  4609 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.987342  4416 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:01:14.024392  4452 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:14.075309  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.085031  4509 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:14.086546  4509 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:14.089000  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 75444.3us
W20260709 13:01:14.092206  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 149574us
I20260709 13:01:14.092988  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.030594  4589 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:14.094121  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.039991  4548 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.117542  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:14.044835  4614 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.175096  1542 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:13.983750  4580 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.091521  4452 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.042142  4577 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:01:14.094444  4507 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:14.175623  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 172455us
I20260709 13:01:14.189217  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:14.049506  4472 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.095062  4423 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.117708  4548 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:14.192507  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75048.8us
W20260709 13:01:14.203313  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 278185us
I20260709 13:01:14.204039  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:14.176000  4559 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.190208  1542 raft_consensus.cc:2410] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:14.099279  4581 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.209903  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.210709  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.075692  4435 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.212002  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.091252  4443 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:14.215858  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.763s (SENT) [suppressed 65 similar messages]
I20260709 13:01:14.218672  1690 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:14.219851  4587 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.220621  1694 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:14.184548  4388 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.221159  1695 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:14.228482  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.195163  4514 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.230947  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.252759  1696 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:14.206089  4472 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.254969  4610 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:14.256173  4472 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:14.257169  4622 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:01:14.257896  4507 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:14.256377  4619 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:01:14.207391  4560 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.251008  4514 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:14.084463  4609 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.268262  4507 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.303831  4233 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.228727  4580 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:14.206552  4611 consensus_queue.cc:1175] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" responder_term: 9 status { last_received { term: 6 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.7-8.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:14.293253  4524 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.216498  4315 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.305513  4524 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:14.277534  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 161976us
I20260709 13:01:14.306715  4524 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.308027  1585 leader_election.cc:336] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.783s (SENT)
I20260709 13:01:14.308121  4524 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.229089  4424 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.308465  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:14.289296  4625 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.431s	user 0.002s	sys 0.001s
I20260709 13:01:14.289870  4585 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:14.268464  4589 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.291254  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 75419.3us
W20260709 13:01:14.320020  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4165367010000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2726s for a response
I20260709 13:01:14.258682  4435 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:14.320534  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0799367010000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31000000000000005s for a response
W20260709 13:01:14.274135  4570 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.006s
W20260709 13:01:14.342665  1614 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.011s
I20260709 13:01:14.343801  1614 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:14.344653  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.345358  1690 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:14.347398  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 143466us
I20260709 13:01:14.348592  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.230902  4587 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.231309  4522 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.358721  4628 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:01:14.359149  4522 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.360709  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:14.225072  4559 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.356731  4575 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.003s
I20260709 13:01:14.384963  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:14.354768  4587 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.385917  4388 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:14.389827  4646 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:14.390882  4639 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.391389  4639 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.393141  4323 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.984s	user 0.009s	sys 0.002s
I20260709 13:01:14.393623  4392 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.394099  4392 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.398595  1539 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:01:14.399894  4629 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:01:14.360294  4527 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:14.470629  1585 leader_election.cc:336] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.628s (SENT)
W20260709 13:01:14.457764  4390 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.011s
I20260709 13:01:14.347966  4570 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.406749  4435 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.453961  4522 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:14.504958  1692 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:14.387308  4575 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:14.574141  4436 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
W20260709 13:01:14.575333  4641 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:14.597904  1687 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:01:14.510443  4541 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.768s	user 0.005s	sys 0.017s
I20260709 13:01:14.601500  4570 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:14.602871  4436 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.605561  4423 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:14.609804  4609 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.648900  4644 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.649490  4644 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.507963  4510 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:14.607012  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.608587  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 138041us
I20260709 13:01:14.609287  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:14.619830  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 234956us
I20260709 13:01:14.478711  4390 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.687752  4510 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:14.687917  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 78712.8us
I20260709 13:01:14.646699  4225 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.688706  4225 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:14.688891  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:14.683561  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.690886  1585 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.753s (SENT)
I20260709 13:01:14.691442  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:14.478600  4563 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:14.645536  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 785875us
I20260709 13:01:14.627792  4392 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.706012  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.694175  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.689108  4225 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:14.710212  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:14.710963  1585 leader_election.cc:336] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 2.010s (SENT)
W20260709 13:01:14.661751  4613 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.868s	user 0.013s	sys 0.001s
I20260709 13:01:14.508518  4522 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.503734  4452 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.680734  4588 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.706496  4388 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.680104  4644 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.732936  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:14.733170  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.731583  1585 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:14.690033  4541 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:14.702507  4577 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:14.709637  4423 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.709502  4510 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.742590  4575 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:14.758481  4577 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.737799  4436 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:01:14.747025  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:14.762652  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:14.763109  2259 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:14.711653  4375 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:01:14.764907  4614 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.001s
I20260709 13:01:14.761225  4570 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:14.765420  4614 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.766481  4375 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:14.725823  4648 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:01:14.738147  4585 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:14.777638  4577 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.775744  4570 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:14.778831  4570 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:14.748342  4548 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.012s
I20260709 13:01:14.779639  4548 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.779795  4570 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.781603  4570 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.781989  4548 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.735440  4451 raft_consensus.cc:2764] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:01:14.785985  4643 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:14.786334  4614 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.787215  4417 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.787536  4639 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.729930  4649 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.726001  4435 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:14.752658  4541 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.740898  2257 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:14.766979  4375 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:14.769939  4522 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.774974  4436 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:14.775707  4563 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.802199  4505 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:14.802794  4505 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.803227  4505 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.759850  4423 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.784323  4587 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.806384  4423 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:14.808053  4587 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:14.812356  4514 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.813138  4505 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.813804  4514 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.761603  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.799204  4436 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:14.819491  4436 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:14.821127  4436 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.821503  4375 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:14.822325  4524 consensus_meta.cc:287] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.514s	user 0.013s	sys 0.000s
I20260709 13:01:14.823292  4375 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.824724  4452 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.826718  4559 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:14.827657  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:14.828326  2263 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:14.760596  4385 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.829552  4385 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:14.830334  4385 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:14.819545  4541 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.834431  4385 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:14.838172  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 105731us
I20260709 13:01:14.839304  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:14.841508  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:14.826745  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 81175.9us
I20260709 13:01:14.843101  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:14.734547  4613 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:14.847551  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:14.853191  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.856288  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.847301  4649 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:14.859881  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.846655  4563 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:14.882824  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.884485  4505 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:14.885802  4451 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:14.885880  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.886389  4451 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:14.886672  1693 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:14.886875  4451 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:14.892448  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46219us
I20260709 13:01:14.850241  4611 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:14.894315  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.903100  4507 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.903635  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.904763  4507 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:14.905301  4507 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.905800  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:14.907961  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.908578  1691 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:14.909590  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.910554  1691 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:14.905795  4507 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:14.916314  4509 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:14.916867  4509 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:14.917306  4509 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.927495  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:14.912273  1587 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.858s (SENT)
I20260709 13:01:14.932310  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:14.932925  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:14.891145  4614 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:14.880820  4435 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:14.932951  1693 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:14.881218  4649 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:14.949071  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:14.949906  1691 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.933976  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:14.938862  1690 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:14.901757  4648 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:14.955575  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:15.012238  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.013531  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:15.014369  1694 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:14.936632  4505 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:14.936363  4614 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.018486  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 52595.1us
I20260709 13:01:15.020202  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:15.022078  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66596.2us
I20260709 13:01:15.023255  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:15.026087  4638 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:15.026547  4638 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.026507  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:15.027494  1693 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.955235  4649 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:14.965739  4648 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.024777  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.036713  1691 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
W20260709 13:01:15.046867  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.050549  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.051229  1544 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:15.023087  4614 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:15.104712  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:15.027083  4638 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.115231  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.119969  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.123772  1693 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.024031  4452 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:15.107993  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.108609  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:15.104624  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.111673  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.133694  1622 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:15.135056  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.112361  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.137095  1616 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:15.133736  1540 raft_consensus.cc:2368] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:15.105597  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.027334  4548 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.138686  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:15.109122  4626 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.885s	user 0.003s	sys 0.000s
I20260709 13:01:15.130270  1696 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:15.140327  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.140740  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.102836  4510 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:15.142441  1622 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.125968  1693 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:01:15.146474  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.150679  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.142395  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.154573  2263 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:15.139371  4581 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:15.158941  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.159087  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:15.159888  1544 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:15.159667  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.160917  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.161831  2261 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:15.162186  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:15.164907  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.165769  1547 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.044420  4646 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.035521  4563 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:15.073150  4648 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.159603  1546 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.177819  4581 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:15.162741  2264 raft_consensus.cc:2376] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9. Re-sending same reply.
I20260709 13:01:15.193526  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.159417  4510 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.193941  4581 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.194819  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:15.195161  4659 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:01:15.196731  4655 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:15.196455  4225 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:15.196988  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.197629  2259 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.170351  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.192770  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.198973  1540 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:15.167884  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.174240  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:15.198872  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.200162  1695 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:15.044616  4566 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:01:15.171682  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:15.131183  4452 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.178877  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.314420  2260 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:15.189519  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:15.192744  4587 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.193004  1546 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:15.194392  4510 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:15.176568  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:15.196517  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 57941.7us
I20260709 13:01:15.201839  1540 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:15.205190  1622 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:15.345345  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:15.175319  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.346105  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.223377  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:15.346879  2263 raft_consensus.cc:2376] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6. Re-sending same reply.
I20260709 13:01:15.262435  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.347805  2259 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:15.262436  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:15.198330  4654 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:01:15.274571  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:15.282444  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.353212  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.299518  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:15.171926  4577 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.017717  4435 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:15.323312  4451 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:15.326812  4452 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:15.329627  4423 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.000s
I20260709 13:01:15.401247  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:15.407603  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:15.330796  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 300484us
I20260709 13:01:15.331468  4566 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:15.339442  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.167888  4522 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.348943  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.417300  2261 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.344187  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.418272  2258 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
W20260709 13:01:15.353962  1543 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.036s	sys 0.112s
W20260709 13:01:15.419170  1543 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.036s	sys 0.112s
W20260709 13:01:15.419346  1538 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.056s
I20260709 13:01:15.355247  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.355350  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.357944  1547 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:15.365036  2259 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:15.366989  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.134814  4509 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:15.382903  1659 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.049s	sys 0.102s
W20260709 13:01:15.421334  1659 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.050s	sys 0.102s
I20260709 13:01:15.384454  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:15.385603  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:15.392093  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:15.421639  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 578215us
I20260709 13:01:15.314301  4541 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.215147  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.422659  1622 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:15.348225  4506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.039s	sys 0.077s
W20260709 13:01:15.419845  1538 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.057s
W20260709 13:01:15.471843  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54600.3us
I20260709 13:01:15.474866  1621 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:15.475672  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:15.472820  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.404197  4588 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:15.415447  4423 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.388140  4577 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.490954  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.490468  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:15.478148  4506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.040s	sys 0.077s
I20260709 13:01:15.507047  1547 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:15.506542  1622 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:15.474334  4563 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:15.522992  2257 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:15.504128  4505 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:15.474171  4522 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.527602  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:15.536345  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2241) took 3017 ms (client timeout 1858 ms). Trace:
W20260709 13:01:15.540527  1539 rpcz_store.cc:269] 0709 13:01:12.518737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.542426 (+ 23689us) service_pool.cc:224] Handling call
0709 13:01:15.536101 (+2993675us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540038bb54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:15.536267 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4039940992}
I20260709 13:01:15.484236  4541 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.397703  4435 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:15.524236  4604 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.983s	user 0.001s	sys 0.004s
W20260709 13:01:15.536988  4653 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.518s	user 0.001s	sys 0.000s
I20260709 13:01:15.553375  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:15.530429  4588 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:15.558792  1621 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:15.559955  4541 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:15.564942  1547 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:15.585783  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.588351  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:15.600889  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:15.604206  1587 leader_election.cc:400] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:15.604717  1587 leader_election.cc:403] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:15.586265  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.609067  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.609439  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1792) took 1870 ms. Trace:
I20260709 13:01:15.613260  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:15.613906  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:15.615347  1619 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:15.616927  1619 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:15.621448  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:15.622309  1547 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:15.627313  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.022s
W20260709 13:01:15.627813  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.004s	sys 0.022s
I20260709 13:01:15.630996  1621 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:01:15.632493  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.636392  1619 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.632757  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:15.610037  1545 rpcz_store.cc:276] 0709 13:01:13.738820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.779806 (+1040986us) service_pool.cc:224] Handling call
0709 13:01:14.780163 (+   357us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:14.780512 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.780539 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:14.781148 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:01:15.163343 (+382195us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:15.562327 (+398984us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.608747 (+ 46420us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.609026 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.609126 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.609181 (+    55us) raft_consensus.cc:1685] finished
0709 13:01:15.609199 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.609365 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7811,"prepare.queue_time_us":383177,"raft.queue_time_us":4868,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"thread_start_us":625933,"threads_started":2,"wal-append.queue_time_us":709435}
I20260709 13:01:15.559989  4577 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:15.585553  4505 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:15.687345  4627 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.499s	user 0.009s	sys 0.006s
I20260709 13:01:15.687037  4505 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.689039  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1423) took 1916 ms. Trace:
I20260709 13:01:15.689775  4505 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:15.631042  4548 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:15.690934  4548 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:15.691521  4509 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:15.692166  4548 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:15.693025  4664 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:01:15.668193  4423 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:15.669389  4666 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:01:15.689497  1618 rpcz_store.cc:276] 0709 13:01:13.773003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.773347 (+   344us) service_pool.cc:224] Handling call
0709 13:01:13.773660 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.801681 (+ 28021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.801736 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.802316 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.972773 (+170457us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:13.972843 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.972928 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.631906 (+1658978us) spinlock_profiling.cc:243] Waited 6.02 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:15.688655 (+ 56749us) raft_consensus.cc:1685] finished
0709 13:01:15.688683 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.688947 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27574,"raft.queue_time_us":27974,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":13777,"spinlock_wait_cycles":13842816,"thread_start_us":151927,"threads_started":1,"wal-append.queue_time_us":218135}
I20260709 13:01:15.676690  4392 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:15.679211  4610 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:15.679977  4451 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:15.632306  4588 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:15.681598  4566 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:15.640816  4606 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:15.718101  2265 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:15.619287  4521 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:15.645958  4644 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:15.745150  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.695847  4541 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:15.765053  1510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.031s	sys 0.080s
W20260709 13:01:15.765596  1510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.031s	sys 0.080s
W20260709 13:01:15.712455  4385 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.018s
I20260709 13:01:15.798799  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:15.726737  4610 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.727370  4392 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.804021  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:15.754576  4521 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:15.804316  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:15.805145  2259 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:15.750226  4644 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:15.807117  4644 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:15.811457  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1787) took 2073 ms. Trace:
I20260709 13:01:15.812004  1542 rpcz_store.cc:276] 0709 13:01:13.737624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.226286 (+488662us) service_pool.cc:224] Handling call
0709 13:01:14.226768 (+   482us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:14.274440 (+ 47672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.274485 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:14.292159 (+ 17674us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.712694 (+420535us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:14.961462 (+248768us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.961899 (+   437us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.967911 (+  6012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.968011 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.811164 (+843153us) raft_consensus.cc:1685] finished
0709 13:01:15.811193 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.811380 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55435,"prepare.queue_time_us":1357740,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":105,"raft.queue_time_us":43132,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":13908,"thread_start_us":569963,"threads_started":2,"wal-append.queue_time_us":556240}
I20260709 13:01:15.744952  4566 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:15.796365  4385 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.009s	sys 0.018s
I20260709 13:01:15.803478  4392 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.797417  4541 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.754685  4580 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:15.802758  4375 consensus_meta.cc:287] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.979s	user 0.011s	sys 0.002s
I20260709 13:01:15.806407  4521 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:15.803714  4610 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:15.840180  4570 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.058s	user 0.009s	sys 0.004s
I20260709 13:01:15.861598  1622 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:15.836447  4566 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.854987  4671 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.859059  4541 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:15.854518  4588 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:15.825094  1542 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:15.863242  4580 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:15.879366  4507 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.964s	user 0.007s	sys 0.006s
W20260709 13:01:15.878703  4514 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.049s	user 0.013s	sys 0.000s
W20260709 13:01:15.891952  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.021s	sys 0.029s
W20260709 13:01:15.924218  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.022s	sys 0.029s
W20260709 13:01:15.892776  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 417218us
I20260709 13:01:15.927127  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:15.928499  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.006s	sys 0.046s
W20260709 13:01:15.930454  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.006s	sys 0.046s
I20260709 13:01:15.923252  4385 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:15.977720  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 592401us
I20260709 13:01:15.979038  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:15.882252  4522 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:15.981376  1539 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:15.975818  4653 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:01:15.991099  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.009s	sys 0.038s
W20260709 13:01:16.006498  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 512769us
W20260709 13:01:16.010716  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.039s
I20260709 13:01:16.010818  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:16.017499  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:15.993572  4614 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.005s
W20260709 13:01:15.998543  4638 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.000s
I20260709 13:01:15.986012  4423 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:15.979239  4385 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:15.962544  4507 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:16.041128   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.039273  4390 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:16.070453  1547 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:16.092427  1541 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:16.097355  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.002s	sys 0.014s
W20260709 13:01:16.097986  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.002s	sys 0.014s
W20260709 13:01:16.098393  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 756797us
W20260709 13:01:16.099540  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 497148us
W20260709 13:01:16.100602  1546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.006s	sys 0.008s
W20260709 13:01:16.101063  1546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.006s	sys 0.008s
I20260709 13:01:16.042564  4662 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:01:16.111533  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 478718us
W20260709 13:01:16.112733  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 480327us
I20260709 13:01:16.078351  4683 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.060669  4638 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.081935  4423 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:16.156814  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.015s	sys 0.035s
W20260709 13:01:16.157207  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.015s	sys 0.035s
I20260709 13:01:16.158111  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:16.159272  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:16.119796  4670 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:01:16.174795  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:16.113605  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:16.062095  4614 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.113432  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:16.107846  4681 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:16.180868  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 67507.3us
I20260709 13:01:16.181452  1616 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:16.186175  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.186982  1691 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:16.187350  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.115411  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:16.192298  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 76969.3us
I20260709 13:01:16.180955  4375 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:16.197121  4375 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.197570  1620 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:16.199391  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2197) took 1286 ms. Trace:
W20260709 13:01:16.199659  4673 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:01:16.200587  4614 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.199806  1688 rpcz_store.cc:276] 0709 13:01:14.912824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.104227 (+191403us) service_pool.cc:224] Handling call
0709 13:01:15.132049 (+ 27822us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:15.151672 (+ 19623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.151716 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:15.222252 (+ 70536us) log.cc:844] Serialized 52 byte log entry
0709 13:01:15.924802 (+702550us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:15.991065 (+ 66263us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.991316 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.991413 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.199153 (+207740us) raft_consensus.cc:1685] finished
0709 13:01:16.199169 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.199333 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7914,"prepare.queue_time_us":23132,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":52,"raft.queue_time_us":41970,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":25364,"thread_start_us":592069,"threads_started":1,"wal-append.queue_time_us":864297}
I20260709 13:01:16.216112  1691 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:16.224788  4392 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.197659  4375 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.226810  4638 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.198783  4609 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:01:16.212896  4505 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:16.232630  4680 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:01:16.232878  4671 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:16.198488  4606 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:16.234467  4385 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.238955  4679 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:16.208806  4390 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:16.262542  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 460326us
I20260709 13:01:16.265663  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:16.254230  4452 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.001s
I20260709 13:01:16.269586  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1794) took 2418 ms. Trace:
I20260709 13:01:16.255285  4662 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.255636  4684 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:16.310452  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44938.5us
I20260709 13:01:16.287786  4417 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.313748  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:16.322027  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 304679us
W20260709 13:01:16.332170  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.366847  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 53219.2us
I20260709 13:01:16.368685  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:16.368847  1585 leader_election.cc:336] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.601s (SENT)
W20260709 13:01:16.371719  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.381141  4679 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.381644  4679 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:16.382135  4679 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.388902  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2254) took 1274 ms. Trace:
W20260709 13:01:16.389541  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 68259.6us
I20260709 13:01:16.295032  4570 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:16.389506  1546 rpcz_store.cc:276] 0709 13:01:15.114962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.357332 (+242370us) service_pool.cc:224] Handling call
0709 13:01:15.383522 (+ 26190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.471825 (+ 88303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.471868 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.472498 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.101541 (+629043us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:16.101598 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.101692 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.388574 (+286882us) raft_consensus.cc:1685] finished
0709 13:01:16.388604 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.388809 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4843,"raft.queue_time_us":10519,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":56833,"thread_start_us":611242,"threads_started":1,"wal-append.queue_time_us":896860}
W20260709 13:01:16.401906  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 474862us
I20260709 13:01:16.403510  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:16.404985  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 291469us
I20260709 13:01:16.288385  4614 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:01:16.408684  4423 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.417894  4423 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.407892  2231 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:16.427045  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:16.434693  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.435091  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.435894  1692 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:16.300911  4390 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.307521  4452 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.445423  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.389272  4689 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:16.437363  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.438457  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.401173  4606 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:16.462946  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.446319  1690 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:16.447974  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:16.469997  1512 connection.cc:256] RPC call timeout handler was delayed by -3.5831497350000063s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:01:16.452318  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44667.4us
I20260709 13:01:16.409005  4556 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.458137  1695 raft_consensus.cc:2376] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7. Re-sending same reply.
W20260709 13:01:16.472921  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 312102us
I20260709 13:01:16.411713  4507 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.462185  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.436730  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.423947  4385 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:16.472013  1689 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:16.472975  2231 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:16.471936  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.422233  4548 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:16.405315  4662 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:16.477020  1687 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:16.477345  1692 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:16.484139  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.412647  4570 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.457393  4689 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.456303  4693 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:16.502647  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.497790  1691 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:16.428004  4638 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:01:16.501217  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.445631  4671 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:01:16.505832  1692 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.476161  4687 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.511281  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.511817  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.430063  4690 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:01:16.517050  1696 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:16.519862  1687 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:16.457036  4435 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:16.500101  4588 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.523372  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.499604  4699 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.540850  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:16.548614  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 178785us
I20260709 13:01:16.554101  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.555073  1546 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:16.555951  1692 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:16.557355  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.558229  1692 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:16.515079  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.559397  1691 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:16.617993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.618853  1539 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:16.506948  4689 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.538688  1547 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 13:01:16.629392  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79820.5us
I20260709 13:01:16.630048  1547 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:16.630169  1585 leader_election.cc:336] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.640s (SENT)
I20260709 13:01:16.505453  4225 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.506282  4693 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:16.633670  1696 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:16.622819  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:16.633720  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:16.634550  1687 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:16.634734  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 142687us
I20260709 13:01:16.626509  1691 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:16.529486  2231 connection.cc:256] RPC call timeout handler was delayed by -1.1919439519999742s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 13:01:16.487493  4556 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.630795  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:16.636540  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:16.522377  4696 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:16.642481  4696 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.642992  4696 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:16.640231  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:16.641537  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 205040us
I20260709 13:01:16.675948  1539 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:16.679174  1696 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:16.679729  1547 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:16.680212  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:16.631788  4566 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
I20260709 13:01:16.535918  4613 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.693648  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:16.538893  4707 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:16.694263  1547 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:16.620785  4548 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:16.628086  4392 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:16.525971  4614 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.154s
I20260709 13:01:16.629179  4700 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:16.706998  1547 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:16.711526  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.684514  4606 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:16.712239  1547 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:16.716698  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.717269  1547 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:16.617365  4588 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.712738  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:16.692327  4385 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:16.721817  1539 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:16.724491  1546 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:16.675239  4682 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:01:16.708681  4706 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.714468  4671 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:16.527009  4687 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.714159  4613 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:16.627864  4699 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.697243  4566 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.784204  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.729401  4638 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:16.789248  1539 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:16.722656  4707 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:16.726498  4614 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.792768  1547 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:16.705490  4662 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 13:01:16.770149  4686 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:01:16.797500  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:16.813153  1539 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:16.778898  4644 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.971s	user 0.007s	sys 0.006s
I20260709 13:01:16.779455  4671 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:16.755650  4701 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:16.765806  4719 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.793413  4694 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.363s	user 0.001s	sys 0.000s
I20260709 13:01:16.762467  4423 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:16.784232  4613 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:16.835777  1539 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:16.836103  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:16.815656  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 163002us
W20260709 13:01:16.821295  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 191178us
I20260709 13:01:16.822834  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.810997  4452 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:16.815819  4649 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.712s	user 0.012s	sys 0.002s
W20260709 13:01:16.810063  4695 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 13:01:16.761628  4682 consensus_queue.cc:1243] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:16.795410  4638 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:16.816215  4390 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:16.816336  4703 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.841221  1585 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:16.785306  4706 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:16.843007  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.843410  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:16.845250  4570 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:16.855175  4648 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.536s	user 0.010s	sys 0.003s
W20260709 13:01:16.856477  4704 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:01:16.847775  4724 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.835583  4691 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:01:16.860839  4510 consensus_meta.cc:287] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.503s	user 0.013s	sys 0.001s
W20260709 13:01:16.883086  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 178696us
W20260709 13:01:16.849733  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.003s	sys 0.005s
I20260709 13:01:16.856580  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:16.818025  4614 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:16.858250  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:16.820398  4644 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.863958  1696 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:16.891865  1547 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:16.893170  1696 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:16.893573  4644 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.841691  4423 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:16.808139  4548 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.894263  4423 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.894742  4423 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:16.893699  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.003s	sys 0.006s
I20260709 13:01:16.906276  4423 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.908811  4423 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:16.906507  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 699178us
I20260709 13:01:16.828536  4701 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.828294  4385 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.820094  4606 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:16.923041  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 64813.5us
I20260709 13:01:16.854847  4649 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.925961  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:16.914726  4610 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.047s	user 0.013s	sys 0.000s
I20260709 13:01:16.919628  4728 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:16.928049  4610 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.929606  4507 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:16.930429  4507 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.931157  4507 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:16.931576  4712 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 13:01:16.935628  4698 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:01:16.938530  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2256) took 1803 ms. Trace:
W20260709 13:01:16.939247  4697 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:01:16.941783  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1795) took 1896 ms. Trace:
I20260709 13:01:16.817068  4693 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.942210  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 838) took 1601 ms. Trace:
I20260709 13:01:16.946412  2263 rpcz_store.cc:276] 0709 13:01:15.340705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.347506 (+  6801us) service_pool.cc:224] Handling call
0709 13:01:15.363539 (+ 16033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.628383 (+264844us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:15.628477 (+    94us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.730787 (+102310us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.249305 (+518518us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:16.249364 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.249455 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.941759 (+692304us) raft_consensus.cc:1685] finished
0709 13:01:16.941793 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.942101 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":223979,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":20318,"thread_start_us":683226,"threads_started":2,"wal-append.queue_time_us":710478}
I20260709 13:01:16.935590  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1435) took 1823 ms. Trace:
I20260709 13:01:16.945565  1541 rpcz_store.cc:276] 0709 13:01:15.046055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.046203 (+   148us) service_pool.cc:224] Handling call
0709 13:01:16.941295 (+1895092us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400257454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:16.941666 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2197982464}
I20260709 13:01:16.942124  1540 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:01:16.939417  1545 rpcz_store.cc:276] 0709 13:01:15.135519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.711530 (+576011us) service_pool.cc:224] Handling call
0709 13:01:15.711984 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.746250 (+ 34266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.746295 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.752958 (+  6663us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.210751 (+457793us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:16.211463 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.211639 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.937964 (+726325us) raft_consensus.cc:1685] finished
0709 13:01:16.938006 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.938336 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15293,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15087,"thread_start_us":311937,"threads_started":1,"wal-append.queue_time_us":868291}
I20260709 13:01:16.948745  1620 rpcz_store.cc:276] 0709 13:01:15.111676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.111792 (+   116us) service_pool.cc:224] Handling call
0709 13:01:16.935005 (+1823213us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002c88d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:16.935407 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2487288192}
I20260709 13:01:16.957489  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:16.881201  4556 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:16.969154  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 332391us
W20260709 13:01:16.967118  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76512us
I20260709 13:01:16.833899  4719 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.970997  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:16.862665  4723 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:01:16.975225  1542 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:16.980885  2231 connection.cc:256] RPC call timeout handler was delayed by -1.0641439519999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:01:16.925756  4588 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:16.983552  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:16.863898  4703 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.879464  4510 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:16.870834  4648 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.024418  1617 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:16.986701  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.025445  1619 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:16.858924  4671 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:16.982589  4452 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:16.992182  4723 consensus_queue.cc:1243] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:16.992918  4706 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:16.993110  4701 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:16.993777  4719 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.024060  4648 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.996186  4722 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:16.982452  4644 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:16.971064  4566 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.000360  4649 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:16.869937  4613 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:17.002343  4733 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:17.002511  4609 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:17.002946  4711 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:17.003747  4681 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:17.009578  4684 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.642s	user 0.008s	sys 0.000s
I20260709 13:01:17.009908  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1790) took 3271 ms. Trace:
I20260709 13:01:17.010046  4734 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:16.296581  1543 rpcz_store.cc:276] 0709 13:01:13.851536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.807887 (+956351us) service_pool.cc:224] Handling call
0709 13:01:14.808212 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.808415 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:15.419521 (+611106us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.269075 (+849554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.269132 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:16.269191 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.269376 (+   185us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.269522 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":708003,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":365871,"thread_start_us":1459918,"threads_started":3,"wal-append.queue_time_us":672965}
I20260709 13:01:17.014708  4696 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.059567  4452 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.015462  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.015782  4699 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:17.018683  4679 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.636s	user 0.007s	sys 0.004s
I20260709 13:01:17.019109  4726 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:17.021945  4514 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:17.022228  4729 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.026346  1615 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:16.972579  4548 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.040308  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:17.061089  2231 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.134s (SENT)
I20260709 13:01:16.875569  4724 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:17.061496  1661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.010s	sys 0.019s
W20260709 13:01:17.063376  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 427936us
I20260709 13:01:17.068598  4715 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:16.995801  4541 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.117s	user 0.011s	sys 0.000s
I20260709 13:01:17.072716  4687 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.073069  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.024087  4510 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.081306  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:16.945044  4638 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:17.095921  4610 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.556789  4701 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.471184  4742 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.156s	user 0.002s	sys 0.000s
W20260709 13:01:17.450745  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.560568  4701 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.562523  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1528) took 1118 ms. Trace:
I20260709 13:01:17.562479  4541 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.563468  4701 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:17.096143  4375 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.004s
I20260709 13:01:17.563060  1691 rpcz_store.cc:276] 0709 13:01:16.444298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.636981 (+192683us) service_pool.cc:224] Handling call
0709 13:01:16.637282 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.807367 (+170085us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:16.903874 (+ 96507us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.056944 (+153070us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:17.057552 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:01:17.057720 (+   168us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:17.067734 (+ 10014us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.067973 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.068051 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.562327 (+494276us) raft_consensus.cc:1685] finished
0709 13:01:17.562348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.562467 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92794,"prepare.queue_time_us":173090,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":179376,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":26212,"thread_start_us":350374,"threads_started":3,"wal-append.queue_time_us":405302}
I20260709 13:01:17.564622  4375 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.565025  4452 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.307046  4566 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.217581  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 162903us
I20260709 13:01:17.565876  4566 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.566692  1539 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:17.266762  4708 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:17.567464  4708 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.549595  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1523) took 1106 ms. Trace:
I20260709 13:01:17.569818  4708 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.570480  4646 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:17.572260  4646 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:17.274574  4505 consensus_meta.cc:287] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.015s	user 0.014s	sys 0.006s
I20260709 13:01:17.573729  4681 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.574440  4646 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.575034  4609 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:17.279264  4703 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.576241  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1525) took 1132 ms. Trace:
W20260709 13:01:17.453156  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.071147  4723 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.489s
I20260709 13:01:17.578984  4679 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.579852  4723 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:17.090200  4385 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.490s
I20260709 13:01:17.578184  1687 rpcz_store.cc:276] 0709 13:01:16.443448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.635139 (+191691us) service_pool.cc:224] Handling call
0709 13:01:16.692181 (+ 57042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.701070 (+  8889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.701114 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.701569 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.823748 (+122179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:16.897689 (+ 73941us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.919709 (+ 22020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.074801 (+155092us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b54001f63d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:17.074860 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.575978 (+501118us) raft_consensus.cc:1685] finished
0709 13:01:17.576067 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.576186 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28375,"prepare.queue_time_us":175048,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":167991,"raft.run_cpu_time_us":493,"raft.run_wall_time_us":13239,"spinlock_wait_cycles":19589376,"thread_start_us":160653,"threads_started":2,"wal-append.queue_time_us":147934}
I20260709 13:01:17.577852  1541 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:17.582221  4734 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:17.582578  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.583190  4734 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.571467  4684 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.584638  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.585965  4726 consensus_queue.cc:1243] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:17.586752  1547 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.587252  4715 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:17.587812  1661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.015s	sys 0.022s
I20260709 13:01:17.565590  4541 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.588361  4609 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.574649  1620 raft_consensus.cc:2410] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:17.575714  4711 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.580487  4723 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:17.589636  4375 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.590193  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:17.589347  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.591295  4729 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.593098  1545 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:17.593470  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.595338  4662 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:17.597222  4580 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.599167  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1438) took 2486 ms. Trace:
I20260709 13:01:17.267349  4688 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:17.600551  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.059s
W20260709 13:01:17.683287  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.012s	sys 0.059s
I20260709 13:01:17.684607  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.685225  1622 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:17.600752  4710 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.738s	user 0.005s	sys 0.016s
I20260709 13:01:17.576948  4514 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.577371  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.283124  4507 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.602705  4505 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:17.570173  1692 rpcz_store.cc:276] 0709 13:01:16.442888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.626707 (+183819us) service_pool.cc:224] Handling call
0709 13:01:16.627037 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:16.804517 (+177480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.804551 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:16.811980 (+  7429us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.043204 (+231224us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:17.068386 (+ 25182us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.069214 (+   828us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.069536 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.069660 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.549348 (+479688us) raft_consensus.cc:1685] finished
0709 13:01:17.549368 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.549520 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59505,"prepare.queue_time_us":24453,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":166270,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":15679,"thread_start_us":311174,"threads_started":2,"wal-append.queue_time_us":678250}
I20260709 13:01:17.578558  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.689605  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:17.604436  4696 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.605141  4682 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:17.555670  4689 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.005s
I20260709 13:01:17.572271  4724 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.640013  1619 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:17.103910  4644 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:17.696440  4682 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.668666  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.701336  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.702271  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.669590  1547 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:17.630990  4566 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:17.671902  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1193035739999573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:01:17.678550  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.680334  1546 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:17.700706  4689 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.659627  4720 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:17.705062  4703 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:17.714339  4720 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.670215  4708 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.682548  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.681506  1616 rpcz_store.cc:276] 0709 13:01:15.112667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.490148 (+377481us) service_pool.cc:224] Handling call
0709 13:01:15.490462 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.182047 (+691585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.598873 (+1416826us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54001eb254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:17.599087 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572920192}
I20260709 13:01:17.688048  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.674484  4541 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.719997  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.719861  4541 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.720619  1616 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.603152  4693 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.691634  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.722976  1541 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.725561  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.684775  4609 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.726814  4708 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.728987  4708 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.729507  4708 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:17.690797  4750 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.686733  4688 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.731318  4729 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.703682  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.732438  4688 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.694442  4726 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.732875  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1724) took 1529 ms. Trace:
I20260709 13:01:17.704949  4649 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.733090  4566 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:17.733657  4649 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.733983  4566 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:17.710084  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.734417  4507 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.704703  4696 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:17.735071  1546 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:17.735462  4696 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:17.735999  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.736768  1546 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:17.736416  4696 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.737584  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.733038  4726 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.738866  4726 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.739969  1546 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:17.741065  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.741627  1546 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:17.710770  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.743841  4683 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.744321  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.744333  4683 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.746048  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.734526  4566 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:17.746891  4683 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.747008  4729 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.747596  4729 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.747646  4566 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.748837  4566 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.749737  4729 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.750775  4679 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.752264  4684 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:17.753562  4684 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.753774  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:17.717732  4671 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:17.755424  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.733274  1614 rpcz_store.cc:276] 0709 13:01:16.203234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.203412 (+   178us) service_pool.cc:224] Handling call
0709 13:01:16.203801 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:16.204267 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:16.204308 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:16.204904 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:01:16.476162 (+271258us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:16.476215 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.476278 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.600442 (+1124164us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b24001323f8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f176739c4 00007f7f17671acb 00007f7f1782cdc9 00007f7f1782ca55 00007f7f1782c09d 00007f7f1a45e10e 00007f7f1a47588c 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221
0709 13:01:17.732570 (+132128us) raft_consensus.cc:1685] finished
0709 13:01:17.732591 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.732811 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1459,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":65513856,"thread_start_us":270742,"threads_started":1,"wal-append.queue_time_us":610341}
I20260709 13:01:17.760042  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.710702  1587 leader_election.cc:400] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:17.718703  1620 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:01:17.692747  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.761710  1587 leader_election.cc:403] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:01:17.762751  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52190.7us
I20260709 13:01:17.763363  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.722522  4541 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.730986  4750 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.585536  1538 rpcz_store.cc:276] 0709 13:01:13.738321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.400239 (+661918us) service_pool.cc:224] Handling call
0709 13:01:14.400632 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:14.401000 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:14.401033 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:14.401646 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 13:01:14.849764 (+448118us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:15.479985 (+630221us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.969244 (+489259us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.009159 (+1039915us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b180046d1a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287
0709 13:01:17.009323 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.009442 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:17.009618 (+   176us) raft_consensus.cc:1685] finished
0709 13:01:17.009638 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.009805 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30122,"prepare.queue_time_us":712036,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":374560,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":51269,"spinlock_wait_cycles":10785536,"thread_start_us":1902397,"threads_started":4,"wal-append.queue_time_us":531444,"wal-append.run_cpu_time_us":5204,"wal-append.run_wall_time_us":2124409}
I20260709 13:01:17.742442  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.765934  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.766301  1546 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:17.768211  4703 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.768642  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.704042  4644 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.683310  4662 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.769690  1546 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:17.702517  4723 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.775918  4723 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.763410  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.783481  1543 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:17.785285  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.734030  4649 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:17.680569  1660 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.044s
W20260709 13:01:17.794373  1660 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.004s	sys 0.045s
I20260709 13:01:17.794730  1620 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:17.794872  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 760911us
I20260709 13:01:17.786439  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:17.796967  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.797801  1541 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:17.803406  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.798368  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:17.795511  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49549.2us
I20260709 13:01:17.761439  1614 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:17.799883  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.805709  1695 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.796653  4649 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.808179  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.800413  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.802569  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.808941  1614 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:17.801492  4738 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.812484  1688 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:17.810386  1690 pending_rounds.cc:85] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 6
I20260709 13:01:17.813416  1690 pending_rounds.cc:107] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:01:17.813706  1690 raft_consensus.cc:2889] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.811057  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.812160  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.816385  1614 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:17.817065  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.817407  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:17.819312  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.819767  1691 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:17.819979  1620 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:17.821722  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.804359  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.823364  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.824033  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.823938  1696 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:17.825748  1696 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:17.750444  4681 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.842252  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.855942  1688 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:17.842520  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.856750  1696 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.856792  2257 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:17.827541  1691 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:17.816179  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.858826  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.801784  4507 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:01:17.845567  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.844657  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.842924  4683 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.866535  1616 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:17.850966  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 789907us
I20260709 13:01:17.866853  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:17.867826  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.845986  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:17.833302  1619 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:17.818673  4662 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.835353  1695 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:17.857770  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:17.870903  2265 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:17.871971  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.873051  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:17.859580  2259 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:17.862205  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.862818  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.875519  2261 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:17.864642  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.848026  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:17.868891  2260 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:17.858826  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.878675  2265 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:17.874281  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:17.879725  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.880025  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2250) took 2830 ms. Trace:
I20260709 13:01:17.881659  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:17.882654  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:17.884375  4392 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:17.884500  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.885005  4701 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:17.885558  4701 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:17.885058  4581 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.889678  4750 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.889969  4581 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.890374  4581 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.893863  4392 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:17.885614  4753 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.907337  4753 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.909613  4753 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.880173  4541 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.885560  4744 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.886475  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.910452  4744 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.910683  1688 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:17.910400  4541 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:17.911000  4744 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.911659  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.912189  1688 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:17.887347  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.897310  1541 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:17.888020  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:17.920800  1695 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.888806  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:17.898344  4679 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:17.887672  4683 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.898592  4451 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:17.899241  4720 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.881862  4609 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8.
I20260709 13:01:17.886668  4699 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:17.889417  4701 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.903226  4689 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.870203  4548 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:17.906800  4662 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.921504  1689 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:17.880429  1544 rpcz_store.cc:276] 0709 13:01:15.050016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.171821 (+121805us) service_pool.cc:224] Handling call
0709 13:01:15.172072 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.192390 (+ 20318us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:15.747413 (+555023us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.604117 (+1856704us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b180008b600. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287
0709 13:01:17.604213 (+    96us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.604261 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:17.604994 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.879824 (+274830us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b540003af54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:17.879873 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.879974 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127306,"prepare.queue_time_us":378699,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":24586,"raft.queue_time_us":251141,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":19208,"spinlock_wait_cycles":62358784,"thread_start_us":1180603,"threads_started":3,"wal-append.queue_time_us":642949,"wal-append.run_cpu_time_us":2530,"wal-append.run_wall_time_us":1457143}
I20260709 13:01:17.928997  4687 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:17.933656  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.933779  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2201) took 2773 ms. Trace:
I20260709 13:01:17.929602  4507 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.934005  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.970001  1620 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:17.933779  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.971282  2263 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:17.971411  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:17.972026  1544 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8. Re-sending same reply.
I20260709 13:01:17.934880  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.818243  4738 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.974366  1692 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:17.974716  4683 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.976326  4514 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:17.937357  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.978508  4613 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.979125  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.980083  2263 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:17.983120  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.983392  4541 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.983489  4715 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:17.937284  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.984951  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:17.985611  2263 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:17.936542  4451 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:17.887598  4711 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:17.988448  1547 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:17.988543  1692 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:17.988996  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1714) took 2836 ms (client timeout 2931 ms). Trace:
W20260709 13:01:17.989455  1615 rpcz_store.cc:269] 0709 13:01:15.127454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.172012 (+ 44558us) service_pool.cc:224] Handling call
0709 13:01:17.963594 (+2791582us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001608d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:17.963731 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4213778176}
I20260709 13:01:17.934924  1691 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:17.992899  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:17.996050  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 58850.7us
I20260709 13:01:17.996997  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:17.998486  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:18.008019  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.975934  4738 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:17.903226  4638 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:17.949482  1696 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:18.011883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:18.012177  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.012626  1689 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:18.013257  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:17.932927  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.014019  1616 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:18.014828  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:17.935274  4726 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:17.932242  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1725) took 1689 ms. Trace:
I20260709 13:01:17.853298  4703 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:01:17.964075  1613 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:17.963528  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:17.926900  4679 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:17.968726  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:17.894866  4392 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.075704  1688 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:18.076692  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.077286  1688 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:17.972730  1687 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:17.958130  4662 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.973513  4720 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:17.940716  4509 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:17.962638  1693 rpcz_store.cc:276] 0709 13:01:15.159998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.195766 (+ 35768us) service_pool.cc:224] Handling call
0709 13:01:15.196091 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:15.389306 (+193215us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:15.399219 (+  9913us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.011526 (+612307us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.011677 (+   151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:16.011719 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:16.011767 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.933537 (+1921770us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540023b4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:17.933580 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.933689 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295,"prepare.queue_time_us":25471,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":95158,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":24088,"spinlock_wait_cycles":443299584,"thread_start_us":611541,"threads_started":1,"wal-append.queue_time_us":889430,"wal-append.run_cpu_time_us":3960,"wal-append.run_wall_time_us":1558145}
I20260709 13:01:17.946230  1695 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:17.941278  4505 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:01:18.092844  1695 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:18.017302  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.063891  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.073180  2262 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.073395  4541 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:17.995550  4507 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.008857  4711 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.008015  4701 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:18.074189  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 110780us
I20260709 13:01:18.018285  1618 rpcz_store.cc:276] 0709 13:01:16.242827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.243101 (+   274us) service_pool.cc:224] Handling call
0709 13:01:16.243472 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.243726 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:16.489940 (+246214us) log.cc:844] Serialized 14 byte log entry
0709 13:01:17.931615 (+1441675us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b18003ef740. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287
0709 13:01:17.931747 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:17.931817 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:17.931915 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:17.932010 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:17.932167 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7463,"prepare.queue_time_us":383376,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":5505,"raft.queue_time_us":207290,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6836,"spinlock_wait_cycles":7619456,"thread_start_us":440511,"threads_started":2}
I20260709 13:01:18.044162  1691 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:18.082211  1620 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.102281  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:18.102669  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1448) took 1048 ms. Trace:
I20260709 13:01:18.085564  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.084887  4738 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:18.094929  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.107313  1616 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:18.000126  4687 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:18.096516  1546 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:18.094543  2260 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:18.111711  1687 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:18.112030  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:18.113170  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.087345  4662 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.116164  2231 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:18.119145  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:18.102645  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.120602  1618 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:18.010504  1544 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.103207  1620 rpcz_store.cc:276] 0709 13:01:17.054163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.010961 (+956798us) service_pool.cc:224] Handling call
0709 13:01:18.081964 (+ 71003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.102387 (+ 20423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.102584 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.074903  4679 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.123960  2263 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:18.095348  4720 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.104779  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.126312  1688 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:18.098287  4541 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:18.099704  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 78485.5us
I20260709 13:01:18.121357  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2267) took 1056 ms. Trace:
I20260709 13:01:18.129832  1544 rpcz_store.cc:276] 0709 13:01:17.064560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.010088 (+945528us) service_pool.cc:224] Handling call
0709 13:01:18.010357 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.121062 (+110705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.121282 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.171505  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:18.136142  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.181758  1616 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:18.142860  1687 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:18.183147  1687 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:18.189050  1544 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:18.189946  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2270) took 1124 ms. Trace:
I20260709 13:01:18.190375  1544 rpcz_store.cc:276] 0709 13:01:17.065476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.186451 (+1120975us) service_pool.cc:224] Handling call
0709 13:01:18.188592 (+  2141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.189624 (+  1032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.189873 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.199374  1688 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.201766  1544 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.205396  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1451) took 1149 ms. Trace:
I20260709 13:01:18.205813  1620 rpcz_store.cc:276] 0709 13:01:17.055666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.129205 (+1073539us) service_pool.cc:224] Handling call
0709 13:01:18.204919 (+ 75714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.205081 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.205106 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.205145 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:18.205176 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.205226 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.205340 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.208889  1689 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:18.211068  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2271) took 1145 ms. Trace:
I20260709 13:01:18.211647  1544 rpcz_store.cc:276] 0709 13:01:17.065761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.195137 (+1129376us) service_pool.cc:224] Handling call
0709 13:01:18.195510 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.210723 (+ 15213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.210989 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.123224  4753 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:18.210598  2262 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:18.127807  4750 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:18.128216  4752 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:18.229676  2262 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.179198  4688 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:18.135628  4541 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.128899  4720 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.248126  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1454) took 1177 ms. Trace:
I20260709 13:01:18.263063  1620 rpcz_store.cc:276] 0709 13:01:17.070855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.206721 (+1135866us) service_pool.cc:224] Handling call
0709 13:01:18.247590 (+ 40869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.247778 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.247804 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.247849 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:18.247882 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.247943 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.248067 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.245674  1616 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.271731  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1453) took 1209 ms. Trace:
I20260709 13:01:18.272289  1616 rpcz_store.cc:276] 0709 13:01:17.062703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.196817 (+1134114us) service_pool.cc:224] Handling call
0709 13:01:18.245422 (+ 48605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.271346 (+ 25924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.271612 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.122387  4738 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.286248  4507 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:18.287498  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 519) took 2963 ms. Trace:
W20260709 13:01:18.291666  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.231005  4681 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:18.247699  4688 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.209910  4649 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.298329  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1459) took 1107 ms. Trace:
I20260709 13:01:18.287945  1613 rpcz_store.cc:276] 0709 13:01:15.323972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.486495 (+162523us) service_pool.cc:224] Handling call
0709 13:01:17.963818 (+2477323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.076494 (+112676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.287310 (+210816us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54001608d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.287440 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5641542912}
I20260709 13:01:18.303375  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:18.304507  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:18.305891  1616 rpcz_store.cc:276] 0709 13:01:17.191003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.273249 (+1082246us) service_pool.cc:224] Handling call
0709 13:01:18.297670 (+ 24421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.297918 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.297955 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:18.298011 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:18.298063 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.298130 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.298261 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.283354  4509 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.286823  4738 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:18.313715  1544 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.308797  1613 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:18.291189  4752 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:18.307350  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:18.318936  2262 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:18.247839  4693 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:01:18.305418  4688 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:18.317603  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:18.306401  4762 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.312592  4559 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:18.333421  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:18.336012  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:18.312407  4763 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:18.340385  1616 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
W20260709 13:01:18.338860  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 167467us
W20260709 13:01:18.341238  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 216465us
I20260709 13:01:18.315586  4738 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:18.278318  4687 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.305115  4581 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.309353  4681 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:01:18.362414  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.314328  4509 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.332134  4734 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:01:18.331533  4702 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:01:18.348922  4726 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:18.456629  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1434) took 3345 ms. Trace:
W20260709 13:01:18.468797  4761 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:01:18.427093  4763 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:18.477849  4759 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:01:18.331869  4762 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.334439  4559 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.428465  4738 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.536873  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:18.457870  1617 rpcz_store.cc:276] 0709 13:01:15.111374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.112815 (+  1441us) service_pool.cc:224] Handling call
0709 13:01:15.113100 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.024828 (+1911728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.455788 (+1430960us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400160dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:18.456414 (+   626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4395574656}
I20260709 13:01:18.478683  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:18.539711  1616 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.506256  4684 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.503822  4723 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:18.665897  1617 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:01:18.666278  1617 pending_rounds.cc:85] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 4
I20260709 13:01:18.668181  1617 pending_rounds.cc:107] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:01:18.668424  1617 raft_consensus.cc:2889] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:18.666716  1585 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.573s (SENT)
I20260709 13:01:18.669471  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:18.533406  4614 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:18.703706  4646 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:18.703835  4671 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.948s	user 0.013s	sys 0.000s
I20260709 13:01:18.704062  4768 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:18.704576  4768 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:18.704761  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.710939  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:18.712530  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:18.713578  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:18.715046  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.716313  2260 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:18.716414  4559 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:18.448098  4752 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.717382  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.718149  2258 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:18.719765  2265 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:18.715097  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.721719  2264 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
W20260709 13:01:18.725509  4613 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.746s	user 0.007s	sys 0.002s
I20260709 13:01:18.727018  1622 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:01:18.727835  4762 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:18.727577  4614 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.729775  4614 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:18.730085  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.679770  4723 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.735656  4720 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.736750  4723 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:18.737630  4720 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:18.738262  4720 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:18.505584  4763 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.704938  4768 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.747999  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1799) took 1698 ms. Trace:
I20260709 13:01:18.748417  1545 rpcz_store.cc:276] 0709 13:01:17.050076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.050236 (+   160us) service_pool.cc:224] Handling call
0709 13:01:17.592748 (+542512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.676206 (+ 83458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.747772 (+1071566us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b5400084dd0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.747934 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246984064}
I20260709 13:01:18.740331  4763 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:18.750000  1545 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:18.750598  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2281) took 1681 ms. Trace:
I20260709 13:01:18.751271  1545 rpcz_store.cc:276] 0709 13:01:17.068773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.749432 (+1680659us) service_pool.cc:224] Handling call
0709 13:01:18.749772 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.750360 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.750546 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:18.717223  4744 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.790s	user 0.000s	sys 0.008s
I20260709 13:01:18.742057  1538 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
W20260709 13:01:18.756558  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 439033us
I20260709 13:01:18.743903  1546 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:18.761435  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2278) took 1693 ms. Trace:
W20260709 13:01:18.747092  2231 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.0.107.254:35005, user_credentials={real_user=slave}} blocked reactor thread for 53505.4us
I20260709 13:01:18.748023  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2263) took 3215 ms. Trace:
I20260709 13:01:18.761807  1546 rpcz_store.cc:276] 0709 13:01:17.067840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.714319 (+1646479us) service_pool.cc:224] Handling call
0709 13:01:18.743629 (+ 29310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:18.761143 (+ 17514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.761377 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.762521  1542 rpcz_store.cc:276] 0709 13:01:15.532457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.954494 (+422037us) service_pool.cc:224] Handling call
0709 13:01:15.954938 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:16.975735 (+1020797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.747781 (+1772046us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540018abd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:18.747962 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2346136320}
W20260709 13:01:18.763248  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 413429us
I20260709 13:01:18.764410  1542 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:18.765141  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2287) took 1068 ms. Trace:
I20260709 13:01:18.765547  1542 rpcz_store.cc:276] 0709 13:01:17.696943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.763806 (+1066863us) service_pool.cc:224] Handling call
0709 13:01:18.764173 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.764863 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.765079 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:18.767606  2264 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:18.768525  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:18.663609  4436 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:18.765591  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:18.783645  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.743257  1616 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:18.674844  4684 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.787556  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.792266  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.787997  1659 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:18.788928  2264 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:01:18.738608  4720 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.740603  4721 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:18.795540  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:18.761785  4679 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
I20260709 13:01:18.758071  4753 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:18.703886  4738 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:18.797854  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.798928  1546 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.826972  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1810) took 1138 ms. Trace:
I20260709 13:01:18.827432  1546 rpcz_store.cc:276] 0709 13:01:17.689054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.762900 (+1073846us) service_pool.cc:224] Handling call
0709 13:01:18.798698 (+ 35798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.826518 (+ 27820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.826894 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:18.812031  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.801113  2257 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:18.801283  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.829699  1694 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:18.800069  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:18.830860  2259 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.798563  2266 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.822804  2258 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:01:18.831355  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.761072  4711 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.796574  4662 consensus_meta.cc:287] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.660s	user 0.008s	sys 0.002s
I20260709 13:01:18.834152  1546 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:18.835929  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1802) took 1784 ms. Trace:
I20260709 13:01:18.829342  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.830188  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.838775  1539 rpcz_store.cc:276] 0709 13:01:17.051703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.051840 (+   137us) service_pool.cc:224] Handling call
0709 13:01:17.052112 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:17.567059 (+514947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.835707 (+1268648us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400208d54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:18.835873 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1182781312}
I20260709 13:01:18.840596  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2291) took 1130 ms. Trace:
W20260709 13:01:18.840756  1618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.022s	sys 0.055s
W20260709 13:01:18.841310  1618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.022s	sys 0.055s
I20260709 13:01:18.841085  1546 rpcz_store.cc:276] 0709 13:01:17.709815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.828365 (+1118550us) service_pool.cc:224] Handling call
0709 13:01:18.833922 (+  5557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.840295 (+  6373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.840527 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:18.843248  4541 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:01:18.843667  4541 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.845669  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:18.847105  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.847345  4772 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.847820  4772 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.848234  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:18.850037  4772 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:18.854206  4638 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
I20260709 13:01:18.854655  4649 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:18.856765  4684 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:18.857703  4701 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.000s
I20260709 13:01:18.876447  1545 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:01:18.876927  1545 pending_rounds.cc:85] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 6
I20260709 13:01:18.877192  1545 pending_rounds.cc:107] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:01:18.877463  1545 raft_consensus.cc:2889] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:18.879133  1614 raft_consensus.cc:2410] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:18.879827  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2284) took 1273 ms. Trace:
I20260709 13:01:18.880635  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1449) took 1825 ms. Trace:
I20260709 13:01:18.880714  1545 rpcz_store.cc:276] 0709 13:01:17.606435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.751948 (+1145513us) service_pool.cc:224] Handling call
0709 13:01:18.752185 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.877994 (+125809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.879513 (+  1519us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540038ac54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:18.879741 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284651776}
I20260709 13:01:18.881278  1614 rpcz_store.cc:276] 0709 13:01:17.055016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.817179 (+762163us) service_pool.cc:224] Handling call
0709 13:01:18.880397 (+1063218us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002b75d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.880554 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2439693184}
I20260709 13:01:18.883562  4711 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.884733  4726 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:18.885250  4726 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:18.886391  4726 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.887701  4726 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:18.850451  2259 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:18.858770  4509 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:18.859704  4682 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:18.800689  4721 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:18.892238  4721 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.893599  4721 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:18.896083  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2273) took 1829 ms. Trace:
I20260709 13:01:18.896587  1544 rpcz_store.cc:276] 0709 13:01:17.066356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.212637 (+1146281us) service_pool.cc:224] Handling call
0709 13:01:18.213032 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.314145 (+101113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.895765 (+581620us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540038bb54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:18.896006 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231129344}
I20260709 13:01:18.898095  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2255) took 3769 ms. Trace:
I20260709 13:01:18.898554  1540 rpcz_store.cc:276] 0709 13:01:15.129030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.389661 (+260631us) service_pool.cc:224] Handling call
0709 13:01:16.941602 (+1551941us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:16.957174 (+ 15572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.897868 (+1940694us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400257450. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.898029 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3567589760}
I20260709 13:01:18.905959  2260 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:18.906589  4563 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:18.907204  4563 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:18.908263  4563 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.823604  4766 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:18.861557  4685 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:18.863171  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1460) took 1301 ms. Trace:
I20260709 13:01:18.916065  4766 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:18.916565  4766 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:18.916117  1622 rpcz_store.cc:276] 0709 13:01:17.561646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.725314 (+163668us) service_pool.cc:224] Handling call
0709 13:01:18.862935 (+1137621us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54002c79d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.863098 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234092416}
I20260709 13:01:18.863687  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2276) took 1796 ms. Trace:
I20260709 13:01:18.909762  4563 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.917749  1547 rpcz_store.cc:276] 0709 13:01:17.067228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.803174 (+735946us) service_pool.cc:224] Handling call
0709 13:01:18.863456 (+1060282us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400107054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.863618 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423157504}
I20260709 13:01:18.864482  4738 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:18.865705  1687 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:18.917855  4451 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.921221  4451 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:18.925010  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1531) took 1117 ms. Trace:
I20260709 13:01:18.925454  1690 rpcz_store.cc:276] 0709 13:01:17.807793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.807912 (+   119us) service_pool.cc:224] Handling call
0709 13:01:17.810181 (+  2269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:17.814374 (+  4193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:17.814404 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:17.815145 (+   741us) log.cc:844] Serialized 52 byte log entry
0709 13:01:17.928419 (+113274us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:18.012794 (+ 84375us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.013170 (+   376us) log.cc:844] Serialized 14 byte log entry
0709 13:01:18.013381 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:18.013449 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:18.861029 (+847580us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b180032b540. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1f803328 00007f7f1f7fa901 00007f7f1f7fa8a7 00007f7f1f8f2288 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508
0709 13:01:18.922321 (+ 61292us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b180032b540. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:18.924790 (+  2469us) raft_consensus.cc:1685] finished
0709 13:01:18.924812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:18.924952 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12336,"prepare.queue_time_us":373668,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":7331,"raft.queue_time_us":241,"raft.run_cpu_time_us":10542,"raft.run_wall_time_us":905300,"spinlock_wait_cycles":35660928,"thread_start_us":156259,"threads_started":2,"wal-append.queue_time_us":270824}
I20260709 13:01:18.866992  2261 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:18.930264  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.930812  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.931126  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.931404  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:18.939536  1615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.024s	sys 0.030s
I20260709 13:01:18.798640  4720 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:18.940378  1615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.024s	sys 0.030s
I20260709 13:01:18.797017  4436 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:18.939574  4609 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.785051  4744 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.833076  4679 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:18.962746  4688 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:01:18.976148  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2210) took 1140 ms. Trace:
I20260709 13:01:18.979903  1691 rpcz_store.cc:276] 0709 13:01:17.835312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.871737 (+ 36425us) service_pool.cc:224] Handling call
0709 13:01:18.975919 (+1104182us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54001f68d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:18.976067 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143484672}
I20260709 13:01:18.983534  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.940490  4662 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.917683  4766 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:18.968139  4581 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:18.993338  2263 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:18.976998  4699 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.009s	sys 0.009s
I20260709 13:01:18.967640  4609 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:18.997112  1693 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:18.994546  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:18.997856  1690 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:18.995872  4775 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:18.997792  4699 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.009s	sys 0.009s
I20260709 13:01:18.988519  4688 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:19.017652  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 221289us
I20260709 13:01:18.997071  4436 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.015929  4699 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:19.050033  4711 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:19.058808  4773 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:19.061834  4744 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.012512  4775 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.071575  4775 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:19.073081  4679 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:19.066155  4688 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.067420  4699 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.078088  4768 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.079694  4720 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.080327  4768 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:19.084095  4720 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:19.117404  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.119479  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.132817  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2272) took 2066 ms (client timeout 2200 ms). Trace:
W20260709 13:01:19.133833  1587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.042s	sys 0.091s
W20260709 13:01:19.134413  1587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.042s	sys 0.091s
W20260709 13:01:19.135250  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 1.34404e+06us
I20260709 13:01:19.137253  1539 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:19.138497  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:19.146817  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1811) took 1285 ms. Trace:
I20260709 13:01:19.148267  1539 rpcz_store.cc:276] 0709 13:01:17.861227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.840005 (+978778us) service_pool.cc:224] Handling call
0709 13:01:19.135799 (+295794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:19.138358 (+  2559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.146728 (+  8370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:19.133677  1538 rpcz_store.cc:269] 0709 13:01:17.066057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.765456 (+699399us) service_pool.cc:224] Handling call
0709 13:01:19.132169 (+1366713us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b5400208354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:19.132511 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156795136}
W20260709 13:01:19.152427  1620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.013s
W20260709 13:01:19.160526  1620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.000s	sys 0.014s
W20260709 13:01:18.977121  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.002s	sys 0.015s
I20260709 13:01:19.208412  4662 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.177523  1691 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:01:19.212160  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.216851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.164232  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2205) took 1361 ms. Trace:
I20260709 13:01:19.220573  1692 rpcz_store.cc:276] 0709 13:01:17.802092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:17.802269 (+   177us) service_pool.cc:224] Handling call
0709 13:01:19.163557 (+1361288us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400451854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:19.163843 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379471104}
I20260709 13:01:19.220996  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.219938  4662 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.221983  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.222739  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.222572  4662 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.223284  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.219923  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.194869  2265 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:19.222003  1617 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.203889  4451 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:19.225371  4662 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:19.196895  4609 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.225795  4451 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.204983  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1458) took 2048 ms. Trace:
I20260709 13:01:19.193037  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.195710  2266 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:19.188235  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1539) took 1362 ms. Trace:
I20260709 13:01:19.180701  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1545) took 1182 ms. Trace:
W20260709 13:01:19.165063  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 377027us
I20260709 13:01:19.214564  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.188673  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.191906  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.242864  1693 rpcz_store.cc:276] 0709 13:01:17.998301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.091565 (+ 93264us) service_pool.cc:224] Handling call
0709 13:01:19.180096 (+1088531us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54000b40d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:19.180466 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031185664}
I20260709 13:01:19.254756  1659 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.231626  1620 rpcz_store.cc:276] 0709 13:01:17.156413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.264377 (+1107964us) service_pool.cc:224] Handling call
0709 13:01:18.264792 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.265028 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:18.649900 (+384872us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.204281 (+554381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.204409 (+   128us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:19.204556 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.204686 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.204894 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56898,"prepare.queue_time_us":596311,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":48208,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":217,"thread_start_us":755467,"threads_started":2,"wal-append.queue_time_us":385643}
I20260709 13:01:19.259294  4723 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.260350  4723 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:19.260946  4723 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.207603  4638 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:19.263543  4638 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.241932  1696 rpcz_store.cc:276] 0709 13:01:17.825331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.013040 (+187709us) service_pool.cc:224] Handling call
0709 13:01:19.187707 (+1174667us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540012c5d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:19.187998 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2680864000}
I20260709 13:01:19.292923  1688 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:19.292200  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 100819us
W20260709 13:01:19.295569  1585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.001s	sys 0.013s
I20260709 13:01:19.295758  4451 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:19.296023  1585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.001s	sys 0.013s
W20260709 13:01:19.297519  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 630843us
I20260709 13:01:19.298769  4789 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.300518  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 162232us
I20260709 13:01:19.302999  4522 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.303313  1690 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:19.303681  4522 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.304131  4638 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.304248  4522 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:19.308732  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.018s	sys 0.030s
W20260709 13:01:19.309286  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.018s	sys 0.030s
I20260709 13:01:19.314548  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.319280  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.320360  1538 raft_consensus.cc:2376] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8. Re-sending same reply.
I20260709 13:01:19.323114  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.324127  1539 raft_consensus.cc:2376] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6. Re-sending same reply.
I20260709 13:01:19.325937  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.326653  1546 raft_consensus.cc:2376] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8. Re-sending same reply.
W20260709 13:01:19.327766  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.004s	sys 0.018s
W20260709 13:01:19.328311  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 977864us
I20260709 13:01:19.335410  1621 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:01:19.337430  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.335556  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.339227  1547 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7. Re-sending same reply.
I20260709 13:01:19.340555  4541 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:19.341276  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2290) took 1631 ms. Trace:
W20260709 13:01:19.341647  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 87358.9us
I20260709 13:01:19.341830  1542 rpcz_store.cc:276] 0709 13:01:17.709536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.766600 (+1057064us) service_pool.cc:224] Handling call
0709 13:01:18.779202 (+ 12602us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.779997 (+   795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:18.780039 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:18.780651 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.310064 (+529413us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:19.310177 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.310281 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.340890 (+ 30609us) raft_consensus.cc:1685] finished
0709 13:01:19.340918 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.341173 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":528771,"threads_started":1,"wal-append.queue_time_us":558023}
I20260709 13:01:19.345535  4789 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:19.346980  4763 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:19.347419  4763 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:19.347605  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.347903  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.348048  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.348732  1692 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:19.348899  4763 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.349720  4662 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:19.350433  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.350903  4563 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.351641  1546 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:19.351924  1691 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:19.352488  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.352764  1693 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:19.353415  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.353847  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.351662  4563 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.354660  1543 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:01:19.355818  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.356539  1691 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.356971  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.358017  1542 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:19.359107  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.359261  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.360443  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.361100  1692 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.361008  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:19.362897  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.363056  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.364117  1539 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:19.364213  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.364938  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.365118  1693 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 5.
I20260709 13:01:19.365732  1547 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:19.356454  4563 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.330192  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.366267  4693 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:19.350370  4763 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.367206  4693 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.369939  4693 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:19.370555  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.370782  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.371598  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1452) took 2312 ms. Trace:
I20260709 13:01:19.371656  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.372911  1538 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:19.372153  1618 rpcz_store.cc:276] 0709 13:01:17.059377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.192986 (+1133609us) service_pool.cc:224] Handling call
0709 13:01:18.193422 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:18.220685 (+ 27263us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:18.841784 (+621099us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.311139 (+469355us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:19.311931 (+   792us) log.cc:844] Serialized 26 byte log entry
0709 13:01:19.312140 (+   209us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:19.312196 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.312308 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:19.371217 (+ 58909us) raft_consensus.cc:1685] finished
0709 13:01:19.371233 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.371389 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26771,"prepare.queue_time_us":640408,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":31446,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":66401,"thread_start_us":942294,"threads_started":2,"wal-append.queue_time_us":426770}
I20260709 13:01:19.371606  1616 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:19.364022  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.381992  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1446) took 2328 ms. Trace:
I20260709 13:01:19.382258  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.383389  1544 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:19.382413  1615 rpcz_store.cc:276] 0709 13:01:17.053569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.001221 (+947652us) service_pool.cc:224] Handling call
0709 13:01:18.001541 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:18.001806 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:18.942357 (+940551us) log.cc:844] Serialized 14 byte log entry
0709 13:01:19.267763 (+325406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:19.290664 (+ 22901us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:19.294986 (+  4322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:19.316939 (+ 21953us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:19.381810 (+ 64871us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54781,"prepare.queue_time_us":798026,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":41,"raft.queue_time_us":60045,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":16140,"thread_start_us":1152144,"threads_started":2,"wal-append.queue_time_us":238061}
W20260709 13:01:19.387778  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.387657  4775 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.388000  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58053.8us
I20260709 13:01:19.387197  1691 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:19.388520  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.390717  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.391126  4684 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:19.391736  4684 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:19.392182  4684 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:19.392568  4744 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.392902  1617 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:19.395769  1690 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:19.397339  1510 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.010s	sys 0.011s
W20260709 13:01:19.397848  1510 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.010s	sys 0.011s
I20260709 13:01:19.390189  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.405746  4451 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:19.406229  4638 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:19.407091  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.408196  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.409312  4740 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:19.409907  4740 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:19.410303  4740 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:19.411712  4785 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.374s	user 0.000s	sys 0.003s
I20260709 13:01:19.419013  4662 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.370421  1688 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
W20260709 13:01:19.398375  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 863512us
I20260709 13:01:19.421250  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.422734  4687 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:19.424036  1585 leader_election.cc:336] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.603s (SENT)
I20260709 13:01:19.424264  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:19.425341  2265 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:19.427448  1659 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.427542  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.429867  4541 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.430299  4715 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.431253  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.431049  4715 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.433279  4763 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.433651  4715 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.435051  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:19.435350  4687 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:19.437127  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.437705  2262 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:19.341956  4766 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:19.438810  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.421221  4744 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.438922  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.439735  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.443189  4687 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.443722  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 306) took 20057 ms (client timeout 15000 ms). Trace:
I20260709 13:01:19.435527  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.409246  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:19.450937  1510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.603s (SENT) [suppressed 22 similar messages]
I20260709 13:01:19.455050  4763 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:19.459522  4685 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:19.460417  4684 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:19.461577  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.463649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.469589  1692 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:19.486609  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.473687  4723 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.474181  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.475052  4740 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.479460  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.507400  1544 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:19.480681  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.481966  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.483377  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.484453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:19.492560  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 86217us
I20260709 13:01:19.509323  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.509318  1543 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7. Re-sending same reply.
W20260709 13:01:19.511523  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 102440us
I20260709 13:01:19.488075  4693 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:19.515811  4581 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:19.517506  1614 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:19.521867  4451 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:19.506811  4775 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.516091  1538 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.522325  4451 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:19.530345  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 79484.9us
I20260709 13:01:19.530319  4581 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:19.556506  1617 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:19.526063  4541 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:19.506321  4522 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.560401  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:19.562124  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.533704  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 98319.3us
I20260709 13:01:19.530680  4715 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:19.570407  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.556133  4662 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.572149  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:19.576148  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 89814.7us
I20260709 13:01:19.531842  4638 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.578298  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.575464  1547 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
W20260709 13:01:19.582374  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 108358us
I20260709 13:01:19.559528  4693 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.576161  4541 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:19.596834  4726 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.596650  1443 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:19.597543  4726 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.603103  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:19.601446  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 169440us
I20260709 13:01:19.604619  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.605500  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.607928  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.602397  4614 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:19.609071  4784 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:01:19.611918  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:19.612752  2262 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 477) took 1195 ms (client timeout 1566 ms). Trace:
W20260709 13:01:19.613158  2262 rpcz_store.cc:269] 0709 13:01:18.407898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:18.431808 (+ 23910us) service_pool.cc:224] Handling call
0709 13:01:19.596500 (+1164692us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:19.602896 (+  6396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824256384}
W20260709 13:01:19.614953  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.616031  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.616127  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.616767  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.616784  1540 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.617286  1539 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
W20260709 13:01:19.495000  1442 rpcz_store.cc:269] 0709 13:00:59.390178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.420580 (+ 30402us) service_pool.cc:224] Handling call
0709 13:01:19.443345 (+20022765us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:13.298177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:13.298963 (+   786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:13.299011 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:01:13.299031 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:13.300493 (+  1462us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:13.300606 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:13.300630 (+    24us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:01:13.324661 (+ 24031us) tablet.cc:701] Row locks acquired
0709 13:01:13.324734 (+    73us) write_op.cc:260] PREPARE: finished
0709 13:01:13.324998 (+   264us) write_op.cc:270] Start()
0709 13:01:13.325234 (+   236us) write_op.cc:276] Timestamp: P: 1783602073324887 usec, L: 0
0709 13:01:13.325252 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:01:13.458593 (+133341us) log.cc:844] Serialized 5556 byte log entry
0709 13:01:13.818145 (+359552us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b
0709 13:01:14.643785 (+825640us) op_driver.cc:464] REPLICATION: finished
0709 13:01:15.343147 (+699362us) write_op.cc:301] APPLY: starting
0709 13:01:15.366467 (+ 23320us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:15.694312 (+327845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:15.694365 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:15.706611 (+ 12246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:15.707041 (+   430us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:01:15.707103 (+    62us) write_op.cc:312] APPLY: finished
0709 13:01:15.707536 (+   433us) log.cc:844] Serialized 101 byte log entry
0709 13:01:16.137255 (+429719us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:16.170439 (+ 33184us) write_op.cc:454] Released schema lock
0709 13:01:16.170540 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:16.297004 (+126464us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:16.298743 (+  1739us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2341,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":490824,"apply.run_cpu_time_us":18685,"apply.run_wall_time_us":1082775,"num_ops":14,"prepare.queue_time_us":437446,"prepare.run_cpu_time_us":21857,"prepare.run_wall_time_us":560093,"raft.queue_time_us":333164,"raft.run_cpu_time_us":37206,"raft.run_wall_time_us":210143,"replication_time_us":1318335,"spinlock_wait_cycles":5342592,"thread_start_us":1455115,"threads_started":5,"wal-append.queue_time_us":1000620,"wal-append.run_cpu_time_us":51690,"wal-append.run_wall_time_us":3242090}]]}
I20260709 13:01:19.627205  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.633653  1617 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:19.634290  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.622087  4392 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.626088  4796 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:19.624203  4563 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:19.638298  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.639283  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.635167  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.638392  4727 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:19.641110  4727 consensus_queue.cc:1243] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:19.643093  4563 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.643555  4563 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.644886  1546 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:01:19.626075  4614 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:19.651018  4614 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:19.651580  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.652491  1616 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:19.651995  4614 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.653398  4614 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.653443  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.654836  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.655936  1613 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:01:19.658143  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.643549  4721 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:19.638447  4581 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.659368  4721 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:19.660486  4721 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.661902  4721 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.662358  4541 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.666312  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.666752  4707 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:19.667287  4707 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:19.667727  4522 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.668322  4707 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.669576  4451 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.670936  4451 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:19.670830  4648 consensus_queue.cc:1175] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" responder_term: 8 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:01:19.672919  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:19.673637  2265 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:19.628223  4684 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.674540  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:19.675771  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:19.676473  1541 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.676642  1544 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:19.676869  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.677619  1690 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.618806  4638 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.689000  1538 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:19.691227  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.693909  1540 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:19.694586  4699 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.694778  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.694931  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:19.700843  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 64490.9us
I20260709 13:01:19.697009  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.629937  4723 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.635951  4740 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:19.696430  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74382.5us
I20260709 13:01:19.632483  1443 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 3 to 4, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:19.706099  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:19.706099  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:19.709008  1617 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.706607  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.709470  1543 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.675738  4693 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.711000  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:19.714880  1547 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.714852  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.717469  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:19.718281  2262 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 4.
I20260709 13:01:19.719159  4699 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.719403  1691 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:19.719334  4778 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:01:19.721593  1690 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:19.625432  4715 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:01:19.777161  4715 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.777906  4715 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:19.778254  4715 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:19.731318  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.685359  4392 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.781244  4392 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.720594  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.782226  4648 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.782407  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 72597.1us
W20260709 13:01:19.784121  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.784071  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.784930  4723 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:19.786814  4648 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.749297  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:19.788239  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.750901  1620 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.751425  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.722690  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:19.754282  4613 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.754746  4784 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:19.755244  4726 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.711742  4727 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:01:19.756583  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.749359  1688 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.757899  4703 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:19.730976  1687 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:19.758669  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:19.757928  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:19.759778  1539 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.761276  4638 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.760713  1443 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.763037  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:19.763739  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:19.765213  4563 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.767298  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:19.771873  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:19.775468  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 130000us
I20260709 13:01:19.789245  1689 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:19.808543  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 94050.3us
W20260709 13:01:19.789961  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66084us
I20260709 13:01:19.810674  2265 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.813038  1547 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.806913  4613 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.815768  1585 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.817086  4613 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.817706  2262 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.817915  4563 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.818538  4726 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.805600  4703 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:19.819540  1443 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 7, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.819540  4638 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:19.821393  4638 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.821679  1443 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:19.822906  2257 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:19.825558  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.801249  1617 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:19.805795  1687 pending_rounds.cc:85] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 6
I20260709 13:01:19.808810  2261 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:01:19.820065  4703 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.834194  1688 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:19.831409  1687 pending_rounds.cc:107] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:19.836987  1687 raft_consensus.cc:2889] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.837301  1511 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.837558  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.838723  2262 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:19.837071  4726 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:19.856213  4726 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:19.859021  4451 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.860584  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.839273  4778 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.840073  4740 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:19.860870  4715 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.861611  4740 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:19.861891  4581 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:19.862174  1443 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 5, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:01:19.863169  4581 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:19.864306  4581 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.833135  4614 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.865394  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.860608  4638 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:19.865427  4614 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:19.866556  4778 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:19.868042  4614 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:19.867384  1443 catalog_manager.cc:5697] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 4, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.841019  2265 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.833117  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.840411  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:19.851924  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 95456.3us
I20260709 13:01:19.851604  2231 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.852439  4685 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:19.852705  4693 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:19.864765  4563 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.847568  4505 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:19.876641  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.878082  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.862603  4715 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.870334  1443 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 1 to 3, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:19.870761  4703 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:19.910547  1443 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:01:19.912216  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.534s (SENT)
I20260709 13:01:19.913079  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.914469  4541 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:19.915545  2231 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.553s (SENT)
I20260709 13:01:19.916337  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:19.917352  4541 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:19.878861  4522 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:19.912523  1443 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 5, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.896240  4614 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:19.923784  4614 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:19.924818  4614 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.925637  4762 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:01:19.926797  4750 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:19.927328  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 49346.3us
I20260709 13:01:19.929466  4762 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:19.901242  4766 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:19.927421  4750 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:19.881811  4778 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:19.942696  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 102387us
I20260709 13:01:19.941726  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.942499  1539 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.960280  2261 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:19.870766  4740 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:19.968842  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 138071us
I20260709 13:01:19.970894  1659 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:19.952210  4778 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.962348  4662 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:19.974763  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:19.970642  4762 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:19.922749  4693 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:19.971822  4684 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.000710  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:20.005012  2231 leader_election.cc:336] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.606s (SENT)
W20260709 13:01:20.006147  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 179358us
I20260709 13:01:19.981669  4662 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:20.004746  1587 connection.cc:256] RPC call timeout handler was delayed by -1.5076681230000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 13:01:19.981792  4778 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:20.025053  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.015403  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.002980  4727 consensus_queue.cc:1243] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:19.990732  4723 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:20.017066  1620 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:19.975787  4699 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:01:20.011516  4784 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.028614  1510 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:19.993047  4703 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:01:20.012318  4763 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:20.014274  4789 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:20.043607  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 50773.9us
I20260709 13:01:20.047046  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:19.992457  4451 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:01:20.073137  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:20.043661  4789 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.064896  4766 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.092207  1620 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:20.105729  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:20.106868  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:20.107463  1547 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:20.108073  1538 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:20.117332  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:20.118216  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:20.082906  4789 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.117538  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:20.127683  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 122683us
I20260709 13:01:20.131294  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.132083  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:20.136051  1543 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:20.137215  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.138222  1619 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:20.139245  1546 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:20.143116  1539 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.129012  1538 pending_rounds.cc:85] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 5
I20260709 13:01:20.145351  1538 pending_rounds.cc:107] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:01:20.145706  1538 raft_consensus.cc:2889] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:20.147055  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 83041.7us
I20260709 13:01:20.064275  4784 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.041100  4750 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.153378  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:20.154166  1544 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:20.152088  1618 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:20.163682  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1635266280000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:01:20.164134  1587 connection.cc:256] RPC call timeout handler was delayed by -1.162626628000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
W20260709 13:01:20.164427  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1590266280000492s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:01:20.164724  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0879266280000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:01:20.156200  1615 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:01:20.167994  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 122638us
I20260709 13:01:20.170385  2262 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:20.099610  4744 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:01:20.082121  4723 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:01:20.142668  4581 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.169992  4703 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.158437  4810 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:20.187987  1615 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:01:20.172798  4699 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:20.166738  4812 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:20.203521  4809 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:20.204073  4809 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:20.204192  4775 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.204890  4809 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:20.205812  4813 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.206274  4813 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:20.207240  4814 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.207989  4814 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.198717  1615 pending_rounds.cc:85] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 4
I20260709 13:01:20.204591  4822 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.204982  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.217957  1615 pending_rounds.cc:107] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:20.218320  1615 raft_consensus.cc:2889] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:20.218883  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 197848us
I20260709 13:01:20.219878  1622 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:20.213176  1539 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:20.209287  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:20.221804  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.185380  4810 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:20.232448  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79867.9us
W20260709 13:01:20.204104  4808 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:01:20.273311  4815 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:01:20.210723  4812 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.207232  4813 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.285694  1510 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:01:20.286074  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.287074  4814 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.287310  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:20.200881  4699 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.148787  4762 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.292743  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 117639us
I20260709 13:01:20.311367  1617 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:20.312835  4693 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:20.313062  4823 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:01:20.294322  4824 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:01:20.159345  4662 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.218255  4451 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:20.290861  4803 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 13:01:20.348857  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.666s (SENT)
I20260709 13:01:20.281018  4648 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:20.334335  1617 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.334761  1687 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:20.204335  4436 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 13:01:20.289464  4784 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.292490  4810 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:20.351745  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 66142.3us
I20260709 13:01:20.218999  4581 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.363768  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 323823us
W20260709 13:01:20.364730  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 317835us
I20260709 13:01:20.333338  4699 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.378189  4819 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.378820  4827 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.379914  4821 raft_consensus.cc:2764] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:20.380900  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.384387  4834 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:01:20.396474  4806 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260709 13:01:20.396713  4834 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:20.398042  4834 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.327451  4822 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:01:20.399116  4812 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.399824  4822 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:20.400450  4812 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.403417  4834 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.405285  4721 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:20.405710  4721 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.406553  4721 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.407064  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.407824  4721 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.409572  4829 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:20.410252  4829 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:20.410845  4827 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.411399  4829 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.413281  4827 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:20.415055  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57503.8us
I20260709 13:01:20.416258  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.418040  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.349169  4451 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:20.396178  4816 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:01:20.434058  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.354111  4648 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.392999  4763 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:20.468942  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:20.419085  4819 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.474558  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.453878  1617 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.478857  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 147780us
W20260709 13:01:20.483552  2231 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.696s (SENT)
I20260709 13:01:20.483275  4648 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.484651  2231 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.718s (SENT)
I20260709 13:01:20.484789  4648 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:20.485098  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.477617  4819 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.462956  4784 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:20.459242  4563 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:20.497555  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48677.8us
I20260709 13:01:20.498027  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:20.499223  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 170337us
I20260709 13:01:20.500592  1539 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:20.498066  4811 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.511025  4822 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:20.506855  4703 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:20.507545  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.508265  4828 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:20.508841  4451 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.513473  4451 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:20.495152  4392 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.515638  4392 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.517726  4392 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.519060  4824 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:20.519726  4824 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.520174  4824 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:20.520803  4845 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:01:20.522475  4831 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:20.522240  4763 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.522236  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:20.523828  1539 raft_consensus.cc:2393] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:20.528589  4563 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:20.535161  4807 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.492s	user 0.004s	sys 0.000s
I20260709 13:01:20.520661  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:20.544140  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.546164  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.554530  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.556854  2261 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:20.493607  4687 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.494730  4750 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:20.564169  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 146189us
I20260709 13:01:20.576884  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:20.583089  2265 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:20.583581  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:20.543596  4727 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.588639  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:20.589046  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.591008  1544 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:20.574982  4687 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.597036  4687 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.602768   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:20.603137  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.603737  1618 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:20.606606  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:20.589032  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.607270  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:20.608796  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.557618  4784 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.498370  4723 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:01:20.631031  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:20.612496  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.634600  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.635082  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.614884  1510 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:20.564227  4436 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.636121  1585 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:20.636152  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:20.639088  1538 raft_consensus.cc:2393] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:20.564088  4834 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:01:20.640060  1544 raft_consensus.cc:2368] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
W20260709 13:01:20.642045  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 58539.7us
I20260709 13:01:20.643647  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:20.626703  4811 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:20.628248  4684 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:20.660779  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:20.662446  4843 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:01:20.662588  4784 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.639868  4436 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.679589  4436 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.682230  4831 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:20.648773  4819 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:20.687062  2231 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.992s (SENT)
I20260709 13:01:20.688962  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.678009  4614 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:20.619163  4727 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.705804  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 91039.6us
I20260709 13:01:20.706355  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.687422  4684 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.687826  4581 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.697213  4822 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:20.700212  4831 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:20.723474  4831 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.727852  4563 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.728487  4563 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:20.728817  4563 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:20.729631  4563 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.732231  4824 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.713766  4684 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.741693  4684 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.743058  4824 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:20.748651  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.751251  1687 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:20.751495  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.753089  1621 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:20.718804  4822 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:20.755576  1618 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:01:20.755843  4822 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:20.756155  1618 pending_rounds.cc:85] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:01:20.756560  1618 pending_rounds.cc:107] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:01:20.756824  1618 raft_consensus.cc:2889] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.760553  4727 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:20.761605  4852 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 13:01:20.764909  4614 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.765544  4614 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.750413  1617 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:20.772298  4778 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.001s
I20260709 13:01:20.704241  4809 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.735800  4851 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:01:20.736832  4810 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:20.738294  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51331.4us
I20260709 13:01:20.739017  4842 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:20.739022  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47353.2us
W20260709 13:01:20.761670  4715 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.002s
I20260709 13:01:20.792678  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:20.793139  2231 leader_election.cc:336] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.033s (SENT)
I20260709 13:01:20.793426  1619 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:20.793637  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:20.783538  4789 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
I20260709 13:01:20.800809  1613 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:20.801373  1618 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:20.809262  1617 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:01:20.809818  1617 pending_rounds.cc:85] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:01:20.810091  1617 pending_rounds.cc:107] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:20.810374  1617 raft_consensus.cc:2889] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:20.785418  4740 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.823041  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 111482us
I20260709 13:01:20.792824  4541 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:20.843641  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55179.3us
I20260709 13:01:20.794095  4685 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.828163  4766 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:20.859391  1539 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
W20260709 13:01:20.846516  4613 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:20.861099  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.794708  4778 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:20.863623  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 237853us
I20260709 13:01:20.839183  4744 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:20.867542  1511 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:20.873663  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 87929.7us
I20260709 13:01:20.824239  4789 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.854501  4727 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.879345  2261 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:20.879629  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 47655.4us
W20260709 13:01:20.883107  4855 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.286s	user 0.000s	sys 0.003s
W20260709 13:01:20.886757  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.887162  4581 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.887698  2258 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:20.853430  4541 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.890300  4541 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:20.891136  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.890710  4791 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:01:20.892236  4809 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.892313  4687 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.895944  4833 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:20.896523  4833 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.897068  4687 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:20.890802  4684 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.887708  4581 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.898279  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:20.899098  1622 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:20.899225  4819 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.899432  4581 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:20.900614  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.901465  1540 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:20.902498  4778 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.904289  1619 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:20.866365  4811 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:20.905704  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:20.906052  4810 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.905534  4684 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:20.909686  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.862054  4726 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.910909  4726 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.913264  4684 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.913821  4684 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.914911  4789 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:20.915563  4727 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.916323  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:20.917667  4727 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.845114  4740 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:20.919705  4740 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:20.920213  4684 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:20.920353  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:20.920676  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65153.2us
I20260709 13:01:20.922864  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:20.848546  4834 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:20.850636  4842 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:01:20.930094  4436 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.916429  4726 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:20.942988  4744 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:20.966972  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 99494us
I20260709 13:01:20.938380  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:20.977232  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:20.995101  2264 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:20.995385  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:20.996353  2262 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:01:20.999254  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:20.999276  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 390564us
I20260709 13:01:21.000388  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:21.001515  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:20.999555  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:20.999889  1614 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:20.853163  4685 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.012696  4843 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.013237  4843 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.013747  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:21.013867  4685 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:21.015152  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.016395  2231 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.017275  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:21.018810  4869 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:21.019275  4869 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.019629  4869 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:20.974524  4699 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:01:20.970671  4810 raft_consensus.cc:2764] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:21.015313  4750 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:21.018437  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:20.979020  4831 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:21.018265  4614 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:20.997138  4763 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:01:21.115561  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:21.029726  4699 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.140252  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:21.032375  2262 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:01:21.155458  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 137082us
W20260709 13:01:21.103454  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 90141.1us
W20260709 13:01:21.047463  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.229784  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 213472us
W20260709 13:01:21.205991  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:21.230445  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.230773  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:21.114102  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.210250  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:21.232331  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.001847  4740 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.234179  4876 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:21.234848  4876 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.166910  4744 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:21.014537  4685 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.222s
I20260709 13:01:21.028950  4750 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:21.031301  4451 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:21.237792  4876 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.237845  4750 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:21.114849  4809 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:21.240077  4822 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.227878  4436 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:21.242149  4822 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:21.235324  2263 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:21.243207  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.243983  1696 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:21.245069  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.247123  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:21.233456  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 117965us
I20260709 13:01:21.247812  1544 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.211032  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:21.167445  4861 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.434s	user 0.000s	sys 0.004s
W20260709 13:01:21.249964  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 109848us
I20260709 13:01:21.251101  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:21.251391  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.252205  1538 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:21.253309  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.254142  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.254779  4864 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.248378  4726 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.294373  1693 raft_consensus.cc:2393] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:21.294510  4726 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.295665  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.296494  4563 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.296741  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.296873  4726 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.297783  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:21.234858  4740 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:21.298501  4740 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.298646  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:21.298944  4740 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:21.092336  4648 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:21.256696  4811 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:21.256886  1689 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:01:21.257640  1542 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:21.259495  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.260341  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.258721  4869 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.258754  4876 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:21.167969  4843 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:21.025596  4791 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.096192  4833 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:21.262899  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.319626  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:21.320365  1620 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:21.025367  4784 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.266s
I20260709 13:01:21.290964  1687 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:21.291165  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:21.256699  4822 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.328764  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:21.294716  4864 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.115628  4831 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:21.042927  4541 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.309823  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.330003  1538 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:21.317085  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59953.3us
I20260709 13:01:21.249226  2257 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:21.317718  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:21.301776  4809 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:21.344133  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:21.328523  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:21.308849  4451 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:21.344728  1543 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.343623  4810 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.343891  4876 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:21.309989  4811 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:21.348480  4707 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.379706  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.381078  1687 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:21.349030  4809 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.372241  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:21.396416  1620 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:21.416118  4614 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:21.413539  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.326802  4775 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:01:21.482848  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 220055us
I20260709 13:01:21.483168  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.495679  1689 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:21.344033  4750 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.345989  4858 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:01:21.399119  4707 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:21.484864  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 153863us
I20260709 13:01:21.413630  4876 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:21.484098  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:21.500458  1688 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:21.380715  4810 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.502915  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.503542  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.485575  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:21.554188  1687 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:21.554425  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51570.4us
I20260709 13:01:21.554939  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:21.555192  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:21.556146  4842 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:21.512231  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:21.558650  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46677.1us
I20260709 13:01:21.551162  2262 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:21.559343  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:21.564993  1687 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:21.569445  2231 leader_election.cc:400] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
I20260709 13:01:21.569875  2231 leader_election.cc:403] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:21.566885  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:21.571146  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.573839  1688 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:21.571079  4858 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.505252  4791 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:01:21.563961  4869 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.587394  1688 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:21.587177  4876 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:21.591112  4879 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:01:21.591887  4813 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.592774  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1756) took 1200 ms. Trace:
W20260709 13:01:21.593086  4883 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:21.549888  4862 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:21.593194  1615 rpcz_store.cc:276] 0709 13:01:20.392323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.392603 (+   280us) service_pool.cc:224] Handling call
0709 13:01:20.449845 (+ 57242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.596217 (+146372us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:20.857965 (+261748us) log.cc:844] Serialized 14 byte log entry
0709 13:01:21.078954 (+220989us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.092687 (+ 13733us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.102816 (+ 10129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:21.102869 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.102974 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:21.592532 (+489558us) raft_consensus.cc:1685] finished
0709 13:01:21.592556 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:21.592713 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60313,"prepare.queue_time_us":113124,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":164821,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":38260,"thread_start_us":473825,"threads_started":3,"wal-append.queue_time_us":463058}
I20260709 13:01:21.595371  4541 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7.
I20260709 13:01:21.596024  1615 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:21.596498  4614 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:21.597071  4614 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:21.550750  4451 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.597991  4614 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.599289  1615 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:01:21.599747  1615 pending_rounds.cc:85] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 2
I20260709 13:01:21.599974  1615 pending_rounds.cc:107] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:01:21.600212  1615 raft_consensus.cc:2889] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:21.612232  4869 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:21.614023  1688 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:01:21.616303  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.618368  1688 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.618674  1543 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:21.618250  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.578711  4727 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:21.623550  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.597697  4699 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.510268  4831 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.629323  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:21.630505  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.642123  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.643240  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.643441  1696 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:21.647082  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:21.647821  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.617900  4784 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.653462  4784 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.654229  4824 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.654688  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.654953  4824 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:21.656107  4784 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.656177  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.649659  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:21.657133  4685 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:21.657307  1692 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:21.617827  4862 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.622898  4727 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.657543  4685 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:21.665982  4505 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:21.645607  4811 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.667032  1544 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:21.652500  4581 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:01:21.667595  4821 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.673120  1546 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:21.676728  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2297) took 1570 ms. Trace:
I20260709 13:01:21.622442  4869 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.619654  4891 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:01:21.705137  1688 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:21.703532  1540 rpcz_store.cc:276] 0709 13:01:20.106931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.118110 (+ 11179us) service_pool.cc:224] Handling call
0709 13:01:20.118590 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.901870 (+783280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.676422 (+774552us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b5400208854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:21.676630 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800097664}
I20260709 13:01:21.660789  4762 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.668911  4775 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.677913  4727 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.702893  4864 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.677733  4862 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.755491  4885 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.758525  4750 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.757894  4824 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.746897  4762 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:21.805992  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 159040us
I20260709 13:01:21.779757  4707 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.783795  4810 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:21.815361  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:21.704797  4703 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:21.846019  1692 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:21.848291  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:21.806136  4842 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:21.852217  1512 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:21.855253  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:21.849949  4889 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:21.841832  4891 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:01:21.856936  4889 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:01:21.857576  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 299704us
I20260709 13:01:21.813235  4581 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:21.878119  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.869635  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:21.789105  4885 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.893527  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:21.833119  4614 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.791649  4685 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.857492  4707 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.941282  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:21.941083  4707 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.942209  1692 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:21.867528  4505 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:01:21.889453  4827 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:21.898636  4829 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:21.902576  4392 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:21.959159  4862 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.959961  4811 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.867719  4819 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:01:21.968178  4707 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:21.968341  4885 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:21.970377  4762 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:21.971561  4890 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 13:01:21.977464  4740 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
W20260709 13:01:21.984615  4563 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.688s	user 0.011s	sys 0.000s
W20260709 13:01:21.992488  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:21.993613  1585 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:21.993907  4451 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.994412  4451 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.996503  4451 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:21.905223  4887 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:01:21.998751  4662 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.867653  4791 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.000428  4791 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.889465  4715 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:22.003413  4715 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:22.004765  4842 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:22.004522  4715 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.005407  4842 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:21.906272  4581 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:21.854761  4881 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:22.014140  4869 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:21.853993  4864 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:01:22.014814  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:22.015277  4888 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:01:22.015475  2265 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:22.016964  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1757) took 1515 ms. Trace:
I20260709 13:01:22.017407  1613 rpcz_store.cc:276] 0709 13:01:20.502026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.502177 (+   151us) service_pool.cc:224] Handling call
0709 13:01:20.502480 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.807286 (+304806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.016716 (+1209430us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002b7fd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:22.016891 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667492736}
I20260709 13:01:22.018747  4897 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.019483  4897 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:21.934424  4614 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.023252  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 739) took 1231 ms. Trace:
I20260709 13:01:22.023677  2261 rpcz_store.cc:276] 0709 13:01:20.791622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.801809 (+ 10187us) service_pool.cc:224] Handling call
0709 13:01:20.827923 (+ 26114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:20.880887 (+ 52964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.022971 (+1142084us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b54005a00d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:22.023169 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110070016}
I20260709 13:01:22.026113  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:22.031023  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.031863  1687 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:21.857836  4822 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:01:22.043258  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 49740us
I20260709 13:01:21.867771  4821 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:22.029412  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:22.067716  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:21.868160  4889 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.069015  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:22.076400  1541 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:22.024185  4699 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:21.978060  4740 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.024382  4819 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.014829  4864 consensus_queue.cc:1243] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:01:22.095894  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 474091us
I20260709 13:01:22.064059  4784 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.063333  4715 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.109073  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.080081  4821 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.080647  4778 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:22.073488  4814 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:22.226747  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:22.210760  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 99740.3us
W20260709 13:01:22.140216  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 110937us
W20260709 13:01:22.249639  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.250372  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:22.236866  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 171427us
I20260709 13:01:22.243111  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:22.251041  1691 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:22.251992  1687 pending_rounds.cc:85] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 2
I20260709 13:01:22.260119  1687 pending_rounds.cc:107] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:22.260470  1687 raft_consensus.cc:2889] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:22.190847  4813 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.010s
I20260709 13:01:22.247068  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:22.263787  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.268028  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.223341  4581 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.269449  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.271495  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:22.275451  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.275842  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:22.264573  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:22.176352  4862 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:22.297034  4870 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:22.225905  4614 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.297506  1690 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:22.175984  4822 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:22.242663  4821 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.106820  4685 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.211198  4775 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.215322  4897 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.191009  4811 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.319424  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.319540  4811 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.312753  4822 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.295725  4864 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:22.322434  4864 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.138741  4829 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:22.323589  4864 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.324565  4829 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.236830  4791 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:22.327137  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.272454  4828 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.328619  4828 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:22.333256  4903 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:01:22.269364  4836 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.306054  4911 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.269631  4865 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.263127  4885 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.109274  4819 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.139935  4392 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:22.094461  4699 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.243319  4814 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:22.321906  4811 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.269054  4810 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:22.340638  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:22.442340  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.337292  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 562) took 1365 ms. Trace:
I20260709 13:01:22.345454  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:22.337582  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:22.430465  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 187387us
I20260709 13:01:22.338835  4865 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:22.179955  4898 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:01:22.297533  4840 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.297722  4881 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.452232  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:22.305663  4870 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.303854  4862 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:22.337230  4727 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.004s
I20260709 13:01:22.437300  4814 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:22.258487  4784 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.258797  4778 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.445557  1619 rpcz_store.cc:276] 0709 13:01:20.971973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.972120 (+   147us) service_pool.cc:224] Handling call
0709 13:01:20.972522 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.112220 (+139698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.112247 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.127273 (+ 15026us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.231274 (+104001us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:21.231300 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:21.261021 (+ 29721us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4800032358. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:01:22.337010 (+1075989us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002ed454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:22.337062 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:22.337104 (+    42us) raft_consensus.cc:1685] finished
0709 13:01:22.337117 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.337238 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55990,"raft.queue_time_us":3038,"raft.run_cpu_time_us":1964,"raft.run_wall_time_us":138016,"spinlock_wait_cycles":330105472,"thread_start_us":101691,"threads_started":1,"wal-append.queue_time_us":239730}
I20260709 13:01:22.474570  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:22.431742  4876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.009s	sys 0.033s
I20260709 13:01:22.340692  4614 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.344820  4819 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.507941  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 745) took 1376 ms. Trace:
I20260709 13:01:22.484838  4862 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:22.481405  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 136030us
I20260709 13:01:22.521034  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:22.382472  4581 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:22.484071  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:22.529644  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45698.1us
I20260709 13:01:22.334591  4740 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:22.342464  4835 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.771s	user 0.006s	sys 0.000s
I20260709 13:01:22.382776  4662 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:22.486346  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.444554  4648 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:22.336787  4915 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.151s
I20260709 13:01:22.482815  4870 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.339272  4885 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.500139  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.335259  4836 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.542738  2262 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:22.499372  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.543895  2264 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:01:22.480572  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:22.487692  4810 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.489590  4726 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:22.499828  4876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.010s	sys 0.034s
I20260709 13:01:22.496289  4505 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:22.508363  2266 rpcz_store.cc:276] 0709 13:01:21.131478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.141446 (+  9968us) service_pool.cc:224] Handling call
0709 13:01:22.227209 (+1085763us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:22.227391 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:22.227793 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:22.228362 (+   569us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.507613 (+279251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:22.507664 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:22.507705 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.507766 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.507882 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7997,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":134777600,"thread_start_us":278023,"threads_started":1}
I20260709 13:01:22.335810  4911 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.554069  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:22.489207  4727 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.533456  4451 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.617437  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:22.613008  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 62413.2us
I20260709 13:01:22.620796  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:22.560247  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 304903us
I20260709 13:01:22.474571  4840 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.621455  1615 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.621927  1621 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:22.614898  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.615729  1695 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 5.
I20260709 13:01:22.536537  4648 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:22.616319  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.623131  1691 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:22.616940  2261 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:22.627087  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 96239.2us
I20260709 13:01:22.627470  1693 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:22.627415  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.627429  1694 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:22.628345  1619 raft_consensus.cc:2410] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:22.478425  4881 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.616127  4885 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.607583  4809 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.652555  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.653189  2263 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:22.609086  4829 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.658038  1690 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:22.659333  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:22.551900  4810 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:22.665266  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1486) took 2559 ms. Trace:
I20260709 13:01:22.600818  4726 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.639436  1613 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:22.640027  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.633471  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.668510  1696 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:22.639557  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:22.670357  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.542460  4662 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.602957  4505 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.654408  2262 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:01:22.540899  4819 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.656082  2265 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:22.664425  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.540627  4581 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.671559  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:22.650444  4703 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:22.665640  1616 rpcz_store.cc:276] 0709 13:01:20.093188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.093541 (+   353us) service_pool.cc:224] Handling call
0709 13:01:20.130306 (+ 36765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:20.130864 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:20.130907 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:20.165292 (+ 34385us) log.cc:844] Serialized 26 byte log entry
0709 13:01:20.334982 (+169690us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:20.335018 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:20.335082 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:22.341835 (+2006753us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:22.638104 (+296269us) raft_consensus.cc:1685] finished
0709 13:01:22.638123 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.652379 (+ 14256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65303936,"thread_start_us":136689,"threads_started":1,"wal-append.queue_time_us":301806}
I20260709 13:01:22.710186  1617 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:22.600860  4904 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:01:22.736088  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:22.622964  4687 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:22.551017  4906 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 13:01:22.740024  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.542881  4392 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.656754  4897 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.709100  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:22.736577  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:22.740749  1616 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:22.740926  1614 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:22.520073  4614 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.740024  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:22.739566  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:22.737984  4842 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.732s	user 0.014s	sys 0.000s
I20260709 13:01:22.671865  4810 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.640623  4541 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:01:22.738847  4703 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.627264  4451 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.746495  1620 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:22.740127  4904 consensus_queue.cc:1243] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:22.673043  4505 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:22.712616  4927 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:22.747895  1618 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:22.757658  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 203694us
W20260709 13:01:22.759900  4913 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:22.757620  4703 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.765394  1510 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:22.765578  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:22.765900  1619 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:22.764904  4614 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.771278  4826 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:22.772851  4869 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:22.773236  4869 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:22.774142  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:22.774076  4869 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.774606  4662 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.774978  4826 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:22.775344  4826 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.775457  4869 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:22.775691  4826 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.779754  4581 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:22.780627  4715 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.005s
I20260709 13:01:22.780848  4836 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.783340  4826 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.785910  4826 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:22.786552  4889 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.003s
I20260709 13:01:22.793025  4784 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.792851  4889 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.794807  4840 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.790277  4864 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.796481  4898 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.790978  4821 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:22.797008  4898 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.794893  4819 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:22.798916  4778 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.787901  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:22.799754  2257 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:22.758240  4699 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.800410  4864 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.801002  4821 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.795043  4889 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.802603  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:22.802929  4727 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:22.803565  4917 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:01:22.803603  4876 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:22.804396  4876 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:22.805408  4876 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.806632  2262 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:01:22.755497  4842 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.737636  4824 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:22.808573  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.809015  4833 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:22.809233  2266 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:22.809509  4833 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:22.807004  2262 pending_rounds.cc:85] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 5
I20260709 13:01:22.670306  4829 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.810400  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:22.816402  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:22.812273  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:22.798429  4912 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:01:22.825028  2262 pending_rounds.cc:107] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:22.829035  1615 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:22.878842  2265 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:22.922797  2262 raft_consensus.cc:2889] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:22.967592  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:22.813931  4919 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:22.817859  4898 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.766397  4929 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:22.810434  4833 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.789444  4451 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.790055  4726 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:22.808626  4842 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:22.921324  4904 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.803710  4865 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:22.981078  1687 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:22.980957  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:22.937181  4809 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.791425  4881 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:22.750811  4897 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.821821  4927 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:22.974609  4929 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.165732  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 497) took 1331 ms. Trace:
W20260709 13:01:23.171846  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.004s
W20260709 13:01:23.172295  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.004s
I20260709 13:01:23.096619  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1582) took 1066 ms. Trace:
I20260709 13:01:23.171729  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.171795  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:23.181119  1620 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:23.111429  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:23.172816  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 544372us
I20260709 13:01:23.185290  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:23.186921  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 206056us
W20260709 13:01:23.186789  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.009s
W20260709 13:01:23.187805  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.007s	sys 0.009s
I20260709 13:01:23.186721  1613 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:23.188067  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:23.196295  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.002s
W20260709 13:01:23.197250  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 380934us
I20260709 13:01:23.173028  1692 rpcz_store.cc:276] 0709 13:01:22.030175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.039356 (+  9181us) service_pool.cc:224] Handling call
0709 13:01:22.090648 (+ 51292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:22.091145 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.091185 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:22.187625 (+ 96440us) log.cc:844] Serialized 52 byte log entry
0709 13:01:22.533542 (+345917us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:22.712115 (+178573us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.741429 (+ 29314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.741543 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.096354 (+354811us) raft_consensus.cc:1685] finished
0709 13:01:23.096375 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.096538 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35522,"prepare.queue_time_us":433364,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":25351,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":21295,"thread_start_us":418731,"threads_started":2,"wal-append.queue_time_us":461124}
I20260709 13:01:23.201745  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:23.100997  4862 consensus_meta.cc:287] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
W20260709 13:01:23.196832  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.015s	sys 0.003s
I20260709 13:01:23.202639  2265 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:23.172066  2259 rpcz_store.cc:276] 0709 13:01:21.834252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.934164 (+ 99912us) service_pool.cc:224] Handling call
0709 13:01:21.959139 (+ 24975us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:21.959690 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:21.960030 (+   340us) log.cc:844] Serialized 14 byte log entry
0709 13:01:22.459817 (+499787us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:22.489518 (+ 29701us) log.cc:844] Serialized 52 byte log entry
0709 13:01:22.489722 (+   204us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:22.489768 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.489855 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.165325 (+675470us) raft_consensus.cc:1685] finished
0709 13:01:23.165356 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.165544 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3426,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":363,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":6527,"thread_start_us":498802,"threads_started":1,"wal-append.queue_time_us":595650}
W20260709 13:01:23.202801  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 532741us
I20260709 13:01:23.185006  4541 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.186203  4916 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:23.023305  4814 consensus_meta.cc:287] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.002s
I20260709 13:01:23.098389  4829 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.209852  1510 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.190416  4740 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.217199  1694 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:23.217357  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:23.222555  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.196435  4881 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:23.194480  4775 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:23.224562  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.198787  4750 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.230510  1544 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:23.231496  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.235678  1543 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:23.236946  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.232467  2257 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:23.201634  4843 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.170568  4505 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:23.244967  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46731.4us
I20260709 13:01:23.253453  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.027668  4648 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.196154  4904 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.263671  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.261044  1547 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:23.262768  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.261726  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.265973  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:23.275342  1546 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:23.266717  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.206821  4451 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:23.211256  4862 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.227345  4775 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:23.220141  4726 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.224205  4869 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.281833  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:23.233573  4906 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:23.283274  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 513) took 1015 ms. Trace:
I20260709 13:01:23.212092  4685 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:01:23.284430  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:23.285800  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.240716  4811 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:23.291038  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.191445  4809 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:23.294844  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1497) took 2257 ms (client timeout 2233 ms). Trace:
I20260709 13:01:23.219765  4541 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.224009  4923 consensus_queue.cc:1059] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:01:23.260823  4581 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.281635  4727 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.296458  4392 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:23.300170  1622 rpcz_store.cc:269] 0709 13:01:21.024876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.315786 (+290910us) service_pool.cc:224] Handling call
0709 13:01:23.282325 (+1966539us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54001eb254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:23.282435 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855441664}
I20260709 13:01:23.234663  4829 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.224557  4814 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.303059  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.373054  1547 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:23.308508  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 112617us
I20260709 13:01:23.242311  4740 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.296532  1691 rpcz_store.cc:276] 0709 13:01:22.267579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.267746 (+   167us) service_pool.cc:224] Handling call
0709 13:01:23.283125 (+1015379us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400433854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:23.283220 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":812005120}
W20260709 13:01:23.261035  4891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.041s	sys 0.052s
W20260709 13:01:23.377358  4891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.042s	sys 0.052s
I20260709 13:01:23.283344  4938 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.327142  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.317176  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.380316  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:23.251931  4843 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.294431  4881 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:23.334880  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:23.299317  4906 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.294010  4775 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.301143  2262 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:23.345573  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.394940  1543 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:23.346318  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.395967  1540 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:23.346740  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.353850  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.356539  4828 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:23.361786  4924 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.382s	user 0.001s	sys 0.009s
I20260709 13:01:23.371881  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.386960  1695 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:23.308068  4750 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:23.312661  4451 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.378175  4938 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.327905  4897 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.304185  4726 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.399622  1621 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.399029  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.404410  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:23.407435  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 125689us
I20260709 13:01:23.310803  4869 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:01:23.379045  4908 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.202s	user 0.003s	sys 0.000s
I20260709 13:01:23.414090  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.415970  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.416905  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.395324  4906 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.393008  4865 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:23.309358  4811 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.414072  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:23.345916  4727 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.435566  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.436636  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.435954  1545 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:23.439950  1613 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:23.438720  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.440604  1543 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:23.442206  1543 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:23.439352  1618 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:23.443289  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.444782  1543 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:23.446599  1543 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:23.446895  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.447777  1687 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.448808  1543 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:23.449887  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.458001  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.458691  1691 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:23.450516  4927 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.408795  4928 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:23.387176  4829 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:23.453326  4925 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
W20260709 13:01:23.417012  4870 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.862s	user 0.012s	sys 0.000s
I20260709 13:01:23.458873  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.476485  1615 raft_consensus.cc:2410] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:23.476927  4809 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.461787  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.418475  4451 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:23.479642  4703 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.715s	user 0.009s	sys 0.000s
I20260709 13:01:23.480046  4703 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.480459  4451 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.480700  4833 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.481545  1695 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:23.482873  4935 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.483385  4935 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.484117  4911 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.461781  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.485535  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.485818  1622 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:23.451686  4727 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.459769  1539 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:23.488412  4946 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.488940  4541 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:23.427011  4929 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.475242  1688 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.476094  4870 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.473735  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.500892  1694 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:23.452945  4814 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.492273  1544 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.492324  1691 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:23.496726  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.503168  4648 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.506717  1687 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
W20260709 13:01:23.485484  4901 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.306s	user 0.002s	sys 0.001s
W20260709 13:01:23.473835  4937 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:01:23.532683  1694 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:23.526027  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.534236  1543 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:23.535703  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:23.530790  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:23.485528  4935 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.571609  1689 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:23.572163  1547 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:23.495813  4791 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:23.568084  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:23.461999  4707 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 13:01:23.570241  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 210846us
I20260709 13:01:23.578594  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.583179  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.585312  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.488978  4946 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.490772  4928 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.678718  1694 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:23.678460  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 343717us
I20260709 13:01:23.678516  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.645354  1543 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:23.681423  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.593921  1620 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:23.615887  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 230817us
I20260709 13:01:23.588415  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:23.670221  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 334913us
I20260709 13:01:23.624195  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.654903  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.685600  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.687029  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:23.688141  1689 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:23.688429  1540 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:23.695534  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.696625  1540 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:23.631014  4945 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:01:23.700754  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.729044  1543 raft_consensus.cc:2410] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:01:23.582484  4648 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:23.701702  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:23.652876  4943 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 13:01:23.647070  4941 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:01:23.661609  4904 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.702970  2259 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:23.703861  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.704694  4928 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.705169  4831 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:23.706772  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 749) took 2403 ms. Trace:
W20260709 13:01:23.708472  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 132507us
I20260709 13:01:23.711385  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.749822  1687 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:23.713490  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.685534  4740 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:23.573982  4791 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.573773  4778 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.701076  4829 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.689260  4920 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.585044  4727 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:23.743116  1539 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:23.685108  4821 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.744983  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.750908  1688 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:23.574376  4929 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:01:23.756465  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.728374  4763 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.762297  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.730656  4648 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.747460  4750 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:23.807524  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 62709.1us
I20260709 13:01:23.848531  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:23.759449  4451 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:01:23.749465  2260 rpcz_store.cc:276] 0709 13:01:21.275127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.352000 (+ 76873us) service_pool.cc:224] Handling call
0709 13:01:21.415284 (+ 63284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.585193 (+169909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.585230 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:21.612033 (+ 26803us) log.cc:844] Serialized 26 byte log entry
0709 13:01:21.814799 (+202766us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:21.814846 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.657666 (+842820us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540012e654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:22.657726 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.484916 (+827190us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:23.677792 (+192876us) raft_consensus.cc:1685] finished
0709 13:01:23.677816 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.677968 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26277,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":341837440,"thread_start_us":191401,"threads_started":1,"wal-append.queue_time_us":567013}
I20260709 13:01:23.756839  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
W20260709 13:01:23.774219  4810 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.014s	user 0.012s	sys 0.000s
I20260709 13:01:23.760068  4952 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:23.862968  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:23.863335  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 171314us
I20260709 13:01:23.855623  1540 raft_consensus.cc:606] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:23.864081  1540 raft_consensus.cc:614] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:23.864188  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:23.749150  4614 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:01:23.746130  4954 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:23.788002  1544 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:23.870129  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.795198  1542 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:23.797384  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.805335  1543 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:23.776355  4935 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:23.807220  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.844310  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:23.726575  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.885332  1546 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:23.851930  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.886142  1619 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:23.852866  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:23.847749  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 160806us
I20260709 13:01:23.888689  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:23.766258  4791 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:23.865000  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:23.866117  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.896770  2266 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:23.853842  4933 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:23.905370  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 52618.5us
I20260709 13:01:23.883404  1620 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:23.760532  4831 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.892911  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:23.958142  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65321.4us
I20260709 13:01:23.894320  4687 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:23.959057  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:23.807103  4811 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.848443  4898 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:23.772655  4541 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:01:23.788997  4938 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:23.895102  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.848743  4648 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:23.895848  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.981726  1688 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:23.843688  4684 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:23.898270  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.766258  4740 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:23.894488  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.898861  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:23.899470  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:23.899940  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.901224  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.902069  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.902912  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:23.880609  4763 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.765866  4869 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.847034  4750 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.861621  4923 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.781142  4778 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.885895  4809 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:23.881872  4814 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:23.805122  4727 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:23.935092  1618 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:23.935281  1546 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:23.935647  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:23.937120  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:23.910758  4392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.023s
I20260709 13:01:23.948388  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:23.881441  4870 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.007236  4750 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:23.875792  4810 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:23.955672  4939 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:23.955962  4929 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:24.058866  4937 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:23.797442  4920 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:23.964622  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 100520us
I20260709 13:01:23.966110  1540 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:23.904599  4933 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.895360  4935 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.108603  4933 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.108916  4505 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.110229  4935 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.854005  4964 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:01:23.924156  4927 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:24.111972  4927 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.113842  4862 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.980059  2260 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:24.114261  4927 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:23.904045  1619 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.127002  4831 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.019657  4923 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.127729  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.129014  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:23.992166  1622 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:24.129385  4923 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.061093  4928 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.130175  4928 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.130303  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.130563  4928 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.131007  1622 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.131940  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1507) took 1506 ms. Trace:
I20260709 13:01:24.132339  1621 rpcz_store.cc:276] 0709 13:01:22.625809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.626023 (+   214us) service_pool.cc:224] Handling call
0709 13:01:22.626267 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:23.419864 (+793597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.131701 (+711837us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54000eea54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:24.131879 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763870592}
I20260709 13:01:23.982520  1544 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:24.001797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.135317  1616 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:24.136502  1616 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:24.137799  1616 pending_rounds.cc:85] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 1
I20260709 13:01:24.138054  1616 pending_rounds.cc:107] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:24.138293  1616 raft_consensus.cc:2889] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:23.973999  4953 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:24.139181  4703 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.000995  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:23.891018  4954 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.006889  4938 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:01:24.140781  4938 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:24.141181  4938 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:24.141415  4954 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.017683  4784 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:24.020547  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.142024  4784 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:23.965878  4687 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:24.142751  4687 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.142973  4784 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.144199  4784 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.126904  4885 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:24.145658  4885 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:24.018337  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:24.146476  4885 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:24.147220  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 128976us
I20260709 13:01:24.147583  4885 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:24.147872  4505 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:24.148281  4505 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:24.148640  4505 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.151439  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.032366  1688 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:24.044906  1687 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:23.995580  4740 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.152103  1690 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:24.056377  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:24.056766  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 108477us
I20260709 13:01:24.163209  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:23.937172  4451 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.170435  4831 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:24.170759  4451 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.171176  4831 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:24.060302  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 99887.8us
W20260709 13:01:24.062239  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 173626us
I20260709 13:01:23.807339  4821 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.021628  4898 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:23.985536  4811 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:01:24.012470  4809 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:24.210315  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:24.210448  4614 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:24.210927  1540 raft_consensus.cc:606] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:24.211388  1540 raft_consensus.cc:614] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:24.210999  4614 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:24.056742  4906 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:01:24.211477  4791 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.212051  4906 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.213105  1538 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:24.213619  4791 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.214059  4906 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.070525  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:24.214861  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 144450us
I20260709 13:01:24.214953  4811 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:24.215360  4811 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:24.215706  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:24.215936  4898 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:24.216179  4811 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.216737  4954 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.216835  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:24.217232  4954 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.217398  4811 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.013490  4684 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.217643  4954 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.215713  1585 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:24.218811  4885 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.219388  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:24.079788  4833 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.002s
I20260709 13:01:24.087405  4843 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.095381  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.097122  4828 raft_consensus.cc:3055] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:24.219219  4885 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.105508  4726 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.106717  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:23.984936  1614 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:24.117201  4949 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.593s	user 0.002s	sys 0.001s
I20260709 13:01:24.117741  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:24.253229  1689 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:24.120648  4970 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:01:24.120940  4916 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:24.123612  4968 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:24.161199  4740 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.166445  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.167688  4763 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.169000  1622 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:24.171267  4451 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.060894  1543 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:24.058709  4959 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:24.175881  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.186743  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.233839  4876 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.199918  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:24.202894  4831 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.203433  4727 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.178503  4842 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:24.208021  4750 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.208984  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.301674  1546 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:24.209184  4821 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.209576  4981 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:24.308722  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:24.210098  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:24.056943  4392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.008s	sys 0.028s
I20260709 13:01:24.216982  4898 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.074635  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.235625  4935 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:01:24.229676  2263 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:24.143071  4976 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:24.232005  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.244606  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.244752  4614 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.245853  4933 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:24.202054  4775 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.785s	user 0.009s	sys 0.002s
I20260709 13:01:24.249903  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:24.335343  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.142086  4938 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.256327  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:24.254017  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 136361us
I20260709 13:01:24.255990  4828 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:24.260689  4833 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.270846  4778 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.239176  4927 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:24.309518  4842 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:24.196882  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.282883  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.315531  4392 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:24.284900  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.256026  4836 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.193058  4784 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:01:24.288050  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:24.288704  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.291427  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.252005  4946 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.256994  4885 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.220839  4814 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:01:24.299226  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.299620  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.299801  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.238363  4906 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:01:24.303231  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.211088  4809 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.083284  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.266324  4703 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:24.322346  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.324591  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.337036  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:24.406847  2265 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.384047  4836 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:24.407445  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70545.8us
I20260709 13:01:24.407586  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.408210  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:24.408776  4836 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:24.408964  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 120982us
I20260709 13:01:24.409327  4836 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:24.409749  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:24.409986  4791 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.410409  4791 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.410765  4791 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:24.346330  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 96544.2us
I20260709 13:01:24.411808  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.413040  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.235878  4824 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.414167  4824 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:24.414595  4824 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:24.414425  4964 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:24.414821  4581 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:24.415382  4581 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:24.416543  4703 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:24.417255  4973 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:24.416844  4581 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.417606  4703 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:24.417997  4703 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:24.418823  4961 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:24.419013  4865 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:24.419283  4961 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:24.419634  1617 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:01:24.420142  4961 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.421037  1688 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:24.421121  4809 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.421322  4961 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.283792  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.290059  4959 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.423107  2266 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:24.423439  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.423866  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.418839  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.424630  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.424963  4959 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.296921  4876 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.425590  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.426009  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:24.426173  1695 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:24.380604  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.427040  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.403105  4984 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:24.427919  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.428973  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.290185  4953 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:01:24.403055  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.420538  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.431835  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.432164  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.432391  1690 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:24.432755  1617 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:24.433193  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.433763  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.426955  4750 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.419663  4865 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:24.435593  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.435652  4865 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.436972  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:24.438153  4962 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.342361  1692 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:24.438582  4962 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.438997  4962 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.428073  4984 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.409785  4836 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:24.439929  4984 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:24.440486  4836 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.349499  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.418839  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.441854  1687 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:24.442230  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.442483  1614 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:24.443190  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:24.427608  1695 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:24.443538  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.444129  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:24.444281  1614 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:24.408257  1620 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:24.445864  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.447283  1614 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:24.350677  4927 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.433734  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:24.465324  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 265507us
I20260709 13:01:24.426955  4876 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.466816  1690 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:24.466899  2265 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:24.467760  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.468267  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1854) took 1241 ms. Trace:
I20260709 13:01:24.468430  1614 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:24.468643  1538 rpcz_store.cc:276] 0709 13:01:23.226900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.227652 (+   752us) service_pool.cc:224] Handling call
0709 13:01:23.227951 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.213473 (+985522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.468037 (+254564us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54002dda54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:24.468214 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265340288}
I20260709 13:01:24.446202  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 521) took 1054 ms. Trace:
W20260709 13:01:24.445941  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51412.6us
I20260709 13:01:24.349992  4843 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.449200  1617 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:24.323195  4981 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.496083  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.499958  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.500572  1539 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:24.500999  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:24.501547  1546 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.503222  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:24.471091  1693 rpcz_store.cc:276] 0709 13:01:23.391884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.392107 (+   223us) service_pool.cc:224] Handling call
0709 13:01:23.392463 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.404995 (+ 12532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.405044 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.421926 (+ 16882us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.747102 (+325176us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:23.747171 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.747266 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.122897 (+375631us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:24.382140 (+259243us) raft_consensus.cc:1685] finished
0709 13:01:24.382162 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.446143 (+ 63981us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58455,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"spinlock_wait_cycles":85750144,"thread_start_us":270072,"threads_started":1,"wal-append.queue_time_us":431818}
I20260709 13:01:24.507344  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:24.506774  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:24.489948  4949 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:01:24.472831  4927 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:24.492871  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:24.347242  4775 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.473441  4938 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.494241  4843 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.507959  4614 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:01:24.426029  4928 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.490933  4687 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.500324  4953 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.157s
I20260709 13:01:24.652519  1614 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:01:24.520459  1688 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
W20260709 13:01:24.552112  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 59362.2us
W20260709 13:01:24.832679  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.537423  1546 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
W20260709 13:01:24.588973  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.549394  1617 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:24.937832  4687 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.938534  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.521255  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2244) took 1752 ms. Trace:
I20260709 13:01:24.676702  1691 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:24.939540  1617 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 5: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:24.677608  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.940691  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:24.539633  1695 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:24.945318  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.946806  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.948108  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.511391  1692 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:24.657653  1687 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:24.550149  4703 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.949497  4687 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.949812  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.949997  4687 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:24.512064  4392 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.546182  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:24.950903  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.951318  1620 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:24.951467  1687 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:24.952207  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:24.952399  1620 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:24.952699  1687 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:24.953557  1620 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:24.937117  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.953576  1687 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:24.955456  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:24.628533  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 121239us
I20260709 13:01:24.956017  1546 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:24.506750  4810 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.956820  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.957782  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.958755  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.959731  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.954370  1617 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:24.543931  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.963058  1538 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:24.964351  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.552866  1689 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:24.765797  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.007s	sys 0.010s
W20260709 13:01:24.965422  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.007s	sys 0.019s
I20260709 13:01:24.550766  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 758) took 1910 ms. Trace:
I20260709 13:01:24.965161  1538 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:24.522820  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:24.511828  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.967428  1547 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:24.896075  4648 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.000s
I20260709 13:01:24.513386  4684 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.519253  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:24.934110  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:24.940843  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:24.511317  4993 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.447s
I20260709 13:01:24.939663  1696 rpcz_store.cc:276] 0709 13:01:22.768856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.769027 (+   171us) service_pool.cc:224] Handling call
0709 13:01:23.171284 (+402257us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:23.202420 (+ 31136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.202452 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:23.211026 (+  8574us) log.cc:844] Serialized 78 byte log entry
0709 13:01:23.372985 (+161959us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:23.391830 (+ 18845us) log.cc:844] Serialized 14 byte log entry
0709 13:01:23.392001 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.392082 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.116421 (+724339us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:24.520942 (+404521us) raft_consensus.cc:1685] finished
0709 13:01:24.521033 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.521180 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4397,"prepare.queue_time_us":18690,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":69175,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":5600,"spinlock_wait_cycles":7853440,"thread_start_us":119835,"threads_started":1,"wal-append.queue_time_us":193964}
I20260709 13:01:24.681075  4960 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.434s
I20260709 13:01:24.516613  4920 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.521198  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1852) took 1295 ms. Trace:
I20260709 13:01:24.563568  4505 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.535238  1690 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:24.677145  4988 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:01:24.509191  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:25.021744  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 512652us
W20260709 13:01:24.970219  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.765s (SENT) [suppressed 24 similar messages]
I20260709 13:01:24.965445  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1599) took 1378 ms. Trace:
I20260709 13:01:24.514441  4981 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:24.803933  4984 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:24.966118  4929 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:24.547215  4906 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:25.026247  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:24.972474  4994 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:01:25.027338  1613 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:24.966369  2263 rpcz_store.cc:276] 0709 13:01:22.640022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.923350 (+1283328us) service_pool.cc:224] Handling call
0709 13:01:24.550552 (+627202us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54006a2054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:24.550707 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422898560}
I20260709 13:01:24.512382  4955 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:25.027971  4955 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.981345  1618 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:25.028358  4955 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:25.003276  4684 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:25.029099  4684 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.031147  4684 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:24.931440  4843 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:24.548159  4959 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:24.549850  4881 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:24.932062  4614 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:24.963826  4933 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:24.559145  4891 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:24.986101  4581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.001s	sys 0.052s
W20260709 13:01:25.007542  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 488382us
I20260709 13:01:24.933986  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:24.534438  4740 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.013355  1541 rpcz_store.cc:276] 0709 13:01:23.225721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.226306 (+   585us) service_pool.cc:224] Handling call
0709 13:01:23.261233 (+ 34927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.572619 (+311386us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:23.844057 (+271438us) log.cc:844] Serialized 14 byte log entry
0709 13:01:24.274352 (+430295us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.274888 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.275024 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:24.275061 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.520787 (+245726us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540003a554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:24.520844 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.520904 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:24.521005 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.521142 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52553,"prepare.queue_time_us":470351,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":26992,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":49435,"spinlock_wait_cycles":601885440,"thread_start_us":634776,"threads_started":3,"wal-append.queue_time_us":339505}
I20260709 13:01:25.023190  1689 rpcz_store.cc:276] 0709 13:01:23.587019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.106405 (+519386us) service_pool.cc:224] Handling call
0709 13:01:24.965386 (+858981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:25.016077  4993 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:24.687006  4842 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.056911  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:25.108144  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51320.3us
W20260709 13:01:25.103192  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 169293us
I20260709 13:01:24.983280  4648 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:25.018010  4952 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:25.091212  1694 consensus_meta.cc:287] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:01:25.072999  1543 raft_consensus.cc:606] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:25.111960  1543 raft_consensus.cc:614] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:25.112970  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:25.111788  1694 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
W20260709 13:01:25.069836  4885 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 13:01:25.060240  4881 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:25.100224  4581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.001s	sys 0.053s
I20260709 13:01:25.034300  4920 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:25.128654  2260 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:25.059962  4959 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:25.129561  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:25.104477  4775 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:25.107033  4891 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:25.111056  4952 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.123427  4985 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:25.161265  1619 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:25.126573  4964 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:25.129575  4881 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:25.171401  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 201205us
I20260709 13:01:25.113906  4933 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:01:25.149367  4959 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:25.155929  5003 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.163090  4952 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:25.165416  4891 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:25.169129  4964 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:25.131460  4885 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.207255  4891 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:25.211369  4997 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:01:25.215473  4996 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:25.217053  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1525) took 1269 ms. Trace:
I20260709 13:01:25.217545  1616 rpcz_store.cc:276] 0709 13:01:23.949087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.137260 (+188173us) service_pool.cc:224] Handling call
0709 13:01:24.137583 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:24.151159 (+ 13576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.151192 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:24.151804 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:01:24.965849 (+814045us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:24.965893 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.965979 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.216678 (+250699us) raft_consensus.cc:1685] finished
0709 13:01:25.216709 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.216968 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"thread_start_us":813629,"threads_started":1,"wal-append.queue_time_us":862950}
I20260709 13:01:25.252138  4648 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:25.260532  4791 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.849s	user 0.006s	sys 0.003s
I20260709 13:01:25.261194  4791 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.262554  2266 raft_consensus.cc:2368] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
W20260709 13:01:25.281026  4824 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.866s	user 0.008s	sys 0.003s
I20260709 13:01:25.281514  4824 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:25.283521  5007 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:25.178215  4904 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.288239  4904 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.287703  4821 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:25.214329  4995 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:01:25.319792  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1536) took 1113 ms. Trace:
I20260709 13:01:25.320359  1614 rpcz_store.cc:276] 0709 13:01:24.206353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.469099 (+262746us) service_pool.cc:224] Handling call
0709 13:01:24.469380 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.933254 (+463874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.319416 (+386162us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b54001eb254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:25.319701 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208576256}
W20260709 13:01:25.217401  5004 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:01:25.313725  4927 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.001s
W20260709 13:01:25.325943  4451 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.023s	user 0.008s	sys 0.004s
I20260709 13:01:25.390926  1695 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:25.195538  4928 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:25.199429  4964 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:25.218483  4505 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:25.403373  4809 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.976s	user 0.008s	sys 0.004s
I20260709 13:01:25.311265  4916 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:25.311003  4821 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:25.237847  4955 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.458133  1615 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:01:25.459311  1615 pending_rounds.cc:85] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:01:25.417096  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 881) took 1004 ms. Trace:
I20260709 13:01:25.305305  4911 consensus_queue.cc:1059] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
W20260709 13:01:25.422487  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 317384us
I20260709 13:01:25.188753  5003 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.460222  2266 rpcz_store.cc:276] 0709 13:01:24.412665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.423647 (+ 10982us) service_pool.cc:224] Handling call
0709 13:01:25.416865 (+993218us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54005fd054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:25.417017 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927487872}
W20260709 13:01:25.469405  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:25.472558  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 339018us
I20260709 13:01:25.480229  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:25.490701  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.459740  1615 pending_rounds.cc:107] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:25.491714  1615 raft_consensus.cc:2889] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:25.493770  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 575) took 1267 ms. Trace:
W20260709 13:01:25.478685  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 321601us
I20260709 13:01:25.489269  1585 leader_election.cc:400] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:25.495429  1585 leader_election.cc:403] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:25.489207  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:25.496479  2259 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 6: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:25.499696  5008 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:25.501289  5008 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:25.501808  5008 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:25.497385  1659 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:25.494280  1620 rpcz_store.cc:276] 0709 13:01:24.225905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.954245 (+728340us) service_pool.cc:224] Handling call
0709 13:01:24.954510 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.954727 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:25.167082 (+212355us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.493518 (+326436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.493557 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:25.493588 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.493635 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.493725 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228387,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1765,"raft.queue_time_us":4289,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":95,"thread_start_us":532386,"threads_started":2}
I20260709 13:01:25.498725  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:25.486654  4962 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.047s	user 0.010s	sys 0.003s
W20260709 13:01:25.490835  4995 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:01:25.495018  4961 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.073s	user 0.013s	sys 0.000s
I20260709 13:01:25.404749  4927 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.404963  4451 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.590160  4809 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:25.525336  4614 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:25.488332  4916 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.593262  4581 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:25.599098  4999 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:25.659062  1622 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:25.659616  1621 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:25.661137  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1528) took 1689 ms. Trace:
I20260709 13:01:25.613796  4740 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:25.620138  4938 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.061s	user 0.012s	sys 0.001s
I20260709 13:01:25.593922  4962 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:25.744483  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.032s	sys 0.066s
I20260709 13:01:25.833434  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1538) took 1418 ms. Trace:
I20260709 13:01:25.616210  4961 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.891817  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 411838us
I20260709 13:01:25.895090  1613 rpcz_store.cc:276] 0709 13:01:23.972167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.074325 (+102158us) service_pool.cc:224] Handling call
0709 13:01:25.660928 (+1586603us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b54002ca454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:25.661059 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636058496}
I20260709 13:01:25.734149  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1539) took 1319 ms. Trace:
I20260709 13:01:25.933564  1620 rpcz_store.cc:276] 0709 13:01:24.415145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.618742 (+1203597us) service_pool.cc:224] Handling call
0709 13:01:25.733403 (+114661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.733661 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.733705 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.733768 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.733818 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.733899 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.734065 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:25.766541  2259 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:25.844795  4953 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.901618  4842 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:25.699117  4824 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:25.933609  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:25.841739  4985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.009s
W20260709 13:01:25.904182  4726 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.017s
W20260709 13:01:25.832839  4920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.001s	sys 0.011s
W20260709 13:01:25.895690  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.054s	sys 0.110s
I20260709 13:01:25.993944  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 578) took 1767 ms. Trace:
W20260709 13:01:25.882472  5009 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:01:25.958158  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:25.768219  5001 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.598s	user 0.001s	sys 0.001s
W20260709 13:01:26.131775  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 576) took 1905 ms (client timeout 2449 ms). Trace:
W20260709 13:01:26.132186  1621 rpcz_store.cc:269] 0709 13:01:24.226125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.433414 (+207289us) service_pool.cc:224] Handling call
0709 13:01:26.131579 (+1698165us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400230854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.131720 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2773981696}
I20260709 13:01:25.845115  4831 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.735267  5013 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:01:25.896669  1614 rpcz_store.cc:276] 0709 13:01:24.414859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.321604 (+906745us) service_pool.cc:224] Handling call
0709 13:01:25.321973 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.322160 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:25.322480 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.833037 (+510557us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.833107 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.833153 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.833233 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.833364 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101137,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":89204,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":22532,"thread_start_us":415572,"threads_started":1}
I20260709 13:01:25.844539  4836 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:25.975800  2261 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
W20260709 13:01:25.978871  2265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.014s	sys 0.043s
W20260709 13:01:25.986292  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.016s	sys 0.015s
I20260709 13:01:25.832614  4865 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:25.900049  5022 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:25.844666  4911 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:25.952566  4999 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:26.178958  4999 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.179306  5042 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.057391  4959 consensus_meta.cc:287] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.864s	user 0.005s	sys 0.005s
I20260709 13:01:25.891551  5023 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.976294  4985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.005s	sys 0.015s
I20260709 13:01:25.994431  1617 rpcz_store.cc:276] 0709 13:01:24.226561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.962660 (+736099us) service_pool.cc:224] Handling call
0709 13:01:24.962909 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.963107 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:25.107220 (+144113us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.993582 (+886362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.993639 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:25.993685 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.993753 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.993872 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":287646,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"thread_start_us":1011836,"threads_started":2}
I20260709 13:01:25.630656  4821 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:26.020484  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.983433  4451 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:25.619468  4881 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.955199  4885 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.061412  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1541) took 1540 ms. Trace:
I20260709 13:01:26.210361  1620 rpcz_store.cc:276] 0709 13:01:24.520751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.958937 (+1438186us) service_pool.cc:224] Handling call
0709 13:01:26.060737 (+101800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:26.060972 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.061009 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.061086 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:26.061131 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.061201 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.061336 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:25.958191  4938 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:25.993021  4726 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.017s	sys 0.017s
I20260709 13:01:25.978597  4614 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.198655  4985 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:26.212328  4938 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.215227  4938 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:25.735682  4791 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.213338  4985 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:25.954595  4961 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.174466  4865 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.218990  4961 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.220110  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1527) took 2266 ms. Trace:
I20260709 13:01:26.220513  4865 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.220547  1615 rpcz_store.cc:276] 0709 13:01:23.965293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.140191 (+174898us) service_pool.cc:224] Handling call
0709 13:01:24.140463 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.492298 (+1351835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.219862 (+727564us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002b6bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:26.220046 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3028638464}
I20260709 13:01:26.129187  4955 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.131335  4763 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:26.133657  4831 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.630184  5008 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:25.984426  4648 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:01:26.139489  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1863) took 1594 ms. Trace:
W20260709 13:01:26.133699  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.180955  5022 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:26.160450  2265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.017s	sys 0.043s
W20260709 13:01:26.152338  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 194221us
I20260709 13:01:26.235126  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 776) took 1726 ms. Trace:
I20260709 13:01:25.978492  4842 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.177469  4929 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.173599  4836 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.178208  4927 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.139178  5019 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.240142  5019 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.175091  4993 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:26.241043  4993 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:26.241483  4993 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.241624  4836 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:26.202572  5014 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:01:26.242241  4929 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.243086  5008 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:26.172307  4954 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.954s	user 0.012s	sys 0.004s
I20260709 13:01:26.179888  5042 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.017731  4904 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.133232  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 463) took 1672 ms. Trace:
I20260709 13:01:26.192513  4824 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.185030  4911 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.226824  4763 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.230998  4962 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:26.159504  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.017s	sys 0.016s
W20260709 13:01:26.254837  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 1.07593e+06us
I20260709 13:01:26.232373  1547 rpcz_store.cc:276] 0709 13:01:24.544814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.968076 (+423262us) service_pool.cc:224] Handling call
0709 13:01:24.968367 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.968566 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.968589 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.984277 (+ 15688us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.171357 (+187080us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:25.171396 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.171464 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.139208 (+967744us) raft_consensus.cc:1685] finished
0709 13:01:26.139238 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.139422 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":158276,"threads_started":1,"wal-append.queue_time_us":415109}
I20260709 13:01:26.235074  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:25.958735  4953 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.224251  4821 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.186681  4959 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.211759  5003 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:26.240553  4843 consensus_meta.cc:287] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.142s	user 0.008s	sys 0.004s
I20260709 13:01:26.197569  5023 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.235635  2265 rpcz_store.cc:276] 0709 13:01:24.509123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.509309 (+   186us) service_pool.cc:224] Handling call
0709 13:01:24.509732 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.510002 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:24.763246 (+253244us) log.cc:844] Serialized 14 byte log entry
0709 13:01:26.234760 (+1471514us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:26.234816 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:26.234878 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.234944 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.235070 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44349,"prepare.queue_time_us":52144,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":101488,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":1679325,"threads_started":3,"wal-append.queue_time_us":1145496}
I20260709 13:01:26.248159  1542 rpcz_store.cc:276] 0709 13:01:24.461259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.462125 (+   866us) service_pool.cc:224] Handling call
0709 13:01:24.499953 (+ 37828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.500276 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.500305 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.500734 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.561683 (+ 60949us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:24.561743 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.561834 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.133024 (+1571190us) raft_consensus.cc:1685] finished
0709 13:01:26.133043 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.133178 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2406,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8918,"thread_start_us":50080,"threads_started":1,"wal-append.queue_time_us":592009}
I20260709 13:01:26.225888  5020 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:26.253788  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101550us
I20260709 13:01:26.257464  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.257755  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.238023  4648 consensus_queue.cc:1243] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:26.273524  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.273761  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.275367  1694 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:26.255543  5019 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.259212  4927 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.259274  4904 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.254444  4954 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.277855  5020 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.269340  4843 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.277554  4614 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.282032  4727 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:26.259665  4824 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.294986  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:26.298772  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1533) took 2224 ms. Trace:
I20260709 13:01:26.299189  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.299520  4842 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.291736  4904 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.300196  1539 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:26.300485  4843 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.269258  4929 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.300758  4763 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.301895  1690 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:01:26.302205  5036 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:01:26.289233  4938 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.304438  5042 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.276212  4916 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.305364  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.306598  4954 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.290946  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:26.529937  1587 connection.cc:256] RPC call timeout handler was delayed by -1.4174337149999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 13:01:26.544965  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 254139us
W20260709 13:01:26.545214  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2779337149999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:01:26.529255  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.546650  1689 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:26.547526  1688 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:26.359947  1692 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.324049  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:26.341732  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 579) took 2114 ms. Trace:
I20260709 13:01:26.549963  1616 rpcz_store.cc:276] 0709 13:01:24.226818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.219724 (+992906us) service_pool.cc:224] Handling call
0709 13:01:25.220112 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.221341 (+  1229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.221383 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.221980 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.493415 (+271435us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:25.493480 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.493584 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.341421 (+847837us) raft_consensus.cc:1685] finished
0709 13:01:26.341451 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.341644 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":601,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":93,"thread_start_us":271042,"threads_started":1,"wal-append.queue_time_us":1039136}
I20260709 13:01:26.326162  1619 rpcz_store.cc:276] 0709 13:01:24.068560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.128767 (+ 60207us) service_pool.cc:224] Handling call
0709 13:01:26.292292 (+2163525us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002b75d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.292444 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309309824}
W20260709 13:01:26.298816  4809 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.001s
I20260709 13:01:26.568040  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:26.290113  4952 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.091s	user 0.010s	sys 0.002s
I20260709 13:01:26.311949  5017 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.283s
I20260709 13:01:26.349169  4727 consensus_queue.cc:1243] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:26.568771  1688 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:01:26.316459  4964 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.861s	user 0.005s	sys 0.006s
I20260709 13:01:26.361826  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.571260  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.554152  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.570393  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:26.624577  1690 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.340459  5022 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.348186  5020 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.341416  4953 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.627379  1689 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:26.533993  4831 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:26.341959  5044 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:26.532847  4614 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:26.628664  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57503.9us
I20260709 13:01:26.321998  5023 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.321260  4959 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.630440  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:26.567966  5042 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.578703  4814 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:26.636598  1692 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:26.354669  4824 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:26.639070  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85010.5us
I20260709 13:01:26.575963  4809 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:26.348919  4911 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.641274  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:26.641691  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.657793  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.658051  1689 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:26.658350  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:26.577910  4687 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.659025  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.659403  1689 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:26.660725  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:26.641950  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 87988.4us
I20260709 13:01:26.659035  1693 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:26.575924  4927 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.618978  4929 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.648993  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.638077  4935 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:26.688076  4935 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:26.688561  4935 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.640555  4727 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:26.690954  4727 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:26.647586  5042 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.692165  4990 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:26.649659  4964 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.692719  4990 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.693691  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:26.694823  5018 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
I20260709 13:01:26.669318  4927 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.695838  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1540) took 2251 ms. Trace:
I20260709 13:01:26.696575  4927 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.667495  4906 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.618944  4952 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.696969  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 774) took 2263 ms. Trace:
I20260709 13:01:26.697191  4906 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:26.697613  4906 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.697343  2260 rpcz_store.cc:276] 0709 13:01:24.433206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.439258 (+  6052us) service_pool.cc:224] Handling call
0709 13:01:24.439599 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.131977 (+692378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.696739 (+1564762us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400668354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:26.696916 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584243072}
I20260709 13:01:26.698634  4952 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.699760  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.700495  2265 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:26.670080  4843 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:26.703086  4843 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:26.703191  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54345.4us
I20260709 13:01:26.703670  5053 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.670493  4929 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.671664  4505 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:26.696230  1613 rpcz_store.cc:276] 0709 13:01:24.444319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.954453 (+1510134us) service_pool.cc:224] Handling call
0709 13:01:25.979115 (+ 24662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.979550 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.979572 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.992136 (+ 12564us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.126962 (+134826us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:26.127004 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.127076 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.695677 (+568601us) raft_consensus.cc:1685] finished
0709 13:01:26.695692 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.695788 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3597,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":28650,"thread_start_us":68688,"threads_started":1,"wal-append.queue_time_us":152928}
I20260709 13:01:26.674815  4831 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.647418  4614 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.648592  5017 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:26.684891  4984 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.685907  4993 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.663065  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.691704  4904 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.656580  4814 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.671178  4938 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:26.704140  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:26.704427  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1611) took 1781 ms (client timeout 2180 ms). Trace:
W20260709 13:01:26.740857  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 77843.7us
I20260709 13:01:26.694958  4990 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.707629  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.692201  5042 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:26.709633  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.666247  1690 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:26.743216  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:26.741653  1695 rpcz_store.cc:269] 0709 13:01:24.922960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.947851 (+ 24891us) service_pool.cc:224] Handling call
0709 13:01:26.704233 (+1756382us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54001f72d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.704368 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878074112}
I20260709 13:01:26.704056  4843 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.705849  4953 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:01:26.706113  4505 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:26.745409  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.747808  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:26.751708  5034 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.573s	user 0.005s	sys 0.000s
I20260709 13:01:26.752789  4828 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.691809  4727 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.758606  4814 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.741014  4964 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:26.750999  4999 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.005s
I20260709 13:01:26.759822  4953 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.761363  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.779383  1619 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:26.779870  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:26.767647  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.744390  5019 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:26.771766  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.754082  4906 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.744360  5053 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.761042  4927 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:26.772022  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.758906  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:26.754107  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 885) took 1637 ms (client timeout 1865 ms). Trace:
I20260709 13:01:26.781102  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.710469  4935 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.785974  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.805707  1616 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.806936  4727 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:26.808233  4935 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:26.806002  2263 rpcz_store.cc:269] 0709 13:01:25.116696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.118891 (+  2195us) service_pool.cc:224] Handling call
0709 13:01:26.753931 (+1635040us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400574254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.754052 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3440388864}
I20260709 13:01:26.812397  4935 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:26.812923  4935 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.784996  4814 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.816445  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.816598  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.817297  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.817677  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.818094  4828 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:26.818221  1619 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.818909  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.820012  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.821070  1615 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:26.822011  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.822947  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.824023  4906 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.825227  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:26.826902  4935 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.824028  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.828949  1613 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:26.829319  4451 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:26.829677  4451 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:26.830247  1619 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:26.762784  4505 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.831113  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.831216  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.837097  1615 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:26.803161  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.774595  5040 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.712191  4831 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.829746  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:26.837571  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65615.5us
I20260709 13:01:26.838356  1619 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:26.839008  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.839154  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.840380  1614 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:26.841223  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:26.839803  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54136.1us
I20260709 13:01:26.844262  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:26.846035  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.848023  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:26.848915  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.849565  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:26.850553  4935 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.852998  4929 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.854745  5053 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.855933  4392 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:26.856091  4614 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.856349  4392 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.856748  4392 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:26.856930  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2318) took 3414 ms (client timeout 2747 ms). Trace:
I20260709 13:01:26.858839  4821 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:26.871420  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 515) took 1445 ms. Trace:
I20260709 13:01:26.859504  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49324 (request call id 13) took 2610 ms. Trace:
I20260709 13:01:26.871960  1543 rpcz_store.cc:276] 0709 13:01:24.249547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.289819 (+ 40272us) service_pool.cc:224] Handling call
0709 13:01:26.859320 (+2569501us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54000523d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d4853 00007f7f1f8a260a 00007f7f18e287d4 00007f7f18e28762 00007f7f18e28691 00007f7f18e2860c 00007f7f18e278c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.859426 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756348160}
I20260709 13:01:26.872440  4881 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.854794  4906 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.873109  4906 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:26.873525  4906 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:26.873724  1618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1532) took 2854 ms (client timeout 1566 ms). Trace:
W20260709 13:01:26.874102  1618 rpcz_store.cc:269] 0709 13:01:24.019278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.056048 (+ 36770us) service_pool.cc:224] Handling call
0709 13:01:26.873527 (+2817479us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400341cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.873648 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879048448}
I20260709 13:01:26.875308  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1591) took 3335 ms. Trace:
I20260709 13:01:26.875646  1691 rpcz_store.cc:276] 0709 13:01:23.539542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.539644 (+   102us) service_pool.cc:224] Handling call
0709 13:01:23.539898 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.941662 (+1401764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.875072 (+1933410us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001f63d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:26.875218 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613914496}
W20260709 13:01:26.860021  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 873) took 2449 ms (client timeout 2115 ms). Trace:
W20260709 13:01:26.877456  2261 rpcz_store.cc:269] 0709 13:01:24.410524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.418583 (+  8059us) service_pool.cc:224] Handling call
0709 13:01:26.859805 (+2441222us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54006009d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.859933 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3526929280}
I20260709 13:01:26.832810  5017 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.865692  1696 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:26.865314  4392 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:26.866199  4960 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.868583  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.869239  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.869866  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.870214  4935 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.870533  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:26.878334  1619 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:26.841621  4778 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:26.780843  4953 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:26.882547  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.871794  2257 rpcz_store.cc:276] 0709 13:01:25.425819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.425993 (+   174us) service_pool.cc:224] Handling call
0709 13:01:25.492995 (+ 67002us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.980699 (+487704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.980737 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.980775 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:25.980815 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.871202 (+890387us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:26.871247 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.871357 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1121223936}
W20260709 13:01:26.871161  1545 rpcz_store.cc:269] 0709 13:01:23.419442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.460494 (+ 41052us) service_pool.cc:224] Handling call
0709 13:01:26.833244 (+3372750us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000848d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.833430 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3766402944}
I20260709 13:01:26.916365  4648 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:26.886567  1620 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:26.783308  5019 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.887034  5017 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:26.891182  1617 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
W20260709 13:01:26.892838  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 46999.3us
I20260709 13:01:26.782362  4999 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.904274  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:26.906744  1511 connection.cc:256] RPC call timeout handler was delayed by -1.5718019220000201s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 13:01:26.881070  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.841116  4928 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:26.908972  2230 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:26.780562  4938 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:01:26.913293  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.939472  1619 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:26.940672  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:26.891909  4814 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:26.892204  4821 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:26.892092  5040 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.910838  4927 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:01:26.830608  4451 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.911044  4946 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:01:26.965939  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1868) took 2043 ms (client timeout 1649 ms). Trace:
W20260709 13:01:26.968525  1539 rpcz_store.cc:269] 0709 13:01:24.919293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.940616 (+ 21323us) service_pool.cc:224] Handling call
0709 13:01:26.962125 (+2021509us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400106154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:26.962484 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3005653888}
I20260709 13:01:26.784834  4904 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 13:01:26.847712  4726 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:01:26.904317  4750 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.903919  4898 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.926453  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.907903  4972 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.905864  4960 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:26.933058  1511 connection.cc:256] RPC call timeout handler was delayed by -1.0192019220000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:01:26.933966  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:26.896775  4885 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.004001  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.004230  4999 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:26.944587  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:26.946357  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.919209  4648 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:27.015481  4648 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.891021  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.925074  5017 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.019443  4993 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:26.922008  5019 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:26.903092  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:26.977898  4392 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:26.978787  5042 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.946841  4985 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.979792  4703 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:26.980509  4831 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.036507  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.037612  4392 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:27.020455  4648 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:26.981729  1621 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:26.982810  4451 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:26.985885  1614 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.043444  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:26.987484  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:27.050781  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.987607  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:27.053380  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:26.991889  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 109427us
I20260709 13:01:27.055877  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:26.994995  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61112.6us
I20260709 13:01:26.995215  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:26.985037  4898 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.996727  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:26.997366  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.077517  1538 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:26.997573  4833 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:26.997641  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:26.998338  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:26.998785  1445 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 5 to 6, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:26.998361  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.078512  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.090282  1546 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:27.089707  1547 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:01:27.000347  4972 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.001163  4687 raft_consensus.cc:2764] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:01:27.001483  4960 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.002007  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.003144  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.095718  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.005630  1619 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:27.106667  1547 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.012229  1615 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:27.019487  1613 raft_consensus.cc:2368] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7.
I20260709 13:01:26.984549  4750 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.114656  1542 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:27.022632  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 119633us
I20260709 13:01:27.116266  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.115955  1540 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:27.117672  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:27.031206  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 182363us
I20260709 13:01:26.972082  4946 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:26.963788  4821 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:26.975545  5040 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.057235  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:27.030365  4993 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.094852  4684 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.089697  1544 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:27.128937  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.129624  1544 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.111455  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:27.024124  4726 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:01:27.130978  4726 consensus_queue.cc:1243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:01:27.131243  5056 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:27.132155  4916 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.132685  4916 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:27.133905  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.132184  4821 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:27.138268  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 81096.6us
I20260709 13:01:27.138695  5020 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:27.139083  5020 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.139320  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.139472  5020 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:27.139554  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.140070  1545 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.140877  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.141199  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.141556  1545 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.142066  4824 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.142484  4824 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:27.139101  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:27.143044  4824 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.143431  1613 raft_consensus.cc:2368] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
I20260709 13:01:27.144186  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.144852  1613 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.145520  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.146138  1613 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.126972  4831 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:27.147368  4831 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:27.147763  4831 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.152034  4750 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.153218  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.154211  1613 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:27.114718  4833 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:27.156685  4985 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:27.159175  5016 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.529s	user 0.009s	sys 0.006s
I20260709 13:01:27.121464  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:27.162210  1619 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.163121  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.163967  1538 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:27.165035  5040 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.125336  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.133570  4916 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.166958  1542 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:27.168532  1613 raft_consensus.cc:2410] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:27.142910  4687 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:27.169706  4687 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:27.170066  4687 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:27.125393  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.170887  4687 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.172021  4687 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.172128  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.157084  4933 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:27.172981  1613 raft_consensus.cc:2410] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:27.152055  4898 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:27.173082  4933 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.175403  4933 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.175601  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.176690  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.177228  1540 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:27.161803  5017 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:26.947364  4814 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:27.178992  4814 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.179356  5020 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.171192  4993 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:27.183272  5017 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.184003  4993 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.130378  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.181424  5020 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:27.187032  1544 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.088980  4843 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.123660  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.191431  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:27.192003  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 50888.2us
I20260709 13:01:27.162946  4505 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.171227  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.194880  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.120438  1512 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.142346  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:27.201174  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80831.5us
W20260709 13:01:27.202307  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 82542.9us
I20260709 13:01:27.085508  1614 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:27.204748  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:26.990818  4953 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.226310  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:27.228976  1541 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:27.230026  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.230777  1695 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.231249  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.231895  1690 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:27.232990  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.233697  1690 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.178063  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.234354  1540 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:27.231478  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.221295  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 184854us
I20260709 13:01:27.221927  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.223878  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.243407  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.244242  1691 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.224074  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.224635  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.244704  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:27.245019  1687 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.245103  1694 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:27.225520  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.246917  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:27.247746  1619 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:27.248739  1542 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:27.249797  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.251051  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.251782  1542 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.251652  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:27.252729  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.253756  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.254313  1542 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:27.254853  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.255126  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.246510  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.256484  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.257241  1692 raft_consensus.cc:2410] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:27.257459  1544 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:27.257939  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.255216  1543 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:27.259060  1692 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 7: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.259420  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.259950  1692 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.260413  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.261113  1692 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:27.261453  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.261953  1543 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.262260  1692 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:01:27.263461  2260 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:27.264189  1542 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.265036  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.265532  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.266209  2260 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.266165  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.265707  2257 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:27.267139  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.268736  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.270500  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.272234  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.273049  2265 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:27.245474  1613 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:27.276463  5038 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:27.277097  5038 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.280473  4959 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.280736  5038 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.281095  4959 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.286392  4959 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.258296  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.289023  1544 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [4.4-8.6]
I20260709 13:01:27.242133  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.241786  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:27.291481  1689 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:27.291675  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49966.3us
I20260709 13:01:27.292631  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.293365  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.295154  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.295253  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:27.298521  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 51686.4us
I20260709 13:01:27.299322  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.300453  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.301606  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.301819  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.303324  1619 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:27.220654  4927 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.316007  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:27.312099  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1535) took 3106 ms (client timeout 2180 ms). Trace:
I20260709 13:01:27.316715  1689 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
W20260709 13:01:27.316864  1622 rpcz_store.cc:269] 0709 13:01:24.206059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.288482 (+ 82423us) service_pool.cc:224] Handling call
0709 13:01:27.311902 (+3023420us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400232654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:27.312032 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2935213824}
I20260709 13:01:27.316449  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:27.317724  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.226223  4392 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.310771  4929 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.318064  2257 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:27.319430  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:27.318020  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.220973  4684 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:27.322108  1690 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:27.233079  4778 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.328331  1695 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:27.329349  1543 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:27.330190  1547 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:27.241632  4928 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.340871  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.334101  1613 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:27.336541  4898 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:27.295583  4946 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.348047  1622 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:27.302994  5053 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.341075  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.329452  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.341774  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.344095  1543 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.339236  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.339355  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.363036  1690 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:27.363090  1542 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.362466  1695 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:27.357340  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:27.224746  4614 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 13:01:27.225054  5017 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:01:27.316938  5022 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.392257  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:27.393337  1695 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:27.236402  4904 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:01:27.234066  4906 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.401275  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.402889  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.404265  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.320286  5058 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.407532  1542 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:01:27.377214  1622 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:27.378463  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:27.409269  1690 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:27.379436  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:27.380589  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.235787  4727 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:01:27.300750  4703 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.156836  4833 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.419605  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2277) took 1123 ms. Trace:
I20260709 13:01:27.420012  1696 rpcz_store.cc:276] 0709 13:01:26.296114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.323782 (+ 27668us) service_pool.cc:224] Handling call
0709 13:01:27.419445 (+1095663us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540040ef54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:27.419546 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371184512}
I20260709 13:01:27.422156  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.422816  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.423544  1538 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.428156  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.357658  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.431521  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 73952.5us
I20260709 13:01:27.405061  1695 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:27.371418  1687 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:27.337524  4990 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:27.411283  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.340420  4928 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.415774  1543 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:27.438802  1539 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.443120  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:27.443233  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 103989us
I20260709 13:01:27.444010  1619 pending_rounds.cc:85] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:01:27.444397  1619 pending_rounds.cc:107] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:27.444484  1543 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.444703  1511 leader_election.cc:400] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7.
I20260709 13:01:27.445223  1511 leader_election.cc:403] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:27.382694  4687 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:27.384877  4392 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:27.447115  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.447764  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:27.447808  1541 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:27.449079  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.445995  1619 raft_consensus.cc:2889] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.454838  1619 pending_rounds.cc:107] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:27.455260  1619 raft_consensus.cc:2889] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.457952  1538 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:27.417719  5058 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.461812  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.535763  1543 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:27.464107  1511 leader_election.cc:400] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
I20260709 13:01:27.536612  1511 leader_election.cc:403] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:01:27.537129  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 73232us
I20260709 13:01:27.537921  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:27.539160  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.541015  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.466192  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 156670us
I20260709 13:01:27.350732  4778 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.447242  4928 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.399031  4946 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.447510  5040 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.499138  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.496425  5019 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.523373  4814 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.556396  4727 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.556818  4727 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.557161  4727 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.557376  1541 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.562793  1544 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [5.3-9.5]
I20260709 13:01:27.570541  1538 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:27.502858  1613 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:01:27.558996  1614 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:27.451799  4911 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:27.456838  4891 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:27.507287  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 150105us
I20260709 13:01:27.458074  5053 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:27.462105  4726 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.517233  1539 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:27.482286  4904 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7.
I20260709 13:01:27.440960  4703 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.482796  5037 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:27.499080  5042 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.483333  4964 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:27.546916  2231 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.550112  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:27.554527  4972 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:27.550727  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 101710us
I20260709 13:01:27.558532  1541 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:27.447027  4687 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:27.576236  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.544970  4987 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
I20260709 13:01:27.545127  4843 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.543399  4821 raft_consensus.cc:2764] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:01:27.575099  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.610999  5060 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 13:01:27.561342  4959 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:27.566416  4505 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.584122  4911 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:27.624068  4687 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.584757  4891 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.543025  5058 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.558426  4814 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.562429  5019 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:27.616279  1543 raft_consensus.cc:606] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:27.643653  1543 raft_consensus.cc:614] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:27.618494  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:27.616207  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69365.3us
W20260709 13:01:27.615978  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 75048.6us
I20260709 13:01:27.624150  1542 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:27.586083  4726 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.582904  5022 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:27.647643  5053 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:27.648334  5022 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.649161  5074 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:27.651670  4985 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.647689  4726 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.624904  1541 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:27.627204  4933 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:01:27.634852  4959 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:27.625553  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.620896  4929 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:27.547148  4824 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.582564  1539 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:27.629225  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54211.3us
W20260709 13:01:27.614018  4648 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:01:27.615052  4904 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.613318  4898 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:27.500687  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 181349us
W20260709 13:01:27.792882  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.610869  4684 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:27.553707  4392 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.632978  4993 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:27.671962  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.672308  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.644030  4990 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:27.776026  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.821135  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45198us
I20260709 13:01:27.821974  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:27.656152  5064 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:01:27.827561  5017 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:27.828023  5017 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.828395  5017 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:27.829581  4953 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:27.830806  4648 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:27.831489  4648 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:27.669888  4960 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.002s
W20260709 13:01:27.673272  4451 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.002s
I20260709 13:01:27.800225  2260 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:27.834955  4960 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.834703  4898 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.835829  1615 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:27.672588  4946 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:27.659528  4505 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:27.672573  5037 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 13:01:27.663388  5075 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:27.671301  4987 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.136s
W20260709 13:01:27.684326  1618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.006s
W20260709 13:01:27.823972  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 152094us
I20260709 13:01:27.853893  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:27.854889  1618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.009s	sys 0.007s
I20260709 13:01:27.671937  4891 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.135s
I20260709 13:01:27.672451  4972 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 13:01:27.825696  1617 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 3. (term mismatch)
I20260709 13:01:27.654608  4928 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.826299  5019 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:27.837298  4960 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:27.814669  1691 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.838836  5079 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:01:27.838052  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 165818us
I20260709 13:01:27.839691  4885 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:27.840219  4824 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:27.840965  5094 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:27.841312  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:27.838330  1693 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:27.671729  4703 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:27.816612  4831 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
W20260709 13:01:27.858776  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 222309us
W20260709 13:01:27.904517  1661 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.578s (SENT)
I20260709 13:01:27.850045  5075 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:27.870255  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.659947  4911 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.873353  5099 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:27.832594  4648 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.877112  4727 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.818910  4993 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.664788  4726 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.820600  4904 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:27.887774  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 242350us
I20260709 13:01:27.859943  1617 pending_rounds.cc:85] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 2
I20260709 13:01:27.942350  1617 pending_rounds.cc:107] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:01:27.942691  1617 raft_consensus.cc:2889] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:27.674737  4959 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.945917  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:27.946880  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.867785  5019 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:27.832376  4929 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:27.945861  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:27.947597  1618 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:27.949041  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 78881.8us
I20260709 13:01:27.952229  1613 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:27.952517  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:27.920928  4993 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:27.833187  4684 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:27.951386  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:27.965721  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:27.968721  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:27.973474  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.973682  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:27.974524  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.975356  1545 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:01:27.976347  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:28.007265  5099 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:27.903734  5094 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:28.022921  5084 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.002s
I20260709 13:01:28.008164  1539 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:27.976012  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:28.024366  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:28.014129  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45487.1us
W20260709 13:01:28.013595  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62292.5us
I20260709 13:01:27.914511  4964 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:01:28.031108  1692 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:28.007093  4904 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.015355  1613 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:01:28.015529  5082 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:28.016052  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63502.8us
I20260709 13:01:28.022019  1445 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 7 to 8, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.016553  4727 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.017025  4972 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:27.950681  4885 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.075764  2260 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:28.020820  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:28.020948  4687 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.025566  5042 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:28.026466  5095 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:01:28.026675  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50745.1us
I20260709 13:01:28.023105  5099 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.021941  1617 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:01:28.013389  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:27.949642  5019 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:27.914500  4831 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:28.118790  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 292) took 28219 ms (client timeout 15000 ms). Trace:
I20260709 13:01:28.049939  5082 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.031148  5093 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.033842  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:27.978502  5081 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:27.943459  4935 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:01:28.053341  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:28.150862  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 97655.3us
W20260709 13:01:28.152043  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 118300us
I20260709 13:01:28.152709  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.054423  4972 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:27.976859  4891 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:28.082299  5042 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:28.015406  5057 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.973s	user 0.011s	sys 0.006s
I20260709 13:01:28.197454  4928 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.026345  5094 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:28.078118  1542 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:01:27.978850  4881 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.027988  4953 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:28.102974  1445 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 9, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.049300  4964 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:28.109236  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:28.206185  1696 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:28.109858  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.024284  1541 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:28.207226  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 97464.4us
I20260709 13:01:28.021962  4843 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.207962  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.111045  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:28.209391  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:28.113188  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:28.114967  2260 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:01:28.118703  1545 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:28.041035  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.036748  1692 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:28.211796  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:28.212313  1692 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.037746  1694 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:28.054330  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:28.162290  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 135279us
I20260709 13:01:28.153672  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:28.213490  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59955us
I20260709 13:01:28.213603  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:28.213776  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.214208  1694 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:28.119280  1443 rpcz_store.cc:269] 0709 13:00:59.899000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.922728 (+ 23728us) service_pool.cc:224] Handling call
0709 13:01:28.118712 (+28195984us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.358350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:20.359139 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:20.359185 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:01:20.359204 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:20.360306 (+  1102us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:20.360421 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:20.360468 (+    47us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:01:20.361526 (+  1058us) tablet.cc:701] Row locks acquired
0709 13:01:20.361582 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:01:20.361815 (+   233us) write_op.cc:270] Start()
0709 13:01:20.361974 (+   159us) write_op.cc:276] Timestamp: P: 1783602080361738 usec, L: 0
0709 13:01:20.361995 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:20.362787 (+   792us) log.cc:844] Serialized 4009 byte log entry
0709 13:01:20.683470 (+320683us) op_driver.cc:464] REPLICATION: finished
0709 13:01:20.941131 (+257661us) write_op.cc:301] APPLY: starting
0709 13:01:20.941376 (+   245us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:20.941980 (+   604us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:20.942287 (+   307us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.430078 (+487791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.577632 (+147554us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:01:21.585252 (+  7620us) write_op.cc:312] APPLY: finished
0709 13:01:21.705133 (+119881us) log.cc:844] Serialized 77 byte log entry
0709 13:01:22.174749 (+469616us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.174886 (+   137us) write_op.cc:454] Released schema lock
0709 13:01:22.174951 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.175417 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.175448 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":44,"spinlock_wait_cycles":327936,"child_traces":[["op",{"apply.queue_time_us":257029,"apply.run_cpu_time_us":150672,"apply.run_wall_time_us":1234377,"num_ops":10,"prepare.queue_time_us":149620,"prepare.run_cpu_time_us":10592,"prepare.run_wall_time_us":13813,"raft.queue_time_us":137555,"raft.run_cpu_time_us":73740,"raft.run_wall_time_us":171746,"replication_time_us":321250,"thread_start_us":839025,"threads_started":5,"wal-append.queue_time_us":598158,"wal-append.run_cpu_time_us":59452,"wal-append.run_wall_time_us":2324815}]]}
I20260709 13:01:28.214984  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:28.215168  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:28.166981  5088 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:01:28.167490  5086 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.168296  4831 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.214404  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:28.169363  5090 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:28.148909  5082 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.181864  1622 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:28.008877  5078 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:28.188968  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.194460  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.244781  1585 leader_election.cc:400] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:28.195235  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:28.163179  5100 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:28.217419  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:28.249486  1545 raft_consensus.cc:606] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:28.249841  1545 raft_consensus.cc:614] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:28.229148  4833 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:28.250985  4833 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.251165  1545 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:28.251366  4833 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:28.251755  5080 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:28.252280  1545 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:28.252663  5080 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:28.253413  5058 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:01:28.253909  5058 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.243628  5083 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.254999  5042 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.238049  4952 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:01:28.256007  5042 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.228384  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.229661  1695 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:28.232205  1547 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:28.222314  5093 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.198581  4906 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.229012  4881 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.200937  4946 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:28.245793  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:28.200865  5098 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.205864  4953 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:28.202508  4891 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:28.342494  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1814) took 1149 ms. Trace:
I20260709 13:01:28.342949  1619 rpcz_store.cc:276] 0709 13:01:27.193110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.428823 (+235713us) service_pool.cc:224] Handling call
0709 13:01:27.443575 (+ 14752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.465107 (+ 21532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.465158 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:27.465737 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:01:27.644560 (+178823us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:27.644939 (+   379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:27.645021 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.342261 (+697240us) raft_consensus.cc:1685] finished
0709 13:01:28.342280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.342409 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":123155,"threads_started":1,"wal-append.queue_time_us":404312}
I20260709 13:01:28.248381  1694 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:01:28.246447  4928 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:28.219156  1687 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.224228  1661 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:28.348224  1620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 589) took 1363 ms (client timeout 1545 ms). Trace:
W20260709 13:01:28.348670  1620 rpcz_store.cc:269] 0709 13:01:26.984862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.043123 (+ 58261us) service_pool.cc:224] Handling call
0709 13:01:28.341777 (+1298654us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54004182d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:28.348163 (+  6386us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821659392}
W20260709 13:01:28.259562  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 64209.4us
I20260709 13:01:28.221558  4898 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:28.228312  1445 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 7, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:28.322708  1692 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:28.263489  4831 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:28.263695  4916 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:28.405412  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:28.419709  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.518373  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:28.560829  5093 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:28.562175  5093 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:28.563145  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 339005us
W20260709 13:01:28.563864  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 318127us
I20260709 13:01:28.564028  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.565681  1585 leader_election.cc:400] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
W20260709 13:01:28.565878  5101 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 13:01:28.566135  1585 leader_election.cc:403] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.566788  5008 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:28.567610  5108 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:01:28.566296  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.568486  4881 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.567507  4927 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.569823  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.571199  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:28.573637  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:28.563261  1445 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 5, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:28.332590  4946 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:28.337337  4726 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.587059  5094 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.344961  4953 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:28.575347  4885 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:28.247153  4972 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.347690  5099 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.556123  4952 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:28.559777  5080 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.604493  1445 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 5, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.589327  4946 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:28.577834  4881 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:28.602142  4927 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.567643  5008 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.579747  5053 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:28.608777  4726 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.618069  1445 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:28.570107  4898 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.576537  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:28.669818  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 93608.6us
I20260709 13:01:28.670938  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:28.602495  4451 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:28.630597  1445 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:01:28.677877  5111 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:01:28.677728  1445 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.679752  4999 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:28.679467  1445 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.680186  4999 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.680594  4999 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.681735  1445 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 3 to 5, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.683162  5087 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:28.683706  5087 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:28.684149  4451 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.684574  5087 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.684605  1445 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 3 to 5, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:28.690879  4881 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:28.630048  5017 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.801s	user 0.012s	sys 0.000s
I20260709 13:01:28.694701  4451 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.693069  4885 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:28.694941  5017 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.696123  1621 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:28.696575  5094 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:28.697036  5017 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.699725  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:28.624742  5008 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:28.754055  1692 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:28.612872  5099 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.621752  4972 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:28.755493  1694 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
W20260709 13:01:28.756100  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56454.7us
I20260709 13:01:28.762959  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:28.766147  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.664211  4687 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.698424  4916 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:28.699186  4684 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:28.624234  4927 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.777673  5106 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:28.761130  5008 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:28.796785  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.040s	sys 0.056s
I20260709 13:01:28.790024  4906 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:28.797916  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 232448us
I20260709 13:01:28.667783  4726 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.663719  4891 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:28.794818  5019 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.002s
I20260709 13:01:28.791517  5058 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:28.690459  4999 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.819131  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:28.824024  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 305868us
I20260709 13:01:28.825958  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:28.852617  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:28.854157  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.813575  5106 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:28.817863  4684 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:28.791569  4916 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.863076  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.876113  1545 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:28.822038  5019 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.879240  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:28.875458  5110 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:01:28.856283  5094 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.855959  5085 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:28.854698  5098 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:01:28.936198  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:28.935554  4451 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:28.938892  4451 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.941210  4451 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:28.942981  5112 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:01:28.945724  4778 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.863368  5115 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:01:28.913321  5085 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:28.954874  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1624) took 1725 ms. Trace:
I20260709 13:01:28.955296  1693 rpcz_store.cc:276] 0709 13:01:27.229718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.229823 (+   105us) service_pool.cc:224] Handling call
0709 13:01:27.309238 (+ 79415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.896602 (+587364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.954640 (+1058038us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54001f77d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:28.954820 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216389504}
I20260709 13:01:28.865657  5106 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:28.947537  5113 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 13:01:28.933553  5116 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:01:28.966668  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2351) took 1965 ms. Trace:
I20260709 13:01:28.967167  1544 rpcz_store.cc:276] 0709 13:01:27.001216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.290341 (+289125us) service_pool.cc:224] Handling call
0709 13:01:27.321590 (+ 31249us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:27.570215 (+248625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.966365 (+1396150us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000474d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:28.966591 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554064640}
W20260709 13:01:28.969296  5042 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.005s
I20260709 13:01:28.978025  5099 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.957511  4684 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:28.984616  4833 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.000s
I20260709 13:01:28.985044  4833 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.986222  4953 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:28.986974  4898 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:28.988317  4953 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:28.990063  4993 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.976s	user 0.008s	sys 0.001s
I20260709 13:01:28.924178  5094 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:28.990536  4990 consensus_meta.cc:287] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.128s	user 0.005s	sys 0.005s
I20260709 13:01:29.009222  4990 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:29.009387  5105 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.928s	user 0.002s	sys 0.008s
I20260709 13:01:28.996683  4927 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.992616  4999 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.010985  5071 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:29.011703  5071 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:29.012249  4833 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:28.994518  4726 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.012796  5071 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.010998  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:29.015837  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1817) took 1819 ms (client timeout 1787 ms). Trace:
W20260709 13:01:29.016235  1614 rpcz_store.cc:269] 0709 13:01:27.196046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.204455 (+  8409us) service_pool.cc:224] Handling call
0709 13:01:29.015611 (+1811156us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b5400231254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.015769 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805142400}
I20260709 13:01:29.016821  1545 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:29.017202  1545 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:29.004037  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2364) took 1028 ms. Trace:
I20260709 13:01:29.019292  1542 rpcz_store.cc:276] 0709 13:01:27.975444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.025276 (+ 49832us) service_pool.cc:224] Handling call
0709 13:01:28.025574 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.200464 (+174890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.003755 (+803291us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54000852d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.003969 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116995328}
W20260709 13:01:29.019852  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 590) took 2034 ms (client timeout 1985 ms). Trace:
W20260709 13:01:29.020364  1615 rpcz_store.cc:269] 0709 13:01:26.985114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.194554 (+209440us) service_pool.cc:224] Handling call
0709 13:01:29.019612 (+1825058us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54000eef54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.019772 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472708992}
I20260709 13:01:28.969229  1544 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:01:29.004985  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 592) took 1981 ms. Trace:
I20260709 13:01:29.023526  1622 rpcz_store.cc:276] 0709 13:01:27.023138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.408767 (+385629us) service_pool.cc:224] Handling call
0709 13:01:27.416650 (+  7883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.242983 (+826333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.004768 (+761785us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54002ed454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.004928 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1759446912}
I20260709 13:01:28.991883  4916 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.018098  1545 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.025784  1545 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:28.971329  5082 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.708s	user 0.007s	sys 0.003s
I20260709 13:01:28.954550  5085 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.034931  5082 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.038158  5082 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.040194  5094 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:28.991964  5019 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.045537  4938 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:29.045974  4938 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:29.046773  4938 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:28.990466  4993 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.047956  4938 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.049073  4993 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:29.051350  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 427251us
W20260709 13:01:29.059916  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 297058us
W20260709 13:01:29.060222  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 209297us
I20260709 13:01:29.060905  1541 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:29.066314  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.076346  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.058808  4993 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.058893  4927 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:29.058957  4750 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:29.059384  4906 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:29.093461  1694 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:29.086252  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:29.099630  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.127218  1542 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:29.067917  5123 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.080250  4833 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.131935  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:29.135514  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.136770  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.126664  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:29.136036  2266 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 LEARNER]: Advancing to term 7
I20260709 13:01:29.100284  5045 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.140048  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.145033  2260 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 6.
I20260709 13:01:29.075363  4916 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:01:29.077548  4842 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:01:29.149123  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.079952  5099 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:01:29.147099  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.147445  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:29.149926  2257 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:29.084030  4726 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:01:29.133317  4953 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:29.134023  5053 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.154479  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:29.160655  1693 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.152374  2258 raft_consensus.cc:2376] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7. Re-sending same reply.
I20260709 13:01:29.157021  1585 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:29.158913  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:29.162545  1585 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:29.081928  5118 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:01:29.164273  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:29.101550  4993 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.145061  5017 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:29.125422  4927 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:29.168876  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.165800  1587 leader_election.cc:400] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:29.134452  4911 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
W20260709 13:01:29.185058  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.190819  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.166559  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.193909  1542 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:29.127717  4750 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.140522  4833 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.165974  4831 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.215014  4831 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.215425  4831 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.207011  4726 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.216745  4726 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.218945  4726 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.180847  5082 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:01:29.220301  4750 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.180752  5114 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.220933  5114 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:29.221304  5114 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.226948  4451 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:29.227598  4993 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.168519  5053 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.230088  5053 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:29.231082  5119 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:01:29.232054  4906 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.233062  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.233601  1542 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.237397  4614 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:29.237951  4614 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:29.239059  4960 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:29.239560  4960 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:29.227700  4451 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:29.243034  5073 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:29.243350  5122 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:29.243609  5073 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.244719  5073 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.246016  5073 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.246168  5053 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:29.246641  5053 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:29.247433  5053 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.252418  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 543) took 1961 ms. Trace:
I20260709 13:01:29.252849  1691 rpcz_store.cc:276] 0709 13:01:27.291122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.302496 (+ 11374us) service_pool.cc:224] Handling call
0709 13:01:27.311448 (+  8952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.868203 (+556755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.252189 (+1383986us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b540031ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.252360 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156921216}
I20260709 13:01:29.254742  5075 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.256362  5075 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.259662  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:29.260361  1622 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.261600  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:29.261930  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:29.262288  1615 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.260269  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:29.263679  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:29.266285  4946 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 13:01:29.266789  4946 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.268850  1622 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:29.167078  5097 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:01:29.259917  5103 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.232s	user 0.007s	sys 0.005s
I20260709 13:01:29.283337  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.137612  5123 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.274398  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.253199  2266 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:01:29.275741  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.300464  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:29.301118  2261 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 6.
I20260709 13:01:29.277053  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.277324  1539 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:29.281235  1615 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:29.283260  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.302845  2262 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:29.165989  4929 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:29.309327  1691 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:01:29.300331  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48230.9us
I20260709 13:01:29.213166  5017 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.316265  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.317230  2257 raft_consensus.cc:2368] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8.
I20260709 13:01:29.165973  5083 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:29.307420  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.322009  2260 raft_consensus.cc:2410] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:29.308152  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:29.322464  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.323081  1545 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:29.150167  5045 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.343588  5045 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:29.344347  4927 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.344587  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:29.346359  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:29.301239  1617 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:29.270952  1542 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:29.349447  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.350910  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:29.351727  1660 connection.cc:256] RPC call timeout handler was delayed by -1.126420545999963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:01:29.351958  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.352500  1542 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:29.313220  1695 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:29.354342  1619 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:29.307185  2264 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:29.225821  4831 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.319397  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.319944  2258 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:29.324769  1543 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:29.357183  2265 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.326939  5022 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:29.230551  5008 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:29.359573  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.359948  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:29.360988  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.328897  5123 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.300506  4821 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.316159  5040 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.330788  4833 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:29.330972  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2359) took 1356 ms (client timeout 1582 ms). Trace:
I20260709 13:01:29.375309  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.335127  1690 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:01:29.376245  1545 raft_consensus.cc:2376] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9. Re-sending same reply.
I20260709 13:01:29.320163  5115 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:29.339221  5131 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:29.340169  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:29.272382  5097 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.379447  1659 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:29.328840  5114 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.367077  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:29.330827  5085 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.335940  1691 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:29.397137  2257 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:29.362172  4885 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.358414  5094 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.372085  5099 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.410179  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 220712us
I20260709 13:01:29.371937  4911 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:29.358754  5133 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:29.355921  4614 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.374863  4953 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.415361  5094 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.391484  4821 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.371640  5022 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.403553  4946 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:29.403524  4687 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:29.411723  4833 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:29.394359  5040 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.432367  2265 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:29.418704  5099 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.411484  4750 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:01:29.447817  4648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.009s	sys 0.027s
I20260709 13:01:29.414250  4898 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:29.428966  5076 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:01:29.458144  5061 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:01:29.427068  4885 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.487160  5076 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:29.487531  5076 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.488560  5076 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.488981  4885 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:29.457732  5133 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:29.489864  5134 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:01:29.448673  5097 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.490609  5097 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.491225  5008 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:29.492547  5085 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.471316  5116 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.493609  5116 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.493749  5114 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:29.472564  5135 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:01:29.458297  4953 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.494519  5116 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.469687  4614 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:29.496378  4953 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.456339  4911 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.497008  5076 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.480207  5022 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.480895  4833 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:29.499830  4833 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.501183  4842 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.501685  4842 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.483511  4960 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.502593  4960 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:29.485852  4831 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.487577  5094 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.457448  5078 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.503734  4842 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.504480  5078 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:29.505046  4842 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.505553  5078 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.508554  2259 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:29.509083  5129 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:29.509593  5129 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:29.503443  5115 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:29.523999  4648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.499s	user 0.010s	sys 0.027s
I20260709 13:01:29.510550  5129 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.525242  5129 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.526693  5115 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:29.527019  5053 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.527635  5115 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.528455  5133 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.528909  5115 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.512310  4959 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.513319  5071 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:29.519326  5078 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.517200  4911 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:29.532210  5116 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:29.577116  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 230603us
I20260709 13:01:29.579360  1510 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:29.581642  1510 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:29.587770  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.588624  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.589900  1544 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:29.591221  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.591375  1510 leader_election.cc:400] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8.
I20260709 13:01:29.591467  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.593065  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:29.594101  1544 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:29.595727  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 466) took 2265 ms. Trace:
I20260709 13:01:29.596297  1538 rpcz_store.cc:276] 0709 13:01:27.333681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.572101 (+238420us) service_pool.cc:224] Handling call
0709 13:01:27.574439 (+  2338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:27.615816 (+ 41377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.615854 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:27.615894 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:27.615929 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.595110 (+1979181us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b5400021054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.595223 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.595524 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94634752}
W20260709 13:01:29.597417  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.590112  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.601665   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:29.602591  1540 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
W20260709 13:01:29.602831  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2367) took 1562 ms (client timeout 1632 ms). Trace:
W20260709 13:01:29.603459  1539 rpcz_store.cc:269] 0709 13:01:28.040629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.040790 (+   161us) service_pool.cc:224] Handling call
0709 13:01:29.602144 (+1561354us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540018abd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.602543 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2359361280}
I20260709 13:01:29.605129  1542 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 13:01:29.606298  1539 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:29.607959  1542 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [4.4-8.6]
W20260709 13:01:29.375177  1547 rpcz_store.cc:269] 0709 13:01:27.974184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.974320 (+   136us) service_pool.cc:224] Handling call
0709 13:01:29.324396 (+1350076us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400256f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.330909 (+  6513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504154880}
W20260709 13:01:29.444715  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51158.7us
I20260709 13:01:29.649688  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1637) took 1540 ms. Trace:
W20260709 13:01:29.632061  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2369) took 1526 ms (client timeout 1774 ms). Trace:
W20260709 13:01:29.655963  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.656852  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2287) took 2345 ms (client timeout 1564 ms). Trace:
I20260709 13:01:29.658116  1694 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:29.622394  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 478) took 1542 ms. Trace:
I20260709 13:01:29.660151  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 598) took 1748 ms. Trace:
I20260709 13:01:29.610544  1542 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:29.638342  1539 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:29.664634  1621 rpcz_store.cc:276] 0709 13:01:27.911457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.911615 (+   158us) service_pool.cc:224] Handling call
0709 13:01:27.912024 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.696636 (+784612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.659522 (+962886us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54000f8cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.659984 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1802698496}
I20260709 13:01:29.663441  1687 rpcz_store.cc:276] 0709 13:01:28.108577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.108690 (+   113us) service_pool.cc:224] Handling call
0709 13:01:28.145760 (+ 37070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.347857 (+202097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.648190 (+1300333us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b5400453b54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:29.649253 (+  1063us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168277888}
I20260709 13:01:29.678333  4933 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:29.679497  4933 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.681818  4972 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:01:29.683465  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.684056  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.663726  1541 rpcz_store.cc:269] 0709 13:01:28.105370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.222086 (+116716us) service_pool.cc:224] Handling call
0709 13:01:29.631155 (+1409069us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b5400046fd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.631677 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624082816}
I20260709 13:01:29.689962  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:29.690925  1690 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:29.664572  1543 rpcz_store.cc:276] 0709 13:01:28.079395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.079513 (+   118us) service_pool.cc:224] Handling call
0709 13:01:29.324556 (+1245043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:29.357567 (+ 33011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.621286 (+263719us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400256f50. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.621904 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729610496}
W20260709 13:01:29.664057  1689 rpcz_store.cc:269] 0709 13:01:27.311204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.317503 (+  6299us) service_pool.cc:224] Handling call
0709 13:01:29.656179 (+2338676us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b5400366ad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:29.656551 (+   372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753106816}
I20260709 13:01:29.715621  1695 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:29.717084  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.717165  4933 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.718271  4933 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.718592  1538 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:29.719239  4933 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:29.721947  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.723342  1545 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:29.726502  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.728494  1542 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:29.751345  1539 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:29.750747  1621 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:29.747563  1695 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:29.753959  1616 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:29.765038  1690 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:29.768019  4726 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:29.748931  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:29.746493  4821 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:29.769236  1696 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:29.753846  4648 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.749333  5141 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.770610  4648 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.771350  5141 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:29.773556  4648 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.774045  5141 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:29.755046  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:29.775085  1687 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:29.763489  1621 pending_rounds.cc:85] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:01:29.775625  1621 pending_rounds.cc:107] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:29.775931  1621 raft_consensus.cc:2889] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:29.755190  5128 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.768218  4891 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:29.779253  4891 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.779176  5128 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:29.779780  4891 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:29.780906  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.774942  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:29.748114  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:29.749691  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.768491  4726 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.748286  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:29.786404  1688 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:29.791817  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.794919  4933 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:29.795835  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.796414   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:29.797233  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:29.749887  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:29.819939  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.931408  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.899344  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.800223  1544 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:01:29.926316  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 151632us
W20260709 13:01:30.050876  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.099403  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2374) took 1016 ms. Trace:
I20260709 13:01:29.801379  1540 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:29.884133  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:29.797935  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:29.892045  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.099982  1544 rpcz_store.cc:276] 0709 13:01:29.082607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.599818 (+517211us) service_pool.cc:224] Handling call
0709 13:01:29.799645 (+199827us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800002a98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:29.799888 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.099023 (+299135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.099341 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26074368}
I20260709 13:01:29.875324  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.112466  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:30.113976  1620 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
W20260709 13:01:30.121395  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.074186  5144 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:01:30.113020  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:29.874734  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 113133us
I20260709 13:01:30.127574  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2376) took 1041 ms. Trace:
I20260709 13:01:29.805831  4726 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.121924  1620 pending_rounds.cc:85] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
I20260709 13:01:30.121369  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:29.898165  5040 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.111980  4911 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:30.130605  1620 pending_rounds.cc:107] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:01:30.046491  4935 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.127995  1540 rpcz_store.cc:276] 0709 13:01:29.085724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.603606 (+517882us) service_pool.cc:224] Handling call
0709 13:01:29.756088 (+152482us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b5800002a98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:29.756336 (+   248us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:30.127298 (+370962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.127522 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17018112}
W20260709 13:01:30.132879  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.134588  1620 raft_consensus.cc:2889] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.073220  5099 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.136143  1687 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:30.131901  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:30.137424  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.582s (SENT) [suppressed 17 similar messages]
I20260709 13:01:30.142745  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:30.145975  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:29.766352  4451 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.412s
I20260709 13:01:30.135439  4911 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.152721  5106 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:30.153160  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.162832  1693 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.011s
I20260709 13:01:30.163203  1617 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.163327  1693 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:30.163928  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 555) took 1025 ms. Trace:
I20260709 13:01:30.164233  1693 rpcz_store.cc:276] 0709 13:01:29.138724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.142833 (+  4109us) service_pool.cc:224] Handling call
0709 13:01:30.163851 (+1021018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:30.165560  1615 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:30.166414  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46534us
I20260709 13:01:30.166838  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:30.146674  5128 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.168149  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:30.168401  5128 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:30.168960  5128 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.169139  1613 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:01:30.169440  5128 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.170384  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:30.171182  1613 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:30.172201  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:30.173431  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:30.173943  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.174278  1613 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:01:30.175343  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:30.175778  5116 consensus_meta.cc:287] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.006s
W20260709 13:01:30.176451  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.177217  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.176919  1693 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.169116  1615 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:30.176481  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:30.181912  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 44575.1us
I20260709 13:01:30.185498  1619 raft_consensus.cc:2368] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8.
I20260709 13:01:30.179643  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:30.186960  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.161653  4911 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:30.190696  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 497126us
W20260709 13:01:30.188722  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 391104us
W20260709 13:01:30.191851  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.193204  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:30.196734  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.197890  5127 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:30.198851  1511 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:30.199276  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.199715  2264 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:30.199916  5099 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:30.200145  1618 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:30.201337  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:30.201573  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 452087us
I20260709 13:01:30.202126  1618 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:30.198566  5127 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:30.200067  2266 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 5.
I20260709 13:01:30.202601  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:30.201212  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.212355  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.203308  1622 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:30.208833  1511 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:30.178288  5106 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.224283  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:30.203630  5099 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
W20260709 13:01:30.238909  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.243530  2263 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:30.251083  1613 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:30.208384  4842 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:01:30.206030  5116 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:30.247010  1619 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:30.162308  4935 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.259331  1618 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.202919  4999 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:30.258507  1615 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.256771  5116 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.279810  2263 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:30.280129  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.256465  5141 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:30.280441  2263 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:30.204702  5127 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.269434  5099 consensus_queue.cc:1243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:30.289284  5019 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.279960  5116 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:30.296221  5019 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.297164  5037 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.303193  2266 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:30.293766  4972 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:30.289778  2263 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.289702  4999 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.310312  1619 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.265483  4842 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 13:01:30.333319  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63073.8us
I20260709 13:01:30.352797  1615 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:30.353255  2263 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:30.361159  5078 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.797s	user 0.000s	sys 0.018s
I20260709 13:01:30.367879  1621 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:30.332931  4999 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.354056  4972 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.384542  2259 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:30.385083  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.388461  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.333591  5141 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.338887  5037 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:30.399214  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 190884us
I20260709 13:01:30.377677  4999 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.400750  1619 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:30.393774  4891 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.006s
I20260709 13:01:30.398106  5099 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:30.419615  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 252051us
I20260709 13:01:30.423889  1622 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:30.438546  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:30.419536  4833 raft_consensus.cc:2764] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:30.442236  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.447038  1619 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:30.419195  5155 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.405965  4972 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.481303  2259 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:30.442878  4451 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.414002  4891 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.481158  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.510021  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:30.515825  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 303625us
I20260709 13:01:30.521127  1693 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:30.469141  4933 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:30.496685  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.446422  5099 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.488948  4935 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.553227  4935 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:30.559171  1689 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:30.551380  2260 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
W20260709 13:01:30.571554  4960 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.947s	user 0.016s	sys 0.002s
I20260709 13:01:30.534868  4933 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.578864  1692 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:30.579120  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.554100  4935 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:30.590113  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 386287us
I20260709 13:01:30.521930  4451 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.592869  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.535528  5155 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:30.594540  4959 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.915s	user 0.006s	sys 0.011s
I20260709 13:01:30.623680  1691 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:30.624526  5040 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:30.624961  5071 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.095s	user 0.000s	sys 0.014s
I20260709 13:01:30.624930  5040 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:30.625747  5161 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:30.626053  1616 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:30.626216  5040 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.626418  5161 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.627426  5166 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:30.627902  5166 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:30.629181  5161 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.628850  5166 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.629801  5161 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.627420  5040 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:30.632447  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.632983  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.630401  5166 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:30.635128  1695 raft_consensus.cc:2410] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:30.632102  1659 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.605386  4935 consensus_queue.cc:1243] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:30.638824  4938 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:30.645606  5053 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.118s	user 0.009s	sys 0.009s
I20260709 13:01:30.647056  4911 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.648077  5148 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.648643  5148 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.649452  4911 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:30.650291  1614 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:30.634788  5019 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:30.657222  5160 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:30.659065  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1872) took 3607 ms. Trace:
W20260709 13:01:30.659924  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.660069  5171 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:30.660583  5171 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.660916  5171 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.662026  5106 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:30.662815  5158 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:30.663558  4842 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:30.664076  4842 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:30.664249  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1917) took 1308 ms. Trace:
I20260709 13:01:30.664690  1547 rpcz_store.cc:276] 0709 13:01:29.355934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.613704 (+257770us) service_pool.cc:224] Handling call
0709 13:01:29.614151 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:29.676707 (+ 62556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:29.676751 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:29.885964 (+209213us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b2c00000658. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:01:29.886601 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.152406 (+265805us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:30.152437 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.152522 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.663872 (+511350us) raft_consensus.cc:1685] finished
0709 13:01:30.663892 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.664100 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52240,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":262,"spinlock_wait_cycles":12310784,"thread_start_us":293860,"threads_started":2,"wal-append.queue_time_us":502399}
W20260709 13:01:30.666813  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.669889  5159 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:01:30.674211  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 563) took 1029 ms. Trace:
I20260709 13:01:30.652487  5148 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.674777  1691 rpcz_store.cc:276] 0709 13:01:29.645813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.677842 (+ 32029us) service_pool.cc:224] Handling call
0709 13:01:29.678481 (+   639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.624207 (+945726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.673152 (+ 48945us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b54005017a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a851dc0 00007f7f1a8dda02 00007f7f1a8d9dd6 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:01:30.673985 (+   833us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000b4ad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:30.674156 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129572992}
W20260709 13:01:30.684657  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70453.2us
I20260709 13:01:30.634147  5037 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.630403  5161 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.694263  2263 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:30.695468  1444 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 9, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:30.696604  5162 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:01:30.699532  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.001s	sys 0.021s
I20260709 13:01:30.707054  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1824) took 1442 ms. Trace:
W20260709 13:01:30.709775  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.021s
I20260709 13:01:30.690027  5141 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:30.700853  4726 consensus_meta.cc:287] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.006s
I20260709 13:01:30.709281  1614 rpcz_store.cc:276] 0709 13:01:29.259892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.260019 (+   127us) service_pool.cc:224] Handling call
0709 13:01:30.688970 (+1428951us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002c88d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:30.702043 (+ 13073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190419840}
I20260709 13:01:30.659478  1546 rpcz_store.cc:276] 0709 13:01:27.003459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.293703 (+290244us) service_pool.cc:224] Handling call
0709 13:01:28.343643 (+1049940us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b5800002a98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:28.343901 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.344654 (+   753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.344688 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.560945 (+216257us) log.cc:844] Serialized 26 byte log entry
0709 13:01:29.638032 (+1077087us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b18003f28c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:01:30.137809 (+499777us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:30.421678 (+283869us) log.cc:844] Serialized 14 byte log entry
0709 13:01:30.595915 (+174237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.600514 (+  4599us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.600598 (+    84us) raft_consensus.cc:1685] finished
0709 13:01:30.600613 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.610789 (+ 10176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":438977,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":131134,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":207474,"spinlock_wait_cycles":46790144,"thread_start_us":883764,"threads_started":3,"wal-append.queue_time_us":1718848}
I20260709 13:01:30.720481  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:30.699878  4959 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:30.738369  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.755939  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.758257  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.759972  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.760891  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.761494  1695 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:30.665063  4842 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.764832  1687 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:30.764906  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.765326  5115 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:01:30.766117  1691 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:30.760388  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.712702  4891 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.770998  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:30.769724  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 567327us
I20260709 13:01:30.705165  4911 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 13:01:30.775379  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 342198us
I20260709 13:01:30.779827  5099 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.755575  4959 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.728434  4972 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.777583  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.785835  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.724531  4726 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.757436  5141 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:30.789559  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 343388us
I20260709 13:01:30.787555  2260 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:30.784897  4959 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:30.799014  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:30.800899  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.801641  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.802121  5053 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.802840  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1566) took 1024 ms. Trace:
I20260709 13:01:30.802688  5053 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.803525  4614 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.804008  4614 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.804949  5053 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.805815  4614 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.803236  1617 rpcz_store.cc:276] 0709 13:01:29.778504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.262163 (+483659us) service_pool.cc:224] Handling call
0709 13:01:30.273782 (+ 11619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.353041 (+ 79259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.353074 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.380302 (+ 27228us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.778089 (+397787us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:30.778129 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.778199 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.802591 (+ 24392us) raft_consensus.cc:1685] finished
0709 13:01:30.802632 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.802784 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43932,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":9313,"thread_start_us":356733,"threads_started":1,"wal-append.queue_time_us":399265}
I20260709 13:01:30.789808  5078 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.785501  5170 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.811307  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:30.811884  2266 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:30.808807  1547 raft_consensus.cc:2393] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:30.787680  5071 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.807447  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:30.813243  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.808702  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.814167  5173 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.814371  2259 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:30.814742  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:30.814983  5173 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.818846  5071 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.821310  5071 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:30.822381  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 400322us
W20260709 13:01:30.823719  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 220951us
I20260709 13:01:30.794382  4891 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:30.839263  4891 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.787864  4938 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:01:30.839654  4891 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:30.825947  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46582.7us
I20260709 13:01:30.826120  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:30.826576  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.784436  5099 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:01:30.827531  5078 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.828543  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:30.824523  5170 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:30.808277  5127 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.849016  1510 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.830057  5167 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.833586  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 565) took 1086 ms. Trace:
I20260709 13:01:30.838306  5069 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.838827  4451 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.844969  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:30.843101  2257 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:30.829238  5175 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.872882  5037 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:30.873514  5037 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.873972  5037 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:30.875388  5173 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.872722  5179 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:30.843394  4881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.035s	sys 0.031s
I20260709 13:01:30.822134  5176 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:30.850986  2266 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:30.847414  4614 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:30.850670  1688 rpcz_store.cc:276] 0709 13:01:29.747190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.787090 (+ 39900us) service_pool.cc:224] Handling call
0709 13:01:29.787492 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:30.117379 (+329887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:30.117411 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:30.143698 (+ 26287us) log.cc:844] Serialized 26 byte log entry
0709 13:01:30.710150 (+566452us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:30.710196 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:30.710261 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:30.833360 (+123099us) raft_consensus.cc:1685] finished
0709 13:01:30.833380 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:30.833528 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":221309,"raft.queue_time_us":344182,"raft.run_cpu_time_us":900,"raft.run_wall_time_us":30962,"thread_start_us":544008,"threads_started":1,"wal-append.queue_time_us":615273}
I20260709 13:01:30.853463  4933 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.853555  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:30.855479  5078 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.856417  5099 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:30.856807  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:30.857265  5167 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.858521  5161 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:30.860388  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 202) took 28467 ms (client timeout 15000 ms). Trace:
I20260709 13:01:30.861166  1444 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:01:30.836444   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:30.877141  5179 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.864060  4726 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:30.871068  4938 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:30.813369  5141 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:30.872684  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:30.849081  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.874332  5175 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:01:30.938100  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 84626.2us
W20260709 13:01:30.937988  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 72278.6us
I20260709 13:01:30.850807  5071 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:30.986236  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.940930  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 97346.1us
I20260709 13:01:30.862847  5155 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:31.014119  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 157375us
W20260709 13:01:30.881703  5116 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.542s	user 0.002s	sys 0.010s
W20260709 13:01:30.936786  4881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.047s	sys 0.046s
I20260709 13:01:30.941182  4935 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:31.067155  4935 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:31.068141  4999 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.005s
I20260709 13:01:31.068579  4999 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.069810  4935 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:30.999820  1696 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:30.939277  5128 consensus_meta.cc:287] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.002s
I20260709 13:01:30.999105  4933 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.070858  5128 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.071023  4933 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.072899  5128 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:31.073140  4933 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.002574  2266 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:31.074517  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.075435  5128 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:31.012428  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 139843us
I20260709 13:01:31.077180  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:31.077131  4933 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:30.852389  5127 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:31.078719  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63908.5us
I20260709 13:01:31.015897  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.079439  2259 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.079514  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.012663  1510 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.019273  2260 pending_rounds.cc:85] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 6
I20260709 13:01:31.018875  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:31.081506  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 62778.8us
I20260709 13:01:31.081735  5116 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.020568  5141 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.021082  1444 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 6, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.083956  5116 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:31.085285  2264 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:31.087177  2259 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:31.087426  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.088052  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.088547  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.089094  2264 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 5.
I20260709 13:01:31.090214  2264 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:01:30.997946  1445 rpcz_store.cc:269] 0709 13:01:02.392824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.450182 (+ 57358us) service_pool.cc:224] Handling call
0709 13:01:30.860103 (+28409921us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:29.023824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:29.024551 (+   727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:29.024597 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:01:29.024623 (+    26us) tablet.cc:662] Decoding operations
0709 13:01:29.026048 (+  1425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:29.026163 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:29.026202 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:29.042106 (+ 15904us) tablet.cc:701] Row locks acquired
0709 13:01:29.042133 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:01:29.042334 (+   201us) write_op.cc:270] Start()
0709 13:01:29.042480 (+   146us) write_op.cc:276] Timestamp: P: 1783602089042267 usec, L: 0
0709 13:01:29.042510 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:01:29.152898 (+110388us) log.cc:844] Serialized 4809 byte log entry
0709 13:01:29.547739 (+394841us) op_driver.cc:464] REPLICATION: finished
0709 13:01:29.548885 (+  1146us) write_op.cc:301] APPLY: starting
0709 13:01:29.548966 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:29.549202 (+   236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:29.549328 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:29.550498 (+  1170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:29.551536 (+  1038us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:01:29.551610 (+    74us) write_op.cc:312] APPLY: finished
0709 13:01:29.552033 (+   423us) log.cc:844] Serialized 89 byte log entry
0709 13:01:29.552207 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.552370 (+   163us) write_op.cc:454] Released schema lock
0709 13:01:29.552434 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:29.713381 (+160947us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:29.714767 (+  1386us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6988543,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":902,"apply.run_cpu_time_us":3194,"apply.run_wall_time_us":3895,"num_ops":12,"prepare.queue_time_us":232373,"prepare.run_cpu_time_us":17280,"prepare.run_wall_time_us":435533,"raft.queue_time_us":62368,"raft.run_cpu_time_us":1234,"raft.run_wall_time_us":1234,"replication_time_us":505038,"thread_start_us":560159,"threads_started":4,"wal-append.queue_time_us":325233}]]}
I20260709 13:01:31.025157  4726 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.000831  4938 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.012102  4614 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.028064  5167 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.029560  5037 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.106685  5037 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.035177  5115 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.108346  5115 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.112015  5115 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.034976  5181 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:30.878645  5069 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.115037  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.039956  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.119357  2265 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:31.041639  2263 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:01:31.042091  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.042461  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.122475  2262 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.122983  2261 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:31.044811  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.046257  5170 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.095252  5155 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:31.069871  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.128790  5176 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:31.075721  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.129568  5176 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.130108  5176 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.076406  1690 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:31.131469  5127 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:31.002736  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 100668us
I20260709 13:01:31.015347  4684 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:31.135385  4684 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.135732  4614 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.136263  4684 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.080672  2260 pending_rounds.cc:107] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:01:31.139047  2260 raft_consensus.cc:2889] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:31.025658  5161 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.083726  1444 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 9 to 10, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:30.999632  5179 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:31.104055  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 91477.9us
I20260709 13:01:31.134171  5127 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.159421  1510 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.095419  4911 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:01:31.141402  2266 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:31.173826  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.003427  5175 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.107684  4891 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.140609  5181 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:01:31.151160  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.185868  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.117422  4938 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:31.185967  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 106588us
I20260709 13:01:31.128113  5155 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:31.160477  5040 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:31.192649  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.152813  4999 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.118453  5069 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.197924  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:31.201946  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 87748.9us
I20260709 13:01:31.192288  5170 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:31.192574  4972 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:31.206008  1444 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 5, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.151091  5180 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:01:31.152702  5071 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:31.207829  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 93134us
I20260709 13:01:31.196152  5155 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:31.195960  4935 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:31.210992  2261 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.210986  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.195631  5106 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:31.198066  5040 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:31.213172  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.197734  5161 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.226313  5161 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.227397  2261 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:31.203481  5167 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.160881  5099 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:01:31.220194  4614 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.251677  4614 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.253674  4614 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.220568  5040 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.220296  4938 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.223903  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.224408  5115 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:31.225147  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 74129.5us
I20260709 13:01:31.203649  4726 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:31.231128  4972 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:31.241711  5171 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 13:01:31.242996  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.242928  4959 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.242825  1444 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 8, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:31.266849  1444 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 6 to 8, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:31.244333  5168 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:31.246718  5175 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.247681  5170 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.207456  5037 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:01:31.239303  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:31.255831  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57568.2us
W20260709 13:01:31.257267  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.260380  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.201663  5128 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:01:31.282294  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.261816  2262 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:31.264179  2258 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:31.250571  5071 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.284698  1444 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:01:31.270030  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 72221.7us
I20260709 13:01:31.271449  5175 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.259454  4614 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:31.273912  4891 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.274112  4959 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.266129  5069 raft_consensus.cc:2764] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:01:31.285782  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 55245.4us
I20260709 13:01:31.271940  5170 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:31.291548  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.296752  1444 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.289588  4881 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.289777  4911 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.298698  5173 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:31.230669  4935 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.271952  4972 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.321125  4959 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.321661  4959 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.322870  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.323416  2261 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:31.310566  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:31.311676  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56241.2us
I20260709 13:01:31.311795  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.261046  5106 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.316195  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.324837  2258 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.286108  5166 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.275591  5168 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:31.312067  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:31.266983  5171 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.318296  4614 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.320976  4935 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.332829  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.324122  2262 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:31.328236  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 125554us
I20260709 13:01:31.315346  5188 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:31.351045  4935 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:31.352933  5168 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.353646  5176 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.354238  5168 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.356454  5176 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:31.357807  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.306558  5040 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.358542  1693 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:31.360286  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:31.328799  5099 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:31.360960  2266 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:31.326045  4911 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:31.353659  1444 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:31.368197  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 84548.7us
I20260709 13:01:31.369731  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:31.370882  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 77432.3us
I20260709 13:01:31.371074  5069 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.371739  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.377244  1444 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.372972  5181 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:31.378734  5181 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:31.379113  5181 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:31.381381  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.365165  5191 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:01:31.372519  5163 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.385008  2261 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:31.384892  5163 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.385445  5071 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.385918  5071 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.387202  5163 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.387322  2262 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:31.388661  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.388516  5181 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.391363  5181 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.391268  4911 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:31.392405  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.392676  5106 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.394289  5170 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.362828  5188 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.372903  5115 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:31.395109  5115 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:31.395535  5115 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:31.340932  4891 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.402865  1444 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 6, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:31.408149  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 61760.6us
W20260709 13:01:31.408738  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.409116  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.359917  5167 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.422665  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:31.419914  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 99202.2us
I20260709 13:01:31.375907  5180 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:31.431530  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 59888.7us
I20260709 13:01:31.375804  4938 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:01:31.439889  5175 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:31.439932  5166 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.440363  5127 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:31.444115  4911 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.445838  4684 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.455022  1659 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.422341  5192 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.385046  5155 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.460090  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.427196  5176 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:01:31.429024  4891 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.395553  5188 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:31.649870  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.547793  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.589902  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.580417  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 223294us
I20260709 13:01:31.466379  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:31.562071  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139552us
W20260709 13:01:31.576599  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.652261  2262 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:31.553980  2230 leader_election.cc:400] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 7. Current term is 8.
W20260709 13:01:31.547924  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 128308us
I20260709 13:01:31.468169  2258 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:31.462986  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:31.656729  1510 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:31.465312  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 91590.5us
W20260709 13:01:31.661788  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.450513  4959 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:31.666888  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.667656  2258 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.674990  1510 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:31.688012  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.452191  5175 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.554090  4999 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.701433  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 159406us
W20260709 13:01:31.703568  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 237336us
I20260709 13:01:31.705343  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:31.706269  5189 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.575587  4684 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.446476  5179 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.552707  5037 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:31.463209  5163 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:31.663115  5176 consensus_queue.cc:1243] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:31.465721  5194 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:31.693306  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.707746  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.714170  2266 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:31.544741  5071 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:31.709803  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 43616.5us
I20260709 13:01:31.691082  5106 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:31.579069  5171 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.601444  4614 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.547086  5127 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:31.602932  5040 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.717200  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:31.546732  5116 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:01:31.717370  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:31.717789  5163 raft_consensus.cc:697] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:31.595994  5167 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.699862  5173 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:31.711016  5037 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.706665  5189 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.719935  5115 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.721935  5175 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.722808  5071 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:31.683943  4881 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:31.702907  5191 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:31.700176  4959 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:31.466857  4911 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.723804  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:31.725283  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:31.729919  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 194070us
I20260709 13:01:31.731890  2258 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:31.725759  5106 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:31.749387  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:31.786636  1546 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:31.749054  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:31.792075  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:31.781395  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.783022  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49483us
I20260709 13:01:31.789717  1538 pending_rounds.cc:85] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 3
I20260709 13:01:31.798890  1538 pending_rounds.cc:107] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:31.725159  5069 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:01:31.542263  5192 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.811267  1543 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:31.783727  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:31.799427  1538 raft_consensus.cc:2889] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:31.761691  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.761426  5173 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.746788  4935 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:31.899381  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.884068  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.899484  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:31.789104  5106 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.761513  5189 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.900461  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:31.905925  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:31.906482  1618 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:31.906759  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.901445  1693 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:31.906548  1545 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:31.831178  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.908931  1690 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:31.711050  4999 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.910516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.914250  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.914945  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:31.915668  1689 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:31.765129  4959 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.764506  5071 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.925688  5071 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:31.926218  5071 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:31.926736  5071 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:31.927103  2259 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:31.830693  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 105490us
I20260709 13:01:31.928913  5071 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:31.764719  4881 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.783052  5127 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.830701  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.932673  1696 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:31.933635  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:31.934224  1696 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:31.935544  1696 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:01:31.903434  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.764273  5175 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:31.732874  5198 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:31.936544  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.937186  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:31.922338  4959 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:31.906338  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:32.003460  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:31.794385  5116 raft_consensus.cc:2764] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:01:31.945488  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.945916  1510 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.948403  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:31.953569  1659 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:31.963116  1540 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:31.957633  1587 leader_election.cc:336] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.564s (SENT)
I20260709 13:01:31.765017  5191 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:31.740448  5194 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.166s
I20260709 13:01:31.972047  1688 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:31.985247  4881 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:31.967850  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:31.986361  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:32.045115  1614 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.045493  1690 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:31.782738  5168 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 13:01:31.763530  5115 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:32.005688  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 282036us
I20260709 13:01:32.007166  1616 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:32.004108  1541 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
W20260709 13:01:32.011665  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74566.8us
I20260709 13:01:31.757360  5163 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.037725  1544 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:32.043313  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 89868.1us
I20260709 13:01:31.907859  5173 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:31.761323  5037 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:31.765460  5195 consensus_queue.cc:1175] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:01:32.015851  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:32.171587  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.968621  5128 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:32.077765  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 131966us
I20260709 13:01:32.050675  2259 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:32.051591  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:32.136379  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:32.173171  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.173623  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.174001  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.170786  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:32.178094  1543 raft_consensus.cc:2410] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:32.179752  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:31.987833  5181 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:01:32.076424  5185 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:01:32.036859  5161 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.051342  5167 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:32.199010  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.086213  4881 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.233168  1545 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:01:32.052347  5190 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:32.101792  5116 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:32.222932  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:32.224534  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:32.136797  4938 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:32.141884  5179 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:32.191138  5040 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:32.195317  5209 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:32.273459  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:32.273953  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 316365us
I20260709 13:01:32.274253  1543 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:32.219502  5115 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.195344  4935 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.198206  5128 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:32.219453  5167 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:32.278235  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54171.2us
I20260709 13:01:32.231724  4881 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:32.287012  1587 leader_election.cc:336] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.582s (SENT)
I20260709 13:01:32.309777  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:32.274681  5069 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:32.303345  5217 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:32.236564  4614 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:32.310706  5221 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:32.345624  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:32.274863  5197 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:32.243734  5155 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:32.267346  5040 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.355404  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:32.308960  5167 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.315474  4881 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.306921  5209 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:32.284081  4935 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.373669  5176 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.377148  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101509us
W20260709 13:01:32.409080  1587 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.632s (SENT)
I20260709 13:01:32.409641  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:32.377883  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 429501us
I20260709 13:01:32.327504  5069 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:32.405598  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61120.4us
I20260709 13:01:32.407294   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:32.267575  5161 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.367352  5040 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:32.377045  5196 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:32.386716  5037 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:32.331339  5188 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:01:32.441867  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:32.444832  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 252902us
I20260709 13:01:32.326637  5115 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.445693  1689 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:32.406948  4935 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.436224  5069 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:32.454526  1687 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:32.435238  4959 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:32.435547  5221 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.462169  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:32.353250  5191 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.444679  4614 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:32.466511  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:32.468804  5224 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:01:32.471026  5214 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.389s	user 0.000s	sys 0.002s
I20260709 13:01:32.470654  5128 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.474128  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:32.477419  1546 consensus_meta.cc:287] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.000s
I20260709 13:01:32.477762  1546 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:32.486348  1614 raft_consensus.cc:2410] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:32.521831  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 112789us
W20260709 13:01:32.523198  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.527051  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:32.527760  1542 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:32.528659  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:32.529819  5181 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.529875  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:32.482383  5166 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.531543  5166 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:32.533545  5220 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:01:32.533720  5166 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:32.535234  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:32.535815  4891 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:32.536089  5173 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:32.536623  1695 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:32.538393  5216 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 13:01:32.540007  5207 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:01:32.544981  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:32.545665  1544 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:32.548362  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.553824  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:32.558336  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.560999  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.562532  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.550084  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.440199  5176 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.566951  1615 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:32.578714  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.579838  2262 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:32.580562  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:32.579608  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:32.581885  2258 raft_consensus.cc:2376] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8. Re-sending same reply.
I20260709 13:01:32.579087  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.586246  2266 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:01:32.565959  5189 consensus_meta.cc:287] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.000s
I20260709 13:01:32.588069  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.589061  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.481658  4999 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:32.598040  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.593870  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:32.599460  1693 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:32.462585  5192 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:32.594628  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:32.633870  2259 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:32.583670  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:32.599152  2260 raft_consensus.cc:2368] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:32.634634  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:32.530479  5181 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.630792  1542 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:32.565711  5173 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:32.650784  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 67225.9us
I20260709 13:01:32.635259  2266 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:32.630023  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:32.574498  5171 raft_consensus.cc:2764] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:32.548363  5040 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:32.639403  1616 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:01:32.642769  5222 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:01:32.644094  5238 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.647284  1613 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:01:32.648638  1545 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:32.649343  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.649827  1546 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:32.474103  4959 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.595098  4938 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:32.656232  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 198586us
I20260709 13:01:32.482697  5221 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:32.628046  5189 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.661813  1613 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:32.718402  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:32.731856  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 80953.4us
I20260709 13:01:32.751132  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.843303  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:32.755774  5106 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.001s
W20260709 13:01:32.851536  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 199292us
W20260709 13:01:32.764310  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.661911  2263 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:32.580142  5209 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.703900  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.815158  1545 pending_rounds.cc:85] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 7
I20260709 13:01:32.887956  1545 pending_rounds.cc:107] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:32.888034  1622 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:32.888342  1545 raft_consensus.cc:2889] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.663312  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:32.844413  2260 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:32.773865  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:32.656394  4614 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:32.848944  1540 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:32.849128  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:32.891474  1613 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:32.849709  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.848174  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:32.893975  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 230771us
I20260709 13:01:32.895529  1618 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:32.896551  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.897243  1618 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:32.898298  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.899722  1614 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:32.904436  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:32.908571  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 250948us
I20260709 13:01:32.660456  5173 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.911880  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:32.897543  5198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.009s	sys 0.001s
I20260709 13:01:32.914569  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.924940  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:32.795163  5222 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:01:32.927630  1613 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:32.927762  1693 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:32.927636  1614 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:32.925642  1546 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:32.842309  5171 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:01:32.912593  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:32.935889  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:32.912767  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:32.892132  4614 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.939767  1622 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:32.940465  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:32.941309  1618 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:32.948632  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45513.5us
I20260709 13:01:32.758849  5225 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.164s
W20260709 13:01:32.919188  5233 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.003s
I20260709 13:01:32.903757  5166 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:32.707000  5238 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:32.950471  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 53725us
I20260709 13:01:32.954456  1585 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:32.919067  5188 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.876188  5106 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:32.940562  5198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.009s	sys 0.001s
I20260709 13:01:32.906320  5224 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:32.976675  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.001744  1695 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:32.759342  5208 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.279s
I20260709 13:01:32.979405  1614 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:32.948458  4614 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:32.998711  5232 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:01:32.999480  1689 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:01:32.999840  5242 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:01:33.000173  5241 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:33.002395  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:33.004799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:32.954221  5168 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:32.969324  5166 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.971028  4938 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:32.969435  5115 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.024117  1694 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:33.077970  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.080564  1616 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:33.078186  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.082944  1613 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:33.018828  1541 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:33.083585  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 235533us
I20260709 13:01:33.024879  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1670) took 1126 ms. Trace:
W20260709 13:01:33.000973  5230 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:01:33.088135  1695 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:33.083324  1622 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:33.091481  1622 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:33.084870  1613 pending_rounds.cc:85] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 4
I20260709 13:01:33.099198  1613 pending_rounds.cc:107] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:01:33.100020  1613 raft_consensus.cc:2889] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:33.022912  4881 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.584s	user 0.003s	sys 0.006s
I20260709 13:01:33.092628  1622 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:33.020809  5069 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.546s	user 0.008s	sys 0.000s
I20260709 13:01:33.001202  5198 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:33.013630  5189 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.009222  5244 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.086660  1691 rpcz_store.cc:276] 0709 13:01:31.898940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.899066 (+   126us) service_pool.cc:224] Handling call
0709 13:01:31.961342 (+ 62276us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:31.981147 (+ 19805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.981178 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:32.010502 (+ 29324us) log.cc:844] Serialized 52 byte log entry
0709 13:01:32.405673 (+395171us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:32.405713 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.405779 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.024581 (+618802us) raft_consensus.cc:1685] finished
0709 13:01:33.024610 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.024806 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6505,"raft.queue_time_us":19961,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":15638,"thread_start_us":268552,"threads_started":1,"wal-append.queue_time_us":693080}
I20260709 13:01:33.036167  5181 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.111299  1622 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.015708  5040 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.116227  1695 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:01:33.085381  5166 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.117800  1689 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:33.121006  1544 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.005s
I20260709 13:01:33.024422  4911 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:33.025210  5248 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:33.123566  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 618) took 1306 ms. Trace:
I20260709 13:01:33.126086  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:33.103433  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:33.134784  1544 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:33.138159  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:33.138159  5248 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.139658  5248 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.132728  1621 rpcz_store.cc:276] 0709 13:01:31.817230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.899156 (+ 81926us) service_pool.cc:224] Handling call
0709 13:01:31.964623 (+ 65467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.980426 (+ 15803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.980457 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.980904 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.387162 (+406258us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:32.387228 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.387313 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.123321 (+736008us) raft_consensus.cc:1685] finished
0709 13:01:33.123343 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.123497 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6693,"spinlock_wait_cycles":65249152,"thread_start_us":314988,"threads_started":1,"wal-append.queue_time_us":565915}
I20260709 13:01:33.002130  5188 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.154312  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.164793  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.076666  5250 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:01:33.165498  1687 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.145169  5155 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:33.167979  5256 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.164640  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.121371  4881 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.111790  5069 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.172294  5254 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:33.168494  5256 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.168569  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.220382  5221 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.203212  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:33.278810  5228 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
I20260709 13:01:33.265985  1622 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:01:33.202526  5251 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.621s
I20260709 13:01:33.589700  5168 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:33.231307  5116 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.286950  5106 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.600752  5188 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.170321  5161 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.600409  5116 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.257774  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.275367  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.360567  5224 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.600035  5251 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:33.279500  4999 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:33.383728  1618 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:33.636322  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:33.168323  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:33.363330  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 361060us
I20260709 13:01:33.219784  1687 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:33.466559  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 517640us
I20260709 13:01:33.599113  1622 pending_rounds.cc:85] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 4
I20260709 13:01:33.524976  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 571) took 1086 ms. Trace:
I20260709 13:01:33.638535  1622 pending_rounds.cc:107] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:01:33.639086  1622 raft_consensus.cc:2889] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:33.218890  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.257536  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:33.360656  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 193264us
I20260709 13:01:33.641201  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.521380  5238 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.596994  1546 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:33.604980  1621 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:33.599915  5168 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.525523  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 498) took 1005 ms. Trace:
I20260709 13:01:33.644212  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1941) took 1069 ms. Trace:
I20260709 13:01:33.645923  1546 rpcz_store.cc:276] 0709 13:01:32.574959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.137928 (+562969us) service_pool.cc:224] Handling call
0709 13:01:33.644132 (+506204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.595291  5254 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.168874  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.597424  5256 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.276019  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.143716  5244 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.610589  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.637248  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:33.650348  1616 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:01:33.610945  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.230484  5167 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.000s
I20260709 13:01:33.172570  5099 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.462s
W20260709 13:01:33.605424  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 438626us
I20260709 13:01:33.518301  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.619046  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:33.519814  5253 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:01:33.166014  5189 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:33.656165  5215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.010s	sys 0.021s
I20260709 13:01:33.171381  4614 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.606792  5166 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.171195  5173 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.220580  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1924) took 1436 ms. Trace:
I20260709 13:01:33.220325  4959 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.271061  5257 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:33.420095  5262 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:33.170511  5176 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.377602  5226 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:33.270228  5240 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:01:33.734040  5226 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.638026  1618 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.736438  5226 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.737002  5226 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:33.737602  1587 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.544s (SENT)
I20260709 13:01:33.737445  5226 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.644706  1542 rpcz_store.cc:276] 0709 13:01:32.519922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.528405 (+  8483us) service_pool.cc:224] Handling call
0709 13:01:33.525343 (+996938us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540013f1d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:33.525459 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232969984}
I20260709 13:01:33.648442  1689 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:33.744262  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1933) took 1605 ms. Trace:
I20260709 13:01:33.744819  1541 rpcz_store.cc:276] 0709 13:01:32.138994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.183770 (+ 44776us) service_pool.cc:224] Handling call
0709 13:01:32.231341 (+ 47571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.083899 (+852558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.743941 (+660042us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54000465d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:33.744185 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810725760}
I20260709 13:01:33.610553  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:33.652122  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.746816  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.270330  5040 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.364s
I20260709 13:01:33.170667  5223 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.605s
I20260709 13:01:33.654839  1687 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:33.622303  4911 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:33.653527  1585 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:33.612181  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.017s
W20260709 13:01:33.790356  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.001s	sys 0.017s
I20260709 13:01:33.791254  1688 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:33.791810  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1686) took 1018 ms. Trace:
I20260709 13:01:33.792217  1693 rpcz_store.cc:276] 0709 13:01:32.773685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.929104 (+155419us) service_pool.cc:224] Handling call
0709 13:01:32.929559 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.930016 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.930043 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.936952 (+  6909us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.791455 (+854503us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:33.791495 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.791572 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.791630 (+    58us) raft_consensus.cc:1685] finished
0709 13:01:33.791641 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.791756 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":874,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":707177,"threads_started":1,"wal-append.queue_time_us":732700}
I20260709 13:01:33.663296  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.794698  1695 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:33.664798  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:33.625332  1511 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:33.634724  5251 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:33.666486  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.667101  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:33.667527  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.800926  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.801422  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.634999  4999 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:33.671437  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.655680  5115 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.651543  5254 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:33.523058  5198 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:33.719635  5218 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.407s	user 0.002s	sys 0.003s
I20260709 13:01:33.721019  5208 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:33.830694  5208 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:33.830899  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 572) took 1389 ms. Trace:
I20260709 13:01:33.831650  5208 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.721832  5166 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.833154  5166 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.833635  5166 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.835565  5244 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:33.836042  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:33.670527  4935 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.218s	user 0.010s	sys 0.002s
I20260709 13:01:33.800266  5262 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.838956  4935 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.841281  5262 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:33.841652  4935 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.841820  5262 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.636860  5224 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.843881  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.844548  5224 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:33.845508  1545 raft_consensus.cc:2368] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10.
I20260709 13:01:33.845431  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.668433  5189 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.725381  1538 rpcz_store.cc:276] 0709 13:01:31.784107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.784278 (+   171us) service_pool.cc:224] Handling call
0709 13:01:31.784646 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:32.000965 (+216319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.000995 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:32.008857 (+  7862us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.386419 (+377562us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:32.386475 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.386582 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.220324 (+833742us) raft_consensus.cc:1685] finished
0709 13:01:33.220350 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.220513 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":284235,"threads_started":1,"wal-append.queue_time_us":577756}
I20260709 13:01:33.728966  5116 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:33.729732  5069 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:33.846457  1621 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:33.738051  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:33.851737  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 114204us
W20260709 13:01:33.740739  5231 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.205s	user 0.004s	sys 0.000s
I20260709 13:01:33.638652  1692 rpcz_store.cc:276] 0709 13:01:32.438705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.438886 (+   181us) service_pool.cc:224] Handling call
0709 13:01:32.447523 (+  8637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.894988 (+447465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.895028 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:32.895070 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:32.895104 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.524747 (+629643us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001f5ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:33.524794 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.524918 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":926325120}
W20260709 13:01:33.717150  5175 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.705s	user 0.008s	sys 0.012s
I20260709 13:01:33.661841  5167 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.660085  1691 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:33.798831  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.801874  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:33.803296  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 139140us
W20260709 13:01:33.803578  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 178330us
I20260709 13:01:33.861683  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:33.807195  1622 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:01:33.810720  1618 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:33.812683  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:33.862874  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:33.813930  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.814116  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:33.863952  1695 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
W20260709 13:01:33.864070  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 50053.2us
I20260709 13:01:33.827560  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.858903  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:33.847927  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2391) took 1058 ms. Trace:
I20260709 13:01:33.865257  1689 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:33.867784  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:33.818540  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.866371  1545 rpcz_store.cc:276] 0709 13:01:32.789785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.125688 (+335903us) service_pool.cc:224] Handling call
0709 13:01:33.847671 (+721983us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540018abd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:33.847852 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1634724736}
W20260709 13:01:33.821455  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 168019us
I20260709 13:01:33.823719  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.869760  1541 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:33.818536  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.829952  1615 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:33.835649  5166 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:33.675092  5215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.010s	sys 0.022s
W20260709 13:01:33.852391  1587 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.563s (SENT)
I20260709 13:01:33.883529  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:33.883634  1587 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.563s (SENT)
I20260709 13:01:33.861058  1540 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:33.870675  1542 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:33.849995  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.862107  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:33.862285  1622 pending_rounds.cc:85] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:01:33.874382  1547 raft_consensus.cc:2410] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:33.875532  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.877827  1695 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:33.811952  4911 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:33.967087  1585 leader_election.cc:400] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:33.883379  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 621) took 2061 ms. Trace:
I20260709 13:01:34.232955  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:33.923285  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2392) took 1133 ms. Trace:
I20260709 13:01:34.235433  1545 rpcz_store.cc:276] 0709 13:01:32.790049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.883267 (+1093218us) service_pool.cc:224] Handling call
0709 13:01:33.923202 (+ 39935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.968797  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.233554  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.228832  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1595) took 1388 ms. Trace:
I20260709 13:01:34.237361  1613 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:34.237495  1615 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:34.037876  1691 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:33.831362  1696 rpcz_store.cc:276] 0709 13:01:32.441267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.441451 (+   184us) service_pool.cc:224] Handling call
0709 13:01:32.456973 (+ 15522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:32.519652 (+ 62679us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:32.589651 (+ 69999us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.728484 (+1138833us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b18002b0f00. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a 00007f7f1a8e4a2a
0709 13:01:33.830082 (+101598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:33.830134 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:33.830180 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.830243 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.830833 (+   590us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":75122,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":8690,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":7582592,"thread_start_us":92279,"threads_started":1}
I20260709 13:01:33.884109  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:33.820195  5256 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:34.236707  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:34.058534  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.145396  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 296518us
I20260709 13:01:34.233906  1622 pending_rounds.cc:107] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:33.975574  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.228404  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:33.819164  5176 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.233680  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2407) took 1209 ms. Trace:
I20260709 13:01:34.269182  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1945) took 1102 ms. Trace:
I20260709 13:01:34.233687  1539 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:33.952250  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:34.220242  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 358627us
W20260709 13:01:33.890061  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 233705us
I20260709 13:01:34.271420  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:33.968369  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:33.825965  5265 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.268079  1622 raft_consensus.cc:2889] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:33.848193  5189 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.270354  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2396) took 1426 ms. Trace:
W20260709 13:01:34.185508  5282 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:34.269492  1542 rpcz_store.cc:276] 0709 13:01:33.023878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.784303 (+760425us) service_pool.cc:224] Handling call
0709 13:01:34.233619 (+449316us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.122891  5209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.017s
I20260709 13:01:34.289938  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:34.237432  1617 rpcz_store.cc:276] 0709 13:01:32.840300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.978062 (+137762us) service_pool.cc:224] Handling call
0709 13:01:33.000353 (+ 22291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.363565 (+363212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.363622 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.517416 (+153794us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.803024 (+285608us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:33.803067 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.803130 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.978542 (+175412us) raft_consensus.cc:1685] finished
0709 13:01:33.978563 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.228750 (+250187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171221,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":528182,"threads_started":2,"wal-append.queue_time_us":353928}
I20260709 13:01:34.239203  1546 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:34.233815  1585 leader_election.cc:403] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:34.243438  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 381399us
W20260709 13:01:33.952250  5227 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.417s	user 0.003s	sys 0.000s
I20260709 13:01:33.883823  5069 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:34.269678  1545 rpcz_store.cc:276] 0709 13:01:33.166403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.236458 (+1070055us) service_pool.cc:224] Handling call
0709 13:01:34.269121 (+ 32663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.289893  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.273502  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2386) took 1485 ms. Trace:
I20260709 13:01:34.293095  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.293568  1541 rpcz_store.cc:276] 0709 13:01:32.788423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.883510 (+1095087us) service_pool.cc:224] Handling call
0709 13:01:34.273446 (+389936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.292014  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2401) took 1386 ms. Trace:
I20260709 13:01:34.275751  1622 pending_rounds.cc:107] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:34.275445  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.273566  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:34.273000  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2409) took 1248 ms. Trace:
I20260709 13:01:34.294706  1546 rpcz_store.cc:276] 0709 13:01:32.905758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.859570 (+953812us) service_pool.cc:224] Handling call
0709 13:01:34.291950 (+432380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.282305  1539 rpcz_store.cc:276] 0709 13:01:32.843443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.826816 (+983373us) service_pool.cc:224] Handling call
0709 13:01:34.270292 (+443476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.295274  1538 rpcz_store.cc:276] 0709 13:01:33.024389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.849721 (+825332us) service_pool.cc:224] Handling call
0709 13:01:34.272937 (+423216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:33.884109  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:34.184514  5248 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.044s	user 0.006s	sys 0.006s
I20260709 13:01:34.234458  1619 rpcz_store.cc:276] 0709 13:01:31.825470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.898598 (+ 73128us) service_pool.cc:224] Handling call
0709 13:01:31.968939 (+ 70341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.969255 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.969282 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.969706 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.376263 (+406557us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:32.376302 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.389510 (+ 13208us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.739942 (+1350432us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:33.854683 (+114741us) raft_consensus.cc:1685] finished
0709 13:01:33.854708 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:33.883316 (+ 28608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2224,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":34161,"spinlock_wait_cycles":54547200,"thread_start_us":325189,"threads_started":1,"wal-append.queue_time_us":432058}
I20260709 13:01:34.294920  1622 raft_consensus.cc:2889] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:34.286653  1693 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:34.243217  5166 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.296537  2263 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:33.976529  4614 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:33.952581  5191 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:34.289523  5209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.014s	sys 0.019s
I20260709 13:01:33.842543  5262 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:33.826278  5115 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.328697  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.038146  5250 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:01:34.271564  5271 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.293040  1542 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
I20260709 13:01:34.303138  1545 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:34.373235  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1946) took 1169 ms. Trace:
I20260709 13:01:34.335098  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.363831  1696 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:34.373747  1545 rpcz_store.cc:276] 0709 13:01:33.203457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.292865 (+1089408us) service_pool.cc:224] Handling call
0709 13:01:34.373183 (+ 80318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.322382  5261 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:34.311749  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 428138us
I20260709 13:01:34.314731  2266 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:34.381457  1587 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.639s (SENT)
I20260709 13:01:33.923785  5270 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:34.271234  5237 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.968173  5263 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.180445  5208 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.038542  5040 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:33.830899  5267 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.461s
I20260709 13:01:34.320079  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:34.150861  5168 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.321017  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:34.271703  5273 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:34.324004  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.325556  1688 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:01:34.275213  5279 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.282130  5099 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.284401  5167 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.439584  2266 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:34.329502  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.441045  1546 raft_consensus.cc:2410] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:34.441566  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2402) took 1493 ms. Trace:
I20260709 13:01:34.441929  1546 rpcz_store.cc:276] 0709 13:01:32.948057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.313734 (+1365677us) service_pool.cc:224] Handling call
0709 13:01:34.441500 (+127766us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.291440  5274 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260709 13:01:34.331379  1538 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:34.360167  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:34.332199  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:34.332576  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 365700us
W20260709 13:01:34.444729  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.445288  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.360553  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:34.292112  1540 raft_consensus.cc:2376] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9. Re-sending same reply.
I20260709 13:01:34.374931  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.373108  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1947) took 1157 ms. Trace:
I20260709 13:01:34.287712  4938 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:01:34.446981  1542 rpcz_store.cc:276] 0709 13:01:33.216120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.289576 (+1073456us) service_pool.cc:224] Handling call
0709 13:01:34.373036 (+ 83460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.380074  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:34.382045  1587 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.639s (SENT)
I20260709 13:01:34.448346  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.448701  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:34.383785  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2410) took 1359 ms. Trace:
I20260709 13:01:34.449216  1542 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:34.449357  1541 rpcz_store.cc:276] 0709 13:01:33.024634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.313410 (+1288776us) service_pool.cc:224] Handling call
0709 13:01:34.383700 (+ 70290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.449661  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2387) took 1661 ms. Trace:
I20260709 13:01:34.449983  1542 rpcz_store.cc:276] 0709 13:01:32.788695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.447974 (+1659279us) service_pool.cc:224] Handling call
0709 13:01:34.449606 (+  1632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.450304  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.451081  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1944) took 1294 ms. Trace:
I20260709 13:01:34.451473  1541 rpcz_store.cc:276] 0709 13:01:33.156370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.450032 (+1293662us) service_pool.cc:224] Handling call
0709 13:01:34.451023 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.452441  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.288931  5256 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:34.453809  5256 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.395279  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.458228  1696 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.041335  4999 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.410073  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:34.316218  5248 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.411595  5191 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.393111  1539 raft_consensus.cc:2376] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11. Re-sending same reply.
I20260709 13:01:34.482856  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1949) took 1242 ms. Trace:
I20260709 13:01:34.483222  1539 rpcz_store.cc:276] 0709 13:01:33.241022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.295664 (+1054642us) service_pool.cc:224] Handling call
0709 13:01:34.482787 (+187123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.433149  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.484345  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:34.484894  1613 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:34.374171  5271 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.485638  5271 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.413350  5237 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.488270  4959 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:34.489218  4959 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:34.489585  4959 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:34.490290  4911 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:34.443267  5040 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.451005  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.492964  1542 raft_consensus.cc:2368] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:34.493415  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2399) took 1648 ms. Trace:
I20260709 13:01:34.493768  1542 rpcz_store.cc:276] 0709 13:01:32.845394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.450571 (+1605177us) service_pool.cc:224] Handling call
0709 13:01:34.493358 (+ 42787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.494038  1541 raft_consensus.cc:2410] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:34.391377  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:34.287461  4935 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:01:34.385200  5250 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:34.461243  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:34.379320  5238 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.320436  5166 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:34.464272  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 82264.3us
I20260709 13:01:34.439023  5209 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:34.513511  1587 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.655s (SENT)
I20260709 13:01:34.514031  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:34.465565  5261 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.371789  4614 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.288388  5265 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:34.481173  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 207673us
I20260709 13:01:34.494810  2262 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:34.495039  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.412941  5273 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.497784  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 615) took 2661 ms. Trace:
I20260709 13:01:34.504720  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.414642  5270 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:34.416296  5226 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:34.436926  5099 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.507459  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.437144  5168 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:34.510462  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.515779  5069 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:34.516450  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 244492us
I20260709 13:01:34.493335  5040 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:34.482573  5191 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.490419  4959 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.461326  5279 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.523804  1542 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:01:34.534304  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2398) took 1689 ms. Trace:
I20260709 13:01:34.530364  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:34.554863  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 501) took 1956 ms. Trace:
I20260709 13:01:34.552152  2261 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 8: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:34.554564  1546 rpcz_store.cc:276] 0709 13:01:32.845097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.462883 (+1617786us) service_pool.cc:224] Handling call
0709 13:01:34.534233 (+ 71350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.555737  2231 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:34.555375  1542 rpcz_store.cc:276] 0709 13:01:32.598293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.494273 (+1895980us) service_pool.cc:224] Handling call
0709 13:01:34.517019 (+ 22746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.554570 (+ 37551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.554811 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:34.566051  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 53235.1us
I20260709 13:01:34.570719  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:34.572249  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:34.571931  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2395) took 1728 ms. Trace:
I20260709 13:01:34.573529  1538 rpcz_store.cc:276] 0709 13:01:32.843178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.463748 (+1620570us) service_pool.cc:224] Handling call
0709 13:01:34.571883 (+108135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:34.537352  4999 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.579213  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:34.539829  5250 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.596303  2258 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.555303  5099 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.601914  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.565217  5191 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.602547  1688 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.551410  5273 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.576886  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:34.610987  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:34.611871  1538 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:34.603683  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 90211.6us
W20260709 13:01:34.612775  1587 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.774s (SENT)
I20260709 13:01:34.604759  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.609596  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:34.613267  1587 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.774s (SENT)
I20260709 13:01:34.613624  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:34.521850  5238 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.611168  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.575102  5226 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:34.596019  5234 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.619589  2266 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:34.550755  1620 rpcz_store.cc:276] 0709 13:01:31.814593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.814908 (+   315us) service_pool.cc:224] Handling call
0709 13:01:31.828894 (+ 13986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.829790 (+   896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.829846 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.906995 (+ 77149us) log.cc:844] Serialized 26 byte log entry
0709 13:01:32.238018 (+331023us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:32.238060 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.238131 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:33.853775 (+1615644us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:34.440514 (+586739us) raft_consensus.cc:1685] finished
0709 13:01:34.440547 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.474602 (+ 34055us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2750,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":5656,"spinlock_wait_cycles":54943488,"thread_start_us":225334,"threads_started":1,"wal-append.queue_time_us":461653}
I20260709 13:01:34.614737  1613 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:34.615783  1696 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:34.600023  4959 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.630503  5267 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.631127  5267 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.633270  5267 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:34.633917  5294 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:01:34.634528  5284 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:34.636339  5181 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:34.636840  5181 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:34.636687  5270 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.573355  5040 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:01:34.639889  5262 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.640363  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 493) took 2161 ms. Trace:
I20260709 13:01:34.640744  1547 rpcz_store.cc:276] 0709 13:01:32.479181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.479350 (+   169us) service_pool.cc:224] Handling call
0709 13:01:34.640132 (+2160782us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54000848d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:34.640280 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077051648}
I20260709 13:01:34.641476  5265 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.642118  5304 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.642583  5304 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.620344  5226 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.628922  5115 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:34.643069  5304 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.643170  5226 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:34.643843  5248 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:34.643843  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:34.644829  2260 raft_consensus.cc:1217] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[7.9-7.9]   Dedup: 7.9->[]
I20260709 13:01:34.645335  2260 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:01:34.645583  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:34.568022  5168 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.646257  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:34.646831  2260 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.647646  5168 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.647742  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:34.648371  4935 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.648602  5300 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.648767  4935 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.649062  5300 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.649216  4935 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.649461  5300 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.595181  5176 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.623167  4881 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:34.650416  5280 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.650851  2257 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:01:34.625288  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:34.653051  2264 raft_consensus.cc:2393] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 6: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:34.622547  5287 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:01:34.626708  5285 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
W20260709 13:01:34.626111  5289 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:01:34.624002  5279 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.656628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.657953  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:34.659348  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:34.659900  1614 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.631494  5166 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:34.661365  5212 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 2.114s	user 0.000s	sys 0.012s
I20260709 13:01:34.661912  1688 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:34.662788  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:34.663487  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1943) took 1513 ms (client timeout 1891 ms). Trace:
W20260709 13:01:34.663867  1540 rpcz_store.cc:269] 0709 13:01:33.150234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.884626 (+734392us) service_pool.cc:224] Handling call
0709 13:01:34.663340 (+778714us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b540003af54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:34.663433 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39630592}
I20260709 13:01:34.664866  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:34.665236  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:34.637955  5181 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.665848  4935 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.666290  5181 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.667085  5299 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.667582  5299 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.669576  5299 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.647500  5271 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.671712  5271 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:34.522068  5209 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.674152  5209 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:34.650900  5280 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.674511  5237 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:34.674804  5280 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.654788  5168 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:34.677155  5281 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.526s	user 0.000s	sys 0.008s
W20260709 13:01:34.678768  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60646.8us
I20260709 13:01:34.684540  5189 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.581624  4938 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.685386  5176 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:34.685649  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1938) took 2260 ms. Trace:
I20260709 13:01:34.685750  4938 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:34.686090  1544 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10.
I20260709 13:01:34.686250  4938 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.685962  5176 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:34.687512  5176 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.689601  4614 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:34.686314  5234 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:34.690804  1661 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.544s (SENT)
I20260709 13:01:34.690956  5234 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:34.691305  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:34.691900  5234 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.692835  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2397) took 1849 ms. Trace:
I20260709 13:01:34.693234  1541 rpcz_store.cc:276] 0709 13:01:32.844795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.452175 (+1607380us) service_pool.cc:224] Handling call
0709 13:01:34.692648 (+240473us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b540038a254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:34.692779 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93704576}
I20260709 13:01:34.697044  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 579) took 1058 ms. Trace:
I20260709 13:01:34.686128  1543 rpcz_store.cc:276] 0709 13:01:32.424982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.425123 (+   141us) service_pool.cc:224] Handling call
0709 13:01:34.685459 (+2260336us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400021054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:34.685593 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4188181760}
W20260709 13:01:34.628614  5254 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.675s	user 0.006s	sys 0.005s
I20260709 13:01:34.697430  1690 rpcz_store.cc:276] 0709 13:01:33.638391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.869893 (+231502us) service_pool.cc:224] Handling call
0709 13:01:33.955376 (+ 85483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.955659 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:34.244324 (+288665us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.696561 (+452237us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b18003b8480. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a
0709 13:01:34.696735 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:34.696779 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:34.696828 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.696888 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.696991 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":375885,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"spinlock_wait_cycles":9175424,"thread_start_us":419404,"threads_started":2,"wal-append.queue_time_us":238609}
I20260709 13:01:34.699544  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:34.694329  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:34.699805  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 44019.7us
I20260709 13:01:34.702484  1614 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:34.702579  1510 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:34.703763  2258 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:34.669523  5226 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.649358  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:34.731575  1546 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:34.711300  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.733429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:34.733829  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.728971  1538 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:34.735244  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:34.736311  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 87012.2us
I20260709 13:01:34.738267  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:34.740248  5166 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:34.740774  5166 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.741067  5189 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:34.741209  5166 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:34.735720  5250 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:01:34.744254  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.747031  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:34.747133  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2394) took 1923 ms (client timeout 1774 ms). Trace:
W20260709 13:01:34.747603  1544 rpcz_store.cc:269] 0709 13:01:32.790594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.204780 (+414186us) service_pool.cc:224] Handling call
0709 13:01:34.713816 (+1509036us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400046fd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:34.713951 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397219072}
I20260709 13:01:34.747998  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:34.748646  1696 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:34.756204  2266 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:34.756639  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:34.758415  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:34.712445  5209 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:34.731125  5263 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.764565  5180 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:34.714228  5261 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:34.758826  5299 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:34.774053  5168 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:34.747615  5221 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:01:34.773681  5195 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:34.797477  5180 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:34.807488  5299 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.750231  5254 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.865983  5168 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:34.897161  5037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.018s	sys 0.025s
I20260709 13:01:34.915457  5301 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:34.757242  5069 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.902032  5299 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.908170  5168 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:34.911253  5261 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:34.926095  4935 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:34.943921  5166 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.944168  5280 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.946563  5180 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.954421  5180 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.799955  5263 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:34.922444  5037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.019s	sys 0.026s
I20260709 13:01:34.960134  4938 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:34.950525  5261 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:34.975658  5261 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:34.977504  5261 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:34.995880  5254 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:35.086077  5263 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:35.595336  5304 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.003s
W20260709 13:01:35.748802  5299 consensus_meta.cc:287] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.816s	user 0.005s	sys 0.005s
W20260709 13:01:35.749707  5191 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.133s	user 0.003s	sys 0.006s
I20260709 13:01:35.749421  5299 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:35.709977  4999 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.107s	user 0.008s	sys 0.004s
W20260709 13:01:35.799427  5300 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.149s	user 0.013s	sys 0.000s
I20260709 13:01:35.674779  5304 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:35.750232  5191 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:35.923522  5300 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:36.181767  5099 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.580s	user 0.013s	sys 0.000s
I20260709 13:01:36.182334  5099 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:36.184778  5099 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:36.029814  4938 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:36.030030  5280 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:35.612720  5270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.023s	sys 0.028s
W20260709 13:01:36.599936  5318 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:01:36.586651  5270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.608s	user 0.024s	sys 0.028s
I20260709 13:01:36.592347  5304 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:36.644799  5299 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:36.643783  5191 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:36.651304  5168 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.711s	user 0.011s	sys 0.000s
I20260709 13:01:36.651911  5168 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:36.653095  5180 consensus_meta.cc:287] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.698s	user 0.005s	sys 0.003s
I20260709 13:01:36.654197  5168 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:36.655655  5300 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:36.657366  5273 consensus_meta.cc:287] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 2.038s	user 0.010s	sys 0.003s
W20260709 13:01:36.657717  5261 consensus_meta.cc:287] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.680s	user 0.012s	sys 0.000s
I20260709 13:01:36.657765  5273 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:36.661736  5273 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:36.671733  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:36.672824  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 516) took 2007 ms (client timeout 2179 ms). Trace:
W20260709 13:01:36.673185  1541 rpcz_store.cc:269] 0709 13:01:34.664996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.671376 (+2006380us) service_pool.cc:224] Handling call
0709 13:01:36.672758 (+  1382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.674077  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:36.674693  1541 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:36.675084  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 515) took 2010 ms (client timeout 2228 ms). Trace:
W20260709 13:01:36.675352  1541 rpcz_store.cc:269] 0709 13:01:34.664744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.673859 (+2009115us) service_pool.cc:224] Handling call
0709 13:01:36.675043 (+  1184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.675655  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:36.676247  1541 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:36.676468  1547 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:36.676832  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2388) took 3887 ms. Trace:
I20260709 13:01:36.676925  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 511) took 2013 ms. Trace:
I20260709 13:01:36.677147  1541 rpcz_store.cc:276] 0709 13:01:32.788961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.675863 (+3886902us) service_pool.cc:224] Handling call
0709 13:01:36.676071 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.676581 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.676767 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.677341  1547 rpcz_store.cc:276] 0709 13:01:34.663761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.675394 (+2011633us) service_pool.cc:224] Handling call
0709 13:01:36.676871 (+  1477us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.678427  1541 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:36.679549  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2390) took 3890 ms. Trace:
I20260709 13:01:36.679862  1541 rpcz_store.cc:276] 0709 13:01:32.789523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.678104 (+3888581us) service_pool.cc:224] Handling call
0709 13:01:36.678317 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.679327 (+  1010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.679508 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.678743  1547 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:36.682165  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2393) took 3891 ms. Trace:
I20260709 13:01:36.682509  1547 rpcz_store.cc:276] 0709 13:01:32.790321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.678282 (+3887961us) service_pool.cc:224] Handling call
0709 13:01:36.678553 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.681903 (+  3350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.682111 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.683779  1547 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:36.684489  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1950) took 3403 ms. Trace:
I20260709 13:01:36.684844  1547 rpcz_store.cc:276] 0709 13:01:33.281372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.683307 (+3401935us) service_pool.cc:224] Handling call
0709 13:01:36.683591 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.684248 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.684433 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.663403  5251 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.664981  5251 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:37.688637  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 2.92973e+06us
I20260709 13:01:37.689509  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.691183  5320 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:37.691519  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.691639  5320 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.692236  5320 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.696271  1621 raft_consensus.cc:2393] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:37.698556  1621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 629) took 3832 ms (client timeout 1784 ms). Trace:
W20260709 13:01:37.698936  1621 rpcz_store.cc:269] 0709 13:01:33.866549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.867535 (+   986us) service_pool.cc:224] Handling call
0709 13:01:37.698292 (+3830757us) spinlock_profiling.cc:243] Waited 3.83 s on lock 0x7b54002a71d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:37.698450 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8803760384}
I20260709 13:01:37.700505  5320 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.702420  5320 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:37.702973  5320 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:37.703394  5320 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:37.704078  5320 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:37.708678  2260 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 3.061s	user 0.013s	sys 0.024s
I20260709 13:01:37.709237  2260 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
W20260709 13:01:37.709954  2260 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 829) took 3069 ms (client timeout 3173 ms). Trace:
W20260709 13:01:37.710386  2260 rpcz_store.cc:269] 0709 13:01:34.640815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.646008 (+  5193us) service_pool.cc:224] Handling call
0709 13:01:37.709840 (+3063832us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.718360  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.719000  2230 connection.cc:256] RPC call timeout handler was delayed by -2.2444918630000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:01:37.719595  2230 connection.cc:256] RPC call timeout handler was delayed by -2.0406413559999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:01:37.730679  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.731176  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.731492  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.732046  5251 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.732553  5251 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:37.734272  5251 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:37.735260  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.735944  5251 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.736618  5323 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.736404  5251 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.737071  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:37.737658  2264 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:37.738118  2264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 575) took 3033 ms (client timeout 2104 ms). Trace:
I20260709 13:01:37.738582  5251 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:37.739188  5251 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.739885  5251 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:37.741916  5251 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:37.742460  5323 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.743427  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.744185  1689 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:37.744596  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2329) took 3047 ms (client timeout 1544 ms). Trace:
I20260709 13:01:37.744657  5323 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:37.744982  1689 rpcz_store.cc:269] 0709 13:01:34.697571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.758016 (+ 60445us) service_pool.cc:224] Handling call
0709 13:01:37.744529 (+2986513us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.745806  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2324) took 3052 ms (client timeout 1971 ms). Trace:
W20260709 13:01:37.746003  1689 rpcz_store.cc:269] 0709 13:01:34.693580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.745659 (+3052079us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.745752 (+    93us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.738435  2264 rpcz_store.cc:269] 0709 13:01:34.704318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.704408 (+    90us) service_pool.cc:224] Handling call
0709 13:01:37.738046 (+3033638us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.746492  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2328) took 3051 ms (client timeout 1978 ms). Trace:
W20260709 13:01:37.747808  1689 rpcz_store.cc:269] 0709 13:01:34.697247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.746366 (+3049119us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.746440 (+    74us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.748608  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2331) took 3050 ms (client timeout 2051 ms). Trace:
W20260709 13:01:37.748934  1689 rpcz_store.cc:269] 0709 13:01:34.698118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.748449 (+3050331us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.748556 (+   107us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.749445  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2332) took 3051 ms (client timeout 2058 ms). Trace:
W20260709 13:01:37.749629  1689 rpcz_store.cc:269] 0709 13:01:34.698380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.749349 (+3050969us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.749414 (+    65us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.750100  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2318) took 3170 ms (client timeout 2180 ms). Trace:
W20260709 13:01:37.750294  1689 rpcz_store.cc:269] 0709 13:01:34.580254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.749983 (+3169729us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.750047 (+    64us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.751108  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2333) took 3052 ms (client timeout 2247 ms). Trace:
W20260709 13:01:37.751442  1689 rpcz_store.cc:269] 0709 13:01:34.698689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.750910 (+3052221us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.751024 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.752179  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2325) took 3058 ms (client timeout 2622 ms). Trace:
W20260709 13:01:37.752511  1689 rpcz_store.cc:269] 0709 13:01:34.693846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.752018 (+3058172us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.752127 (+   109us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.753239  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2316) took 3247 ms (client timeout 2827 ms). Trace:
W20260709 13:01:37.753584  1689 rpcz_store.cc:269] 0709 13:01:34.505738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.753111 (+3247373us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.753198 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:37.754326  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 566) took 3342 ms (client timeout 2176 ms). Trace:
W20260709 13:01:37.754859  2258 rpcz_store.cc:269] 0709 13:01:34.412210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.412345 (+   135us) service_pool.cc:224] Handling call
0709 13:01:37.754064 (+3341719us) spinlock_profiling.cc:243] Waited 87.6 ms on lock 0x7b54005d11d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:37.754232 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201430912}
I20260709 13:01:37.755110  5324 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.755748  5324 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.756440  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:37.757087  1621 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:37.758172  5324 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:37.754330  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2319) took 3139 ms (client timeout 3005 ms). Trace:
W20260709 13:01:37.759352  1689 rpcz_store.cc:269] 0709 13:01:34.615204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.754199 (+3138995us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.754287 (+    88us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:37.760744  1687 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:37.760684  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:37.761297  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2330) took 3063 ms (client timeout 1655 ms). Trace:
I20260709 13:01:37.761716  1689 raft_consensus.cc:2368] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
W20260709 13:01:37.761643  1687 rpcz_store.cc:269] 0709 13:01:34.697845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.758190 (+ 60345us) service_pool.cc:224] Handling call
0709 13:01:37.761234 (+3003044us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.762496  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2326) took 3068 ms (client timeout 3150 ms). Trace:
I20260709 13:01:37.762873  1687 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:37.762995  1689 rpcz_store.cc:269] 0709 13:01:34.694140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.759951 (+3065811us) service_pool.cc:224] Handling call
0709 13:01:37.762402 (+  2451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.763535  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1701) took 3389 ms. Trace:
I20260709 13:01:37.763890  1687 rpcz_store.cc:276] 0709 13:01:34.374556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.762432 (+3387876us) service_pool.cc:224] Handling call
0709 13:01:37.762717 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.763325 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.763488 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.765321  1545 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:37.766721  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:37.767678  1616 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:37.775991  2262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.104s	user 0.024s	sys 0.043s
W20260709 13:01:37.777221  2262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.105s	user 0.026s	sys 0.044s
I20260709 13:01:37.777469  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:37.777750  5321 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:37.778294  5321 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.780992  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.782090  5257 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:37.782522  5257 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.782914  5257 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:37.783388  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1702) took 3392 ms. Trace:
I20260709 13:01:37.783761  1689 rpcz_store.cc:276] 0709 13:01:34.391162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.763847 (+3372685us) service_pool.cc:224] Handling call
0709 13:01:37.764135 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.773734 (+  9599us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:37.773761 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:37.774212 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.783068 (+  8856us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:37.783107 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.783165 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.783201 (+    36us) raft_consensus.cc:1685] finished
0709 13:01:37.783211 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.783335 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":17695,"threads_started":2,"wal-append.queue_time_us":6857}
I20260709 13:01:37.787189  2262 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 831) took 3120 ms. Trace:
I20260709 13:01:37.788512  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:37.789376  1616 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:37.791386  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.793011  5320 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:37.793503  5320 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:37.788491  5321 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:37.794390  5320 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.794747  5257 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.789050  2262 rpcz_store.cc:276] 0709 13:01:34.666746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.670750 (+  4004us) service_pool.cc:224] Handling call
0709 13:01:34.671075 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.671284 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.671308 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.671778 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:01:37.777587 (+3105809us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:37.777627 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.786889 (+  9262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.786933 (+    44us) raft_consensus.cc:1685] finished
0709 13:01:37.786965 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.787109 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":3105430,"threads_started":1,"wal-append.queue_time_us":276546,"wal-append.run_cpu_time_us":1796,"wal-append.run_wall_time_us":1001823}
I20260709 13:01:37.798058  5257 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:37.802930  1616 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:37.808413  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:37.809082  1614 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:37.812292  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.813097  1694 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:37.813889  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2321) took 3120 ms (client timeout 1832 ms). Trace:
W20260709 13:01:37.814268  1694 rpcz_store.cc:269] 0709 13:01:34.692688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.734940 (+ 42252us) service_pool.cc:224] Handling call
0709 13:01:37.813481 (+3078541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.815033  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 500) took 5236 ms. Trace:
I20260709 13:01:37.808781  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.816118  5248 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:37.815443  1539 rpcz_store.cc:276] 0709 13:01:32.578970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.483979 (+1905009us) service_pool.cc:224] Handling call
0709 13:01:34.484315 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.513132 (+ 28817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.513187 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.522684 (+  9497us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.726191 (+203507us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:34.726231 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.726299 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:37.814823 (+3088524us) raft_consensus.cc:1685] finished
0709 13:01:37.814843 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.814975 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21913,"raft.queue_time_us":28363,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3347,"thread_start_us":156250,"threads_started":1,"wal-append.queue_time_us":366211,"wal-append.run_cpu_time_us":2548,"wal-append.run_wall_time_us":1073634}
I20260709 13:01:37.816746  1614 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:37.815251  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.818221  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.816684  5248 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:37.819149  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 510) took 3243 ms (client timeout 2292 ms). Trace:
I20260709 13:01:37.819254  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:37.819588  1544 rpcz_store.cc:269] 0709 13:01:34.576055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.818967 (+3242912us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:37.819079 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:37.819486  5248 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.820397  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.820945  1694 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:37.821134  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1953) took 4333 ms. Trace:
I20260709 13:01:37.821529  1544 rpcz_store.cc:276] 0709 13:01:33.487909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.820382 (+4332473us) service_pool.cc:224] Handling call
0709 13:01:37.820670 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.820827 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:37.820860 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:37.820899 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:37.820935 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.820984 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:37.821073 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.823566  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:37.824200  1539 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:01:37.824695  5257 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:37.825212  5257 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:37.825479  1544 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:37.826077  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1954) took 4237 ms. Trace:
I20260709 13:01:37.826481  1544 rpcz_store.cc:276] 0709 13:01:33.589301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.822430 (+4233129us) service_pool.cc:224] Handling call
0709 13:01:37.822750 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.825826 (+  3076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.826024 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.827989  1544 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:37.828668  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 507) took 3255 ms. Trace:
I20260709 13:01:37.829032  1544 rpcz_store.cc:276] 0709 13:01:34.573499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.827350 (+3253851us) service_pool.cc:224] Handling call
0709 13:01:37.827745 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.828400 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.828620 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.826144  5257 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:37.830420  1544 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:37.821735  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:37.832094  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.833194  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.833832  1694 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:37.834960  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 509) took 3259 ms. Trace:
I20260709 13:01:37.824895  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1952) took 4412 ms. Trace:
I20260709 13:01:37.842497  1539 rpcz_store.cc:276] 0709 13:01:33.412679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.817269 (+4404590us) service_pool.cc:224] Handling call
0709 13:01:37.823961 (+  6692us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:37.824659 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.824848 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.844442  1661 connection.cc:256] RPC call timeout handler was delayed by -3.0046422749999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:01:37.845036  1661 connection.cc:256] RPC call timeout handler was delayed by -2.9902422750000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:01:37.845510  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.845418  1661 connection.cc:256] RPC call timeout handler was delayed by -2.9866422750000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:01:37.846021  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.743s (SENT) [suppressed 35 similar messages]
I20260709 13:01:37.853344  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:37.853996  1614 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:34.735114  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:37.861274  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 514) took 3196 ms (client timeout 2010 ms). Trace:
W20260709 13:01:37.861768  1538 rpcz_store.cc:269] 0709 13:01:34.664511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.734879 (+ 70368us) service_pool.cc:224] Handling call
0709 13:01:37.861180 (+3126301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.864506  1617 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
W20260709 13:01:37.866066  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 634) took 3593 ms (client timeout 1558 ms). Trace:
W20260709 13:01:37.866427  1617 rpcz_store.cc:269] 0709 13:01:34.273016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.313206 (+ 40190us) service_pool.cc:224] Handling call
0709 13:01:37.865892 (+3552686us) spinlock_profiling.cc:243] Waited 3.42 s on lock 0x7b54004182d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:37.865999 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7867714944}
W20260709 13:01:37.874017  1661 connection.cc:256] RPC call timeout handler was delayed by -2.9515422750000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 13:01:37.874442  1661 connection.cc:256] RPC call timeout handler was delayed by -2.8561422750000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:01:37.874584  5238 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:37.882997  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.886582  5166 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:37.889930  1614 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:37.892340  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:37.893148  1618 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:38.161033  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.231215  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.245641  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.246410  1613 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:38.253891  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:38.255203  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 508) took 3679 ms (client timeout 2041 ms). Trace:
W20260709 13:01:38.256292  1543 rpcz_store.cc:269] 0709 13:01:34.575417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.730977 (+155560us) service_pool.cc:224] Handling call
0709 13:01:38.255107 (+3524130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.260883  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2385) took 5472 ms. Trace:
I20260709 13:01:38.263959  1546 rpcz_store.cc:276] 0709 13:01:32.788135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.563147 (+1775012us) service_pool.cc:224] Handling call
0709 13:01:34.711697 (+148550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.732260 (+ 20563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.260579 (+3528319us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540003af50. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:38.260801 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253756160}
I20260709 13:01:37.871131  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:38.265734  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 505) took 3692 ms (client timeout 2094 ms). Trace:
I20260709 13:01:38.266201  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:37.835479  1544 rpcz_store.cc:276] 0709 13:01:34.575756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.829872 (+3254116us) service_pool.cc:224] Handling call
0709 13:01:37.830212 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:37.830782 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.834894 (+  4112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.266906  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.269666  1618 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:38.277750  5226 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.279232  1613 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:38.280066  1540 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:38.312145  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1698) took 3993 ms. Trace:
W20260709 13:01:38.312878  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 512) took 3648 ms (client timeout 1609 ms). Trace:
W20260709 13:01:38.313274  1540 rpcz_store.cc:269] 0709 13:01:34.664021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.664633 (+   612us) service_pool.cc:224] Handling call
0709 13:01:38.312712 (+3648079us) spinlock_profiling.cc:243] Waited 3.61 s on lock 0x7b54000532d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:38.312822 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8313641728}
I20260709 13:01:38.283933  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:38.266396  1542 rpcz_store.cc:269] 0709 13:01:34.572901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.265468 (+3692567us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.265652 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:01:38.290066  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.314538  1694 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
W20260709 13:01:38.291285  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 419525us
I20260709 13:01:38.315774  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.317188  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.317283  5166 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:38.317848  5166 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.318197  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.318771  1613 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
W20260709 13:01:38.317852  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.320245  5166 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.321727  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.322327  2230 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.322455  1694 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:38.323089  5257 raft_consensus.cc:2804] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:38.323617  5257 raft_consensus.cc:697] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:38.324014  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.325006  1694 raft_consensus.cc:2410] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:38.324496  5257 consensus_queue.cc:237] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.329730  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:38.326362  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2315) took 3886 ms (client timeout 2209 ms). Trace:
W20260709 13:01:38.335909  1688 rpcz_store.cc:269] 0709 13:01:34.439619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.314448 (+3874829us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:38.326282 (+ 11834us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:38.336686  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.312777  1691 rpcz_store.cc:276] 0709 13:01:34.318367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.318488 (+   121us) service_pool.cc:224] Handling call
0709 13:01:34.318834 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.319195 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.319220 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.319691 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:01:34.607334 (+287643us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:34.607371 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.607445 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.311780 (+3704335us) raft_consensus.cc:1685] finished
0709 13:01:38.311816 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.312030 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7257,"raft.queue_time_us":795,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8708,"thread_start_us":228842,"threads_started":1,"wal-append.queue_time_us":459779,"wal-append.run_cpu_time_us":3734,"wal-append.run_wall_time_us":1137186}
I20260709 13:01:38.335916  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.337935  1687 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:38.338163  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.327868  2262 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.325526  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.333356  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.339267  1691 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:01:38.339533  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.339653  1689 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:38.332135  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.340081  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.340517  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.340731  1687 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:38.341168  1689 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:38.341709  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.341856  5326 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.342054  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.336833  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.340529  1694 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:38.342365  5326 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.342937  1688 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.340107  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.344163  1691 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
W20260709 13:01:38.346352  1545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2403) took 5365 ms (client timeout 2432 ms). Trace:
W20260709 13:01:38.346868  1545 rpcz_store.cc:269] 0709 13:01:32.980820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.374475 (+1393655us) service_pool.cc:224] Handling call
0709 13:01:38.346179 (+3971704us) spinlock_profiling.cc:243] Waited 3.32 s on lock 0x7b5400257954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:38.346281 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7632211328}
I20260709 13:01:38.347723  5166 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.348286  5166 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:38.349143  5166 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.349997  1694 raft_consensus.cc:2410] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:38.351480  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1706) took 3787 ms. Trace:
I20260709 13:01:38.351734  5326 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:38.352078  2259 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:38.351831  1694 rpcz_store.cc:276] 0709 13:01:34.563720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.350574 (+3786854us) service_pool.cc:224] Handling call
0709 13:01:38.351018 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.351180 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.351206 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.351244 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:38.351277 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.351331 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.351424 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.352442  5326 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:38.339978  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.353423  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.354290  5324 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:38.354847  5324 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.356168  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.356943  5226 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:38.357060  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.357472  5226 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:38.357956  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.358464  5226 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.359297  1696 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:38.362373  1688 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:38.357247  5324 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:38.371665  5324 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:38.372165  5324 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.373690  5337 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:38.374233  5324 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.374821  5337 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:38.375247  5337 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:38.367080  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.346354  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1705) took 3879 ms. Trace:
I20260709 13:01:38.363059  5248 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:38.376256  5248 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:38.376672  5248 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.365736  1613 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:38.383525  1687 rpcz_store.cc:276] 0709 13:01:34.466840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.345646 (+3878806us) service_pool.cc:224] Handling call
0709 13:01:38.345889 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.346048 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.346073 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.346114 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:38.346149 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.346195 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.346277 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.388587  5248 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.391320  5248 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.392447  5116 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:38.392926  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.393267  5116 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:38.393632  1614 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:34.755295  1693 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:38.396185  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2322) took 3703 ms (client timeout 1774 ms). Trace:
W20260709 13:01:38.396642  1693 rpcz_store.cc:269] 0709 13:01:34.692992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.733619 (+ 40627us) service_pool.cc:224] Handling call
0709 13:01:38.396098 (+3662479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:38.422205  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.431826  1617 pending_rounds.cc:85] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:01:38.432700  1617 pending_rounds.cc:107] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:38.433084  1617 raft_consensus.cc:2889] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.353204  5326 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.453810  2262 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:38.461222  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 573) took 3757 ms. Trace:
I20260709 13:01:38.461884  1614 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:38.461717  2261 rpcz_store.cc:276] 0709 13:01:34.703702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.704706 (+  1004us) service_pool.cc:224] Handling call
0709 13:01:34.705088 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:34.731589 (+ 26501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.731630 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:34.732206 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:01:38.452476 (+3720270us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:38.452512 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.452576 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.460938 (+  8362us) raft_consensus.cc:1685] finished
0709 13:01:38.460965 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.461155 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":36583,"thread_start_us":127517,"threads_started":1,"wal-append.queue_time_us":3673634}
I20260709 13:01:38.463268  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.466136  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.467247  1690 raft_consensus.cc:2410] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:01:38.467677  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2327) took 3773 ms (client timeout 1842 ms). Trace:
W20260709 13:01:38.468017  1690 rpcz_store.cc:269] 0709 13:01:34.694443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.748921 (+ 54478us) service_pool.cc:224] Handling call
0709 13:01:38.467604 (+3718683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:38.466136  2261 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:38.463114  5343 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.465545  5342 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.470095  5343 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.472523  5343 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.470839  5342 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.473420  5343 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:38.473912  5343 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.475970  5166 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:38.476231  5326 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:38.476622  5166 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:38.476799  5326 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:38.477336  5343 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.477650  5326 consensus_queue.cc:1243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:38.478132  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:38.477806  5166 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.461519  5349 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.455199  5337 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.478991  5349 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.479796  5337 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:38.481614  2261 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:38.481222  5349 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:38.482988  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 572) took 3779 ms. Trace:
I20260709 13:01:38.483150  1659 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.457522  5324 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:38.484686  5324 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.484772  5342 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:38.486831  5324 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.487540  5313 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.488087  5313 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:38.485970  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 3.78651e+06us
I20260709 13:01:38.490397  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:38.483352  5349 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:38.483390  2259 rpcz_store.cc:276] 0709 13:01:34.703382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.703533 (+   151us) service_pool.cc:224] Handling call
0709 13:01:34.757461 (+ 53928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.352550 (+3595089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.482734 (+130184us) spinlock_profiling.cc:243] Waited 3.59 s on lock 0x7b54006af754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:38.482930 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8266963200}
I20260709 13:01:38.502970  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 513) took 3838 ms. Trace:
I20260709 13:01:38.503857  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:38.503383  1539 rpcz_store.cc:276] 0709 13:01:34.664264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.843462 (+3179198us) service_pool.cc:224] Handling call
0709 13:01:37.843761 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:37.843949 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:37.873491 (+ 29542us) log.cc:844] Serialized 14 byte log entry
0709 13:01:38.502609 (+629118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:38.502681 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:38.502725 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.502790 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.502912 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":613941,"prepare.queue_time_us":27868,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":43541,"threads_started":2,"wal-append.queue_time_us":13931}
I20260709 13:01:38.486867  5342 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:38.501901  5349 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:38.488940  5350 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.501068  5313 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.509317  5342 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:38.523075  5342 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.478412  5326 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:38.536229  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1951) took 5126 ms. Trace:
I20260709 13:01:38.539134  1547 rpcz_store.cc:276] 0709 13:01:33.410082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.686125 (+3276043us) service_pool.cc:224] Handling call
0709 13:01:36.686481 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:38.488892 (+1802411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.488920 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:38.492072 (+  3152us) log.cc:844] Serialized 26 byte log entry
0709 13:01:38.533945 (+ 41873us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:38.533989 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.534090 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.535978 (+  1888us) raft_consensus.cc:1685] finished
0709 13:01:38.535998 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.536160 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1802019,"thread_start_us":14849,"threads_started":1,"wal-append.queue_time_us":24899}
I20260709 13:01:38.536289  5354 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.572494  2259 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.532080  5350 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:38.573935  2261 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.574798  5350 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:38.558146  5349 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.576306  5349 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.576386  5350 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:38.577148  5350 consensus_queue.cc:1243] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:38.577610  5350 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:38.578719  5354 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:38.581900  5354 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:38.578590  5350 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:38.586649  5350 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:38.587533  5350 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.579483  5337 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:38.588061  5342 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.598973  5350 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:38.604344  1661 connection.cc:256] RPC call timeout handler was delayed by -2.2036422749999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2781s for a response
W20260709 13:01:38.604902  1661 connection.cc:256] RPC call timeout handler was delayed by -1.8440706680000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:01:38.605252  1661 connection.cc:256] RPC call timeout handler was delayed by -1.7844154239999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:01:38.605593  1661 connection.cc:256] RPC call timeout handler was delayed by -1.4867706680000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:01:38.607882  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.605352  5362 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.589699  5337 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:38.613559  1661 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.891s (SENT)
W20260709 13:01:38.616511  1661 leader_election.cc:336] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.907s (SENT)
I20260709 13:01:38.616931  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:38.617219  1661 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.907s (SENT)
W20260709 13:01:38.617892  1661 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.911s (SENT)
W20260709 13:01:38.618770  1661 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.950s (SENT)
W20260709 13:01:38.619429  1661 leader_election.cc:336] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.056s (SENT)
I20260709 13:01:38.620191  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.620273  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.620981  1613 raft_consensus.cc:2368] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:38.621162  1614 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:38.621068  2231 connection.cc:256] RPC call timeout handler was delayed by -3.2317047390000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:01:38.621852  2231 connection.cc:256] RPC call timeout handler was delayed by -2.9132376550000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3663s for a response
W20260709 13:01:38.622265  2231 connection.cc:256] RPC call timeout handler was delayed by -2.6656892780000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:01:38.622651  2231 connection.cc:256] RPC call timeout handler was delayed by -2.6656892780000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
W20260709 13:01:38.622941  2231 connection.cc:256] RPC call timeout handler was delayed by -2.6494892780000328s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:01:38.623229  2231 connection.cc:256] RPC call timeout handler was delayed by -2.5333892780000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
W20260709 13:01:38.623498  2231 connection.cc:256] RPC call timeout handler was delayed by -2.5191900440000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:01:38.623764  2231 connection.cc:256] RPC call timeout handler was delayed by -2.5191900440000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:01:38.624037  2231 connection.cc:256] RPC call timeout handler was delayed by -2.5016607320000048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:01:38.624353  2231 connection.cc:256] RPC call timeout handler was delayed by -2.4955892780000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 13:01:38.624069  5337 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:38.624691  2231 connection.cc:256] RPC call timeout handler was delayed by -2.4768900440000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 13:01:38.625047  2231 connection.cc:256] RPC call timeout handler was delayed by -2.4460892780000449s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:01:38.625337  2231 connection.cc:256] RPC call timeout handler was delayed by -2.435490044000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 13:01:38.625409  5337 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:38.625659  2231 connection.cc:256] RPC call timeout handler was delayed by -2.3155892780000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:01:38.626001  2231 connection.cc:256] RPC call timeout handler was delayed by -2.214789278000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 13:01:38.626271  2231 connection.cc:256] RPC call timeout handler was delayed by -2.1670892780000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:01:38.626544  2231 connection.cc:256] RPC call timeout handler was delayed by -2.1670892780000486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2094s for a response
W20260709 13:01:38.626827  2231 connection.cc:256] RPC call timeout handler was delayed by -2.1582900440000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:01:38.627106  2231 connection.cc:256] RPC call timeout handler was delayed by -2.1582900440000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 13:01:38.627350  2231 connection.cc:256] RPC call timeout handler was delayed by -2.00619004400005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:01:38.627604  2231 connection.cc:256] RPC call timeout handler was delayed by -2.00619004400005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:01:38.627846  2231 connection.cc:256] RPC call timeout handler was delayed by -1.9888892780000447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2292s for a response
I20260709 13:01:38.628095  5342 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:38.624096  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2400) took 5736 ms. Trace:
W20260709 13:01:38.632669  1661 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 3.070s (SENT)
I20260709 13:01:38.633234  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:38.633839  2259 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.635272  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.635859  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:38.628096  2231 connection.cc:256] RPC call timeout handler was delayed by -1.9620900440000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:01:38.636485  1688 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:38.636451  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.636845  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.637215  1687 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.638100  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:38.636451  2231 connection.cc:256] RPC call timeout handler was delayed by -1.4310900440000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2818s for a response
W20260709 13:01:38.639048  2231 connection.cc:256] RPC call timeout handler was delayed by -1.4310900440000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2818s for a response
I20260709 13:01:38.631258  1541 rpcz_store.cc:276] 0709 13:01:32.887923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.680431 (+3792508us) service_pool.cc:224] Handling call
0709 13:01:36.680667 (+   236us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:38.487634 (+1806967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:38.487669 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:38.488332 (+   663us) log.cc:844] Serialized 78 byte log entry
0709 13:01:38.551627 (+ 63295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:38.551682 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:38.551784 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:38.623886 (+ 72102us) raft_consensus.cc:1685] finished
0709 13:01:38.623905 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:38.624040 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1804701,"thread_start_us":62811,"threads_started":1,"wal-append.queue_time_us":102346}
I20260709 13:01:38.644207  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.647166  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.647513  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.648032  1618 raft_consensus.cc:2410] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:38.648335  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:38.648929  1696 raft_consensus.cc:606] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:38.650352  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.650892  1696 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:38.653800  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:38.657802  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.660373  2259 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:38.661609  1659 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.661552  1688 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:38.671412  2259 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:38.664609  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.674388  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.677739  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.678865  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.679452  1616 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:38.680950  1687 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:38.681982  1696 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:38.682863  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.683910  1696 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.615242  5362 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.686740  5362 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:38.687453  2259 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:38.687714  1693 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:38.690549  1616 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:01:38.690958  1616 pending_rounds.cc:85] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:01:38.691186  1616 pending_rounds.cc:107] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:01:38.691395  1616 raft_consensus.cc:2889] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.691543  1619 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:38.691689  1616 pending_rounds.cc:107] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:01:38.691988  1616 raft_consensus.cc:2889] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.692539  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.693265  1619 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:38.693787  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.693850  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.694198  5226 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.694864  1622 raft_consensus.cc:2410] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:01:38.694731  5226 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.695670  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.696482  1622 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:01:38.695007  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.696846  5226 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:38.697063  1621 raft_consensus.cc:2368] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10.
I20260709 13:01:38.697358  5226 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.693111  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.694020  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.698598  1615 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:38.698632  1616 raft_consensus.cc:2368] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:38.698911  1619 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:38.699515  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.663628  5342 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:38.704519  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:38.705533  2259 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:38.707903  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:38.730340  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.731880  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.732833  1687 raft_consensus.cc:2410] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:38.765045  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.786206  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.831231  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.831916  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.835072  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.842551  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.893149  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.937481  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.967694  1696 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:38.968714  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:38.969750  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.971673  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.972282  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:38.978721  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:38.978912  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:38.979565  1619 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
W20260709 13:01:38.980506  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.983228  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.697808  5226 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:38.989212  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:38.990068  1620 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:38.994071  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.678606  5337 consensus_queue.cc:1059] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.307s
I20260709 13:01:38.981786  5361 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:38.971796  5354 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.996013  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:38.967680  5362 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:38.997041  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 339212us
W20260709 13:01:39.000860  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.002096  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:38.704102  5349 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.291s
I20260709 13:01:38.980772  5342 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:38.998497  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:39.009740  1622 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:39.003012  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:39.004173  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 4.39093e+06us
I20260709 13:01:39.005157  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:39.006387  1696 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:39.005774  1687 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:38.998672  5361 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.031749  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.032140  2259 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:39.005537  5354 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.032362  1621 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:39.033130  1693 raft_consensus.cc:606] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:39.033344  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.033555  1693 raft_consensus.cc:614] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:39.033946  1621 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:39.032166  5361 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.006716  5337 consensus_queue.cc:1243] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:39.017730  5342 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.019016  5370 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:39.035933  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:39.027112  1619 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:39.030143  1617 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:39.039232  2259 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:39.035703  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.031611  5226 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:39.042069  1621 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
W20260709 13:01:39.044442  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.044670  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:39.049943  1620 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:39.050796  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 650) took 1270 ms. Trace:
I20260709 13:01:39.051268  1620 rpcz_store.cc:276] 0709 13:01:37.780486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.967195 (+1186709us) service_pool.cc:224] Handling call
0709 13:01:39.050718 (+ 83523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:39.054021  5326 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:39.054559  5326 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.054968  5326 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.055500  5226 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:39.056021  5226 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:39.056856  5226 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.058561  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.059280  1613 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:39.068244  5337 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:39.069119  5337 consensus_queue.cc:1243] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:39.016634  5349 consensus_queue.cc:1243] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:39.069564  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:39.070281  2259 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9. Re-sending same reply.
I20260709 13:01:39.071604  1659 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:39.080751  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.091373  5296 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:39.091874  5296 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:39.086069  5326 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.117046  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.117765  1619 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:39.034119  5354 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:39.128667  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.117906  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.132123  1617 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
W20260709 13:01:39.134671  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.137436  1622 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:39.007409  5362 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:39.093195  5349 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:39.155584  5350 consensus_meta.cc:287] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
I20260709 13:01:39.153724  5368 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:39.092759  5296 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:39.181855  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 473464us
I20260709 13:01:39.197155  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.195039  5296 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:39.201999  1688 raft_consensus.cc:2410] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:01:39.198196  2263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 561) took 4880 ms (client timeout 3237 ms). Trace:
I20260709 13:01:39.199600  1616 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
W20260709 13:01:39.204493  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.191220  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 188292us
I20260709 13:01:39.208561  5362 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:39.201244  5349 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:39.210033  5349 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.214597  5326 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:39.202589  2263 rpcz_store.cc:269] 0709 13:01:34.317497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.317656 (+   159us) service_pool.cc:224] Handling call
0709 13:01:39.197967 (+4880311us) spinlock_profiling.cc:243] Waited 4.17 s on lock 0x7b54005055d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:39.198106 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9593333120}
I20260709 13:01:39.216701  1617 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:39.218356  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:39.219487  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:39.222054  2261 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:39.224016  1613 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:39.235672  2261 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:39.237068  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:39.239964  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.248777  5362 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:39.256366  5037 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:39.261559  4938 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:39.262012  4938 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.262368  4938 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.266245  1434 maintenance_manager.cc:419] P 6082291f52654c5a8f0456b9ee951915: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033335
I20260709 13:01:39.266654  5362 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:39.272244  5362 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.277194  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1696) took 4984 ms. Trace:
I20260709 13:01:39.278573  5354 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:39.279388  5354 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.277805  1692 rpcz_store.cc:276] 0709 13:01:34.293023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.294428 (+  1405us) service_pool.cc:224] Handling call
0709 13:01:34.654149 (+359721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.654330 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:38.357883 (+3703553us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.272561 (+914678us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.272899 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.273057 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:39.273105 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:39.273157 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:39.273229 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:39.276758 (+  3529us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540040ea50. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:39.277072 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":907911,"prepare.queue_time_us":5438786,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":80,"raft.queue_time_us":27889,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":236,"spinlock_wait_cycles":766829312,"thread_start_us":101865,"threads_started":1,"wal-append.queue_time_us":151740}
I20260709 13:01:39.278278  4938 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:39.285115  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.285821  5296 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.286414  5296 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.288568  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:39.289229  2263 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:39.291124  4938 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:39.298266  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:39.269068  2261 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:01:39.270538  5352 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:39.298452  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:39.300101  5352 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:39.301170  5326 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:39.301026  5352 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.301635  5326 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:39.302093  5326 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:39.303655  1620 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:39.251403  5361 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.304626  5342 consensus_queue.cc:1059] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:39.305397  5342 consensus_queue.cc:1243] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:39.305867  5361 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:39.307174  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:39.307646  5069 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:39.307832  2261 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:39.308387  5069 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:39.309592  5069 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:39.302417  5352 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:39.365227  5344 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.838s	user 0.013s	sys 0.000s
I20260709 13:01:39.327195  5354 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:40.016501  5362 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.092s	sys 0.133s
W20260709 13:01:40.031631  5362 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.093s	sys 0.134s
W20260709 13:01:40.327711  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080038dfc0 after lost signal to thread 431
W20260709 13:01:40.365942  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080038de40 after lost signal to thread 434
W20260709 13:01:41.330977  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.332904  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.333638  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.351519  1585 connection.cc:256] RPC call timeout handler was delayed by -1.4374349200000438s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 13:01:41.352234  1585 connection.cc:256] RPC call timeout handler was delayed by -1.3447349200000644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:01:41.351964  5392 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.354213  5392 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.358666  5392 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:41.389794  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.390399  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.390811  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.391415  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.431618  1660 connection.cc:256] RPC call timeout handler was delayed by -2.1124998829999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:01:41.433125  1660 connection.cc:256] RPC call timeout handler was delayed by -2.0674998829999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:01:41.433743  1660 connection.cc:256] RPC call timeout handler was delayed by -2.0611998830000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:01:41.434202  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.434916  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.435571  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.435671  1660 connection.cc:256] RPC call timeout handler was delayed by -1.9639998829999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 13:01:41.435986  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.436152  1660 connection.cc:256] RPC call timeout handler was delayed by -1.9351998829999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:01:41.436517  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.436702  1660 connection.cc:256] RPC call timeout handler was delayed by -1.927999882999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:01:41.437175  1660 connection.cc:256] RPC call timeout handler was delayed by -1.9135998830000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:01:41.437538  1660 connection.cc:256] RPC call timeout handler was delayed by -1.8748998830000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 13:01:41.444969  5393 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.446321  5393 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:41.448251  1660 connection.cc:256] RPC call timeout handler was delayed by -1.8271998829999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:01:41.448834  1660 connection.cc:256] RPC call timeout handler was delayed by -1.7938998829999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:01:41.449220  1660 connection.cc:256] RPC call timeout handler was delayed by -1.7794998830000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:01:41.449851  1660 connection.cc:256] RPC call timeout handler was delayed by -1.7083998830000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
I20260709 13:01:41.453380  5393 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.454190  5393 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.455155  5393 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.458403  5395 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.459568  5396 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.459481  5395 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.460384  5393 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.460513  5396 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.461063  5393 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.462297  5393 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.464440  5395 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.467383  5395 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.468489  5395 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.468869  5396 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.470250  5396 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.471493  5395 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.472247  5397 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.471058  5396 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:41.473155  5397 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.474606  5396 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:41.479892  5397 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:41.482113  5326 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 2.179s	user 0.020s	sys 0.032s
I20260709 13:01:41.482760  5326 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.486670  5326 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.469245  5393 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:41.469709  1660 connection.cc:256] RPC call timeout handler was delayed by -1.3165328169999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:01:41.490990  1660 connection.cc:256] RPC call timeout handler was delayed by -1.3015998829999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25870000000000004s for a response
W20260709 13:01:41.491387  1660 connection.cc:256] RPC call timeout handler was delayed by -1.0792998830000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28340000000000004s for a response
W20260709 13:01:41.492970  1695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.221s	user 0.028s	sys 0.029s
W20260709 13:01:41.493664  1695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.221s	user 0.028s	sys 0.029s
I20260709 13:01:41.495445  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1697) took 7202 ms. Trace:
I20260709 13:01:41.496022  1695 rpcz_store.cc:276] 0709 13:01:34.293392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.293531 (+   139us) service_pool.cc:224] Handling call
0709 13:01:34.293819 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.294028 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:34.509025 (+214997us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.272002 (+4762977us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.494571 (+2222569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.494720 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:41.494871 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.495002 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.495287 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4537451,"prepare.queue_time_us":4684576,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":5830,"raft.queue_time_us":14152,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16242,"thread_start_us":2631108,"threads_started":3,"wal-append.queue_time_us":495571,"wal-append.run_cpu_time_us":3210,"wal-append.run_wall_time_us":2227326}
I20260709 13:01:39.318604  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:41.539259  5166 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:41.539875  5166 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.540236  5166 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.541833  5279 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.542649  5279 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:41.546717  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 2.23527e+06us
I20260709 13:01:41.546754  5279 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:41.568301  1694 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.293s	user 0.000s	sys 0.029s
W20260709 13:01:41.569054  1694 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.294s	user 0.001s	sys 0.030s
I20260709 13:01:39.289215  5296 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:41.582764  2261 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 2.274s	user 0.018s	sys 0.025s
I20260709 13:01:41.583253  2261 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
W20260709 13:01:41.583951  2261 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 850) took 2277 ms (client timeout 1956 ms). Trace:
W20260709 13:01:41.584148  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc8e0 after lost signal to thread 434
W20260709 13:01:41.586503  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6320 after lost signal to thread 1479
W20260709 13:01:41.588104  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6ec0 after lost signal to thread 1571
W20260709 13:01:41.588397  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6f40 after lost signal to thread 1572
W20260709 13:01:41.584355  2261 rpcz_store.cc:269] 0709 13:01:39.306721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.306885 (+   164us) service_pool.cc:224] Handling call
0709 13:01:41.583796 (+2276911us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:41.594143  1587 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.583s	user 0.011s	sys 0.036s
W20260709 13:01:41.589825  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec020 after lost signal to thread 1646
W20260709 13:01:41.611748  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002bf060 after lost signal to thread 1647
W20260709 13:01:41.610790  1587 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.600s	user 0.011s	sys 0.040s
W20260709 13:01:41.615334  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 2.60445e+06us
I20260709 13:01:41.623040  5392 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.623883  5392 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.628504  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.629735  1618 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:41.631788  1613 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:41.632838  5166 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.633742  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:41.631946  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8d40 after lost signal to thread 1720
I20260709 13:01:41.635010  5279 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:41.635522  5279 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.635208  5370 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:41.635998  5279 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.636181  5370 consensus_queue.cc:1243] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:41.636515  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2940 after lost signal to thread 2290
W20260709 13:01:41.636807  2287 debug-util.cc:398] Leaking SignalData structure 0x7b080036f160 after lost signal to thread 2291
W20260709 13:01:41.637173  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08003863c0 after lost signal to thread 4935
I20260709 13:01:41.638799  5393 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.640200  5393 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.638686  5392 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.644189  5393 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:41.650919  1613 pending_rounds.cc:85] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 8
I20260709 13:01:41.651391  1613 pending_rounds.cc:107] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:01:41.651746  1613 raft_consensus.cc:2889] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:41.651000  5338 raft_consensus.cc:3055] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:41.654317  5338 raft_consensus.cc:740] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:41.655912  1620 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:41.655823  5338 consensus_queue.cc:260] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.657111  5338 raft_consensus.cc:3060] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.658670  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:41.662145  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.670677  1622 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:01:41.671794  1691 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.399s	user 0.011s	sys 0.044s
W20260709 13:01:41.672749  1691 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.400s	user 0.011s	sys 0.044s
I20260709 13:01:41.658313  5166 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:41.672535  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 661) took 2459 ms. Trace:
I20260709 13:01:41.661715  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.660022  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1708) took 3025 ms. Trace:
I20260709 13:01:41.677994  1622 rpcz_store.cc:276] 0709 13:01:39.213221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.665026 (+2451805us) service_pool.cc:224] Handling call
0709 13:01:41.665993 (+   967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.671843 (+  5850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.672373 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:41.686685  2263 raft_consensus.cc:1240] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:01:41.686762  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1868) took 2622 ms (client timeout 2490 ms). Trace:
W20260709 13:01:41.694523  1614 rpcz_store.cc:269] 0709 13:01:39.062509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.681708 (+2619199us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:41.684849 (+  3141us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:41.706485  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:41.707587  1620 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:01:41.710264  2231 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.501s	user 0.020s	sys 0.035s
W20260709 13:01:41.710983  2231 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.502s	user 0.023s	sys 0.035s
I20260709 13:01:41.711745  1695 raft_consensus.cc:2368] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
W20260709 13:01:41.715366  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.411s	user 0.000s	sys 0.065s
W20260709 13:01:41.716626  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.441s	user 0.000s	sys 0.065s
W20260709 13:01:41.716799  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 2.50821e+06us
I20260709 13:01:41.719663  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.725194  5296 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:41.726585  5370 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:41.727129  5370 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:41.726706  1433 maintenance_manager.cc:643] P 6082291f52654c5a8f0456b9ee951915: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.370s	user 0.155s	sys 0.048s Metrics: {"bytes_written":29296,"cfile_init":1,"dirs.queue_time_us":9507,"dirs.run_cpu_time_us":471,"dirs.run_wall_time_us":1082,"drs_written":1,"lbm_read_time_us":390,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5375,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":63,"thread_start_us":16456,"threads_started":2,"wal-append.queue_time_us":7095}
I20260709 13:01:41.728279  5370 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.730157  5370 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.730746  1434 maintenance_manager.cc:419] P 6082291f52654c5a8f0456b9ee951915: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9523 bytes on disk
I20260709 13:01:41.731891  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43144 (request call id 31) took 3065 ms. Trace:
I20260709 13:01:41.732116  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.732586  1693 rpcz_store.cc:276] 0709 13:01:38.666503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.004989 (+338486us) service_pool.cc:224] Handling call
0709 13:01:41.731373 (+2726384us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b540031ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d4853 00007f7f1f8a260a 00007f7f18e287d4 00007f7f18e28762 00007f7f18e28691 00007f7f18e2860c 00007f7f18e278c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:41.731572 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49392000}
I20260709 13:01:41.734037  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:41.735286  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 597) took 3083 ms (client timeout 1675 ms). Trace:
I20260709 13:01:41.735893  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:41.735745  1688 rpcz_store.cc:269] 0709 13:01:38.651677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.674097 (+ 22420us) service_pool.cc:224] Handling call
0709 13:01:41.734839 (+3060742us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54003660d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:41.735062 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208440576}
I20260709 13:01:41.729882  5166 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:41.739526  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.740401  2262 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:41.740242  5279 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:41.741904  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.742745  5279 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:41.735131  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.735225  2258 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:41.747042  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.747848  1620 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:41.749826  1619 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:41.747864  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:41.752079  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:41.753482  1433 maintenance_manager.cc:643] P 6082291f52654c5a8f0456b9ee951915: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":386,"lbm_reads_lt_1ms":4}
I20260709 13:01:41.755373  5360 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:41.755892  5360 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:41.756139  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:41.751718  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:41.757280  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67630us
I20260709 13:01:41.757627  1617 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:41.757243  5360 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.759856  5360 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.760257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:41.760870  1616 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:41.683497  1694 rpcz_store.cc:276] 0709 13:01:38.634509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.634684 (+   175us) service_pool.cc:224] Handling call
0709 13:01:38.635041 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.635265 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:41.569579 (+2934314us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.648445 (+ 78866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.659015 (+ 10570us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:41.659213 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.659450 (+   237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.659827 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":645433,"prepare.queue_time_us":641414,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":9639,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":1550,"thread_start_us":2362899,"threads_started":2,"wal-append.queue_time_us":103739}
I20260709 13:01:41.762647  5257 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:41.747888  1614 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:41.763370  5257 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:41.763705  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:41.728870  5116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.409s	user 0.017s	sys 0.020s
I20260709 13:01:41.764808  5338 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:41.750556  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1864) took 2724 ms. Trace:
I20260709 13:01:41.767074  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:41.767856  1618 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.753549  5279 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.770155  5279 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.772116  5279 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.770969  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.771878  5257 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.777556  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.779475  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.780377  1614 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:41.781430  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.782094  1614 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:41.783542  5338 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:41.785288  5338 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:41.786765  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.787024  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080008b080 after lost signal to thread 1479
W20260709 13:01:41.787501  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ba0 after lost signal to thread 1499
W20260709 13:01:41.787842  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800064f00 after lost signal to thread 1510
I20260709 13:01:41.787776  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:41.788334  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080008b360 after lost signal to thread 1511
W20260709 13:01:41.788628  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800064c80 after lost signal to thread 1512
I20260709 13:01:41.788708  2259 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:41.789917  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:41.765727  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6752256899999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
W20260709 13:01:41.791083  1661 connection.cc:256] RPC call timeout handler was delayed by -1.5665884430000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:01:41.791397  1661 connection.cc:256] RPC call timeout handler was delayed by -1.5323884430000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260709 13:01:41.791314  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:41.791836  1661 connection.cc:256] RPC call timeout handler was delayed by -1.3334884429999647s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
I20260709 13:01:41.791904  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:41.792222  1661 connection.cc:256] RPC call timeout handler was delayed by -1.3145290159999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 13:01:41.792642  1661 connection.cc:256] RPC call timeout handler was delayed by -1.2974290159999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:01:41.792933  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1576590680000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 13:01:41.793196  1661 connection.cc:256] RPC call timeout handler was delayed by -1.0607884429999785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23050000000000004s for a response
I20260709 13:01:41.766215  1619 rpcz_store.cc:276] 0709 13:01:39.025935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.749087 (+2723152us) service_pool.cc:224] Handling call
0709 13:01:41.749491 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.750272 (+   781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.750502 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:41.808552  1510 connection.cc:256] RPC call timeout handler was delayed by -2.0413299429999938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:01:41.809407  1510 connection.cc:256] RPC call timeout handler was delayed by -1.2417461539999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:01:41.809870  1510 connection.cc:256] RPC call timeout handler was delayed by -1.0864299429999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32370000000000004s for a response
I20260709 13:01:41.811779  5337 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:41.812366  5337 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:41.812714  1512 connection.cc:256] RPC call timeout handler was delayed by -2.3158184659999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 13:01:41.813269  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.812769  5337 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.792142  2265 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:41.788941  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800064ca0 after lost signal to thread 1513
I20260709 13:01:41.770479  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.773783  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:41.828435  2287 debug-util.cc:398] Leaking SignalData structure 0x7b0800195400 after lost signal to thread 5106
W20260709 13:01:41.832675  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800067380 after lost signal to thread 1571
W20260709 13:01:41.834412  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08000673a0 after lost signal to thread 1572
W20260709 13:01:41.832604  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79797.4us
I20260709 13:01:41.838907  1659 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:41.840230  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd200 after lost signal to thread 1646
W20260709 13:01:41.840734  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003cd280 after lost signal to thread 1647
W20260709 13:01:41.841620  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08003bae20 after lost signal to thread 5176
I20260709 13:01:41.842144  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:41.828765  5116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.509s	user 0.017s	sys 0.021s
W20260709 13:01:41.855708  2287 debug-util.cc:398] Leaking SignalData structure 0x7b080016ce00 after lost signal to thread 5188
W20260709 13:01:41.857286  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.861195  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee580 after lost signal to thread 1720
I20260709 13:01:41.864132  1620 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:41.864460  1692 raft_consensus.cc:2410] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:01:41.864771  2287 debug-util.cc:398] Leaking SignalData structure 0x7b0800305d40 after lost signal to thread 5191
W20260709 13:01:41.867995  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0d00 after lost signal to thread 5195
W20260709 13:01:41.869088  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003557a0 after lost signal to thread 2290
W20260709 13:01:41.869544  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080035c720 after lost signal to thread 2291
W20260709 13:01:41.865651  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 3.32416e+06us
I20260709 13:01:41.871007  2259 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:41.873001  4935 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.865701  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.874305  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.875056  1693 raft_consensus.cc:2410] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:01:41.875070  1687 raft_consensus.cc:2410] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:41.875564  1659 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:41.876803  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:41.877993  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003573a0 after lost signal to thread 4935
W20260709 13:01:41.878541  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002b2260 after lost signal to thread 4938
W20260709 13:01:41.878598  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.881507  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:41.881237  1587 connection.cc:256] RPC call timeout handler was delayed by -7.7423708310000166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:01:41.865149  5395 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:41.884742  2287 debug-util.cc:398] Leaking SignalData structure 0x7b0800223340 after lost signal to thread 5234
I20260709 13:01:41.886953  1688 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:01:41.887236  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08003744e0 after lost signal to thread 5238
W20260709 13:01:41.882870  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe480 after lost signal to thread 5037
I20260709 13:01:41.885798  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:41.888192  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003df960 after lost signal to thread 5106
W20260709 13:01:41.889137  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003501a0 after lost signal to thread 5176
W20260709 13:01:41.890426  1476 debug-util.cc:398] Leaking SignalData structure 0x7b080038efe0 after lost signal to thread 5188
W20260709 13:01:41.890947  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.892566  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6d40 after lost signal to thread 5191
W20260709 13:01:41.893581  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003c13c0 after lost signal to thread 5195
W20260709 13:01:41.894634  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08001ce5a0 after lost signal to thread 5234
W20260709 13:01:41.894698  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 66515.7us
W20260709 13:01:41.896302  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002a52e0 after lost signal to thread 5238
W20260709 13:01:41.897253  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003787c0 after lost signal to thread 5239
I20260709 13:01:41.897647  1620 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:41.890740  5257 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:41.898600  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.899168  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.899168  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08002614e0 after lost signal to thread 5271
W20260709 13:01:41.899782  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800385ba0 after lost signal to thread 5273
I20260709 13:01:41.901234  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1703) took 7486 ms. Trace:
W20260709 13:01:41.907742  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800220ea0 after lost signal to thread 5300
W20260709 13:01:41.908074  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3300 after lost signal to thread 5301
W20260709 13:01:41.908311  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800406ea0 after lost signal to thread 5304
W20260709 13:01:41.908521  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003261e0 after lost signal to thread 5313
W20260709 13:01:41.914853  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.916013  5037 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.876803  5099 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.920251  5037 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:41.921291  2287 debug-util.cc:398] Leaking SignalData structure 0x7b080027c1c0 after lost signal to thread 5271
W20260709 13:01:41.921705  2287 debug-util.cc:398] Leaking SignalData structure 0x7b080033efe0 after lost signal to thread 5273
W20260709 13:01:41.922279  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9500 after lost signal to thread 5300
W20260709 13:01:41.922591  2287 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff580 after lost signal to thread 5301
W20260709 13:01:41.922969  2287 debug-util.cc:398] Leaking SignalData structure 0x7b080038a780 after lost signal to thread 5304
I20260709 13:01:41.873776  4935 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:41.906795  5338 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:41.927002  5338 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.927413  5338 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:41.927449  5106 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.928344  5106 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.886976  5395 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.938133  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.922858  4938 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:41.936489  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.931125  1695 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:41.929955  2260 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:41.906095  1691 rpcz_store.cc:276] 0709 13:01:34.414575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.344753 (+3930178us) service_pool.cc:224] Handling call
0709 13:01:38.345035 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.346504 (+  1469us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:41.673784 (+3327280us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.835834 (+162050us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.865317 (+ 29483us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:41.880367 (+ 15050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.883417 (+  3050us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.901161 (+ 17744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":925431,"prepare.queue_time_us":929986,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":15243,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":18907,"thread_start_us":2544769,"threads_started":2}
I20260709 13:01:41.946331  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.942265  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:41.943686  1587 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.640s (SENT)
I20260709 13:01:41.949779  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:41.948521  1622 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:41.951603  2259 raft_consensus.cc:2368] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:41.951030  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:41.952785  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.942507  5395 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:41.954566  4938 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:41.954746  1689 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:41.954890  5394 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:41.956204  1687 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:41.953045  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 595) took 3302 ms. Trace:
I20260709 13:01:41.956046  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 662) took 2661 ms. Trace:
I20260709 13:01:41.964252  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:41.954998  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.968122  1618 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:41.955950  2263 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:41.972246  1587 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.640s (SENT)
W20260709 13:01:41.978724  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 104911us
I20260709 13:01:41.986477  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:41.986868  2266 raft_consensus.cc:2368] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8.
I20260709 13:01:41.962160  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:41.989442  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:41.990331  1619 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:41.993789  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2320) took 7349 ms. Trace:
I20260709 13:01:42.010578  1618 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:41.994706  1661 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.510s (SENT)
I20260709 13:01:41.996598  2259 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:41.997653  4938 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:41.958830  5176 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:41.999949  5394 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:41.961638  5359 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.028469  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.028560  5359 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.029066  5195 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:42.030167  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:42.000836  1695 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:42.002076  2258 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:42.002889  5037 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.006131  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.002122  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.036986  2260 raft_consensus.cc:2368] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:42.002921  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.038558  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:42.008914  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.039239  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.040113  5359 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.040362  1622 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:41.973130  1690 rpcz_store.cc:276] 0709 13:01:38.651087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.652142 (+  1055us) service_pool.cc:224] Handling call
0709 13:01:38.670272 (+ 18130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:38.670469 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:41.717314 (+3046845us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.879782 (+162468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.887250 (+  7468us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:41.906938 (+ 19688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.919252 (+ 12314us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.952985 (+ 33733us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604851,"prepare.queue_time_us":606430,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":61,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":21532,"thread_start_us":2598286,"threads_started":2,"wal-append.queue_time_us":245433}
I20260709 13:01:42.041693  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.042368  1690 raft_consensus.cc:2368] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
I20260709 13:01:41.986961  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:42.043385  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 89500.7us
W20260709 13:01:42.045066  1587 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.776s (SENT)
I20260709 13:01:42.045596  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.046484  4938 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:42.046595  5406 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.046800  5392 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:42.047246  4938 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:42.049736  4938 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:41.973256  1621 rpcz_store.cc:276] 0709 13:01:39.213599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.600477 (+2386878us) service_pool.cc:224] Handling call
0709 13:01:41.600988 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.601475 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:41.647924 (+ 46449us) log.cc:844] Serialized 14 byte log entry
0709 13:01:41.859439 (+211515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:41.859492 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:41.859540 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.859604 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.875337 (+ 15733us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109098,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":24209,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":232189,"threads_started":3,"wal-append.queue_time_us":52166}
I20260709 13:01:42.012028  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:42.050583  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.958974  5099 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.058375  2257 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:42.059734  5099 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.013379  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.012857  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.053090  5337 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.061944  1687 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:42.014348  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.063186  5337 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.063520  1694 raft_consensus.cc:2410] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:42.063843  1693 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:42.015075  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.016327  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.016976  5279 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.016592  5106 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.017809  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.067127  5279 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:42.017757  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45562.7us
I20260709 13:01:42.056056  1691 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 7: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:42.009832  1689 rpcz_store.cc:276] 0709 13:01:34.644191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.357900 (+3713709us) service_pool.cc:224] Handling call
0709 13:01:41.930210 (+3572310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:41.991758 (+ 61548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.993511 (+  1753us) spinlock_profiling.cc:243] Waited 3.53 s on lock 0x7b540040f450. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:41.993710 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8115895552}
I20260709 13:01:42.059967  2258 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:01:42.069402  1512 connection.cc:256] RPC call timeout handler was delayed by -1.8655955199999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:01:42.066195  2262 raft_consensus.cc:2368] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
W20260709 13:01:42.069855  1512 connection.cc:256] RPC call timeout handler was delayed by -1.782795520000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:01:41.951347  5296 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:01:42.045941  2265 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:42.067226  1688 raft_consensus.cc:2410] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:01:42.070209  1512 connection.cc:256] RPC call timeout handler was delayed by -1.5856955200000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 13:01:42.072203  1616 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:42.072453  1619 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:42.071923  1512 connection.cc:256] RPC call timeout handler was delayed by -1.4542955200000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:01:42.075047  1512 connection.cc:256] RPC call timeout handler was delayed by -1.4038955200000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:01:42.075358  1512 connection.cc:256] RPC call timeout handler was delayed by -1.3336955200000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:01:42.068379  1661 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.529s (SENT)
W20260709 13:01:42.075685  1512 connection.cc:256] RPC call timeout handler was delayed by -1.310295520000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:01:42.076061  1512 connection.cc:256] RPC call timeout handler was delayed by -1.2517955200000301s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23020000000000002s for a response
I20260709 13:01:41.994377  5338 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.082015  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.101061  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:42.101953  2260 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:42.108084  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.108577  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.110006  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55161.2us
I20260709 13:01:42.113083  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.113986  1619 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.116072  5338 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.122062  1619 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:42.073650  5393 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:01:42.129876  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 52485.1us
W20260709 13:01:42.132745  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 202655us
W20260709 13:01:42.134423  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.082967  5337 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:01:42.128130  1661 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.743s (SENT)
I20260709 13:01:42.135850  2261 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:42.123323  4935 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.139813  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:42.140446  2265 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.133059  5338 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:42.144850  1545 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:01:42.146081  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.151422  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:42.153010  1541 raft_consensus.cc:606] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:42.153941  1541 raft_consensus.cc:614] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:42.155267  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:42.157676  4938 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:42.167665  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:42.170312  2231 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:42.172127  5271 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:42.173295  5271 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:42.178499  1587 connection.cc:256] RPC call timeout handler was delayed by -7.6995134890000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.315s for a response
W20260709 13:01:42.179441  1587 connection.cc:256] RPC call timeout handler was delayed by -7.6995134890000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.315s for a response
W20260709 13:01:42.187023  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.142261  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.194427  1542 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:42.211227  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.211813  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.211138  1587 leader_election.cc:336] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.909s (SENT)
I20260709 13:01:42.216204  2262 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:42.218851  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:42.219486  1587 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.947s (SENT)
I20260709 13:01:42.220021  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.220257  5396 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.221421  5392 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.221664  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:42.221982  1587 connection.cc:256] RPC call timeout handler was delayed by -7.6851134890000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3166s for a response
I20260709 13:01:42.227052  2260 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:42.203217  5338 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:42.229467  5397 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:42.230391  5338 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.236346  5394 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.237020  5394 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.239657  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.240358  1616 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:42.229826  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55980.5us
I20260709 13:01:42.241648  1619 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:42.242123  1619 pending_rounds.cc:85] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:01:42.216158  5395 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:42.243224  1510 connection.cc:256] RPC call timeout handler was delayed by -3.3834938969999939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.414s for a response
I20260709 13:01:42.242184  2231 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:42.242524  1619 pending_rounds.cc:107] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:42.244966  1619 raft_consensus.cc:2889] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.248415  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:42.250272  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.253705  2265 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:42.255227  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:42.244184  5296 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.255868  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.249254  1613 raft_consensus.cc:2376] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11. Re-sending same reply.
I20260709 13:01:42.260218  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.261132  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.261161  1659 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.262792  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.263837  1620 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:42.264112  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.264810  1621 raft_consensus.cc:2376] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11. Re-sending same reply.
I20260709 13:01:42.264884  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.265919  1510 leader_election.cc:400] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8.
I20260709 13:01:42.266285  1510 leader_election.cc:403] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.223601  5396 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:01:42.272995  1617 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:42.268529  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.266582  1620 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:01:42.267036  1587 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.051s (SENT)
I20260709 13:01:42.269332  5397 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:42.269852  5423 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.275333  4935 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:42.276841  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.269565  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.285429  2261 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:42.268206  5195 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:01:42.263891  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.288522  1614 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:42.278251  4938 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:42.278730  1615 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:42.271346  5271 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.266958  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.294025  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.271694  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.280063  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.278070  1510 leader_election.cc:400] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
I20260709 13:01:42.295123  1510 leader_election.cc:403] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:01:42.298252  5037 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:42.298252  5406 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.298758  5419 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:42.298957  1587 leader_election.cc:336] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.058s (SENT)
I20260709 13:01:42.299379  5419 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:42.299546  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.299928  5419 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.301343  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.302675  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.283655  5392 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.307143  1618 raft_consensus.cc:2368] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:42.302414  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.308431  5337 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:42.309018  5337 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:42.309789  1616 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:42.310068  5337 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.313359  4938 consensus_queue.cc:1243] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:42.296461  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.319306  1615 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:42.318168  1613 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 7.
I20260709 13:01:42.317354  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:42.334195  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 56324.9us
I20260709 13:01:42.318809  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.294215  5397 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:42.298974  5037 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.313998  4938 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:42.334337  1620 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:42.343511  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.353564  1618 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:42.346225  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.346794  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:42.355561  1661 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.781s (SENT)
W20260709 13:01:42.347361  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.334767  1587 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.162s (SENT)
I20260709 13:01:42.350860  1613 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:42.354664  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.267342  5418 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:01:42.357322  1619 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:42.364657  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:42.358080  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.336396  5393 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:42.366595  1615 raft_consensus.cc:2368] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8.
I20260709 13:01:42.366747  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.306005  5359 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:01:42.366008  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.352813  4938 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.351488  5406 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.370358  2262 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:01:42.368898  5166 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:01:42.394868  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.395501  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.354570  5116 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:01:42.396833  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.397464  1615 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.371011  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.372037  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.372334  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.400517  1618 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:42.372895  5412 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:42.374480  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.370378  5069 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.375213  5397 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.376250  5418 consensus_queue.cc:1243] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:42.376295  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:42.423120  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.423659  2259 raft_consensus.cc:2368] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11.
I20260709 13:01:42.368789  5393 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:42.381032  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.384582  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:42.382767  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92728.1us
I20260709 13:01:42.388696  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.356081  5423 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:42.395677  1620 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:42.401042  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.371069  5279 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:42.430584  5434 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.003s
I20260709 13:01:42.358747  5106 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.432571  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.410609  2257 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:42.412462  5394 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.414217  1442 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 6, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:42.415721  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.417207  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.355394  5395 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.419627  1615 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:42.435127  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.435699  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.336860  5392 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.448127  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:42.449383  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.453058  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:42.453862  2258 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:42.455289  2257 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:42.457094  1613 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.455936  5337 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:42.417343  5116 raft_consensus.cc:2764] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:01:42.459846  1619 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:42.424291  5412 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.465613  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:42.479552  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44522.1us
I20260709 13:01:42.427286  5393 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.484831  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.479956  1510 leader_election.cc:400] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11.
I20260709 13:01:42.481438  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:42.485486  1510 leader_election.cc:403] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:01:42.488023  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 138449us
W20260709 13:01:42.489012  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.491099  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:42.494119  1617 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:42.461392  5423 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:42.504227  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 196347us
I20260709 13:01:42.504441  1619 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:42.505918  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 81225us
I20260709 13:01:42.511445  5360 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:42.490258  5106 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9.
I20260709 13:01:42.504920  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:42.515442  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.521670  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.495369  5394 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:42.526505  1615 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.500619  5069 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:42.531391  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:42.549808  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.559589  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.416955  5037 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.569348  1622 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:42.569748  1587 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.171s (SENT)
I20260709 13:01:42.573463  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:42.569422  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 84694.1us
I20260709 13:01:42.524132  5360 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.573983  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.571538  1617 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.575093  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.528543  5394 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:42.609073  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 82707.8us
W20260709 13:01:42.620525  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 150639us
W20260709 13:01:42.623579  1661 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 3.173s (SENT)
I20260709 13:01:42.627862  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:42.632529  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57550.2us
I20260709 13:01:42.622723  5360 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:42.629643  5431 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:42.619736  5394 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:42.644366  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.645589  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:42.633924  5106 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:42.650312  1621 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:42.656850  5191 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:42.657235  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:42.657523  5191 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:42.656978  5428 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:01:42.607420  4938 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.650054  5037 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.647758  5359 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.694751  1620 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
W20260709 13:01:42.695297  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 125581us
I20260709 13:01:42.676865  5397 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.658510  5191 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:42.703303  5441 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:01:42.704393  5301 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.694587  5440 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:42.707259  4938 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:42.708022  5415 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:42.655488  5106 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.708436  5415 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.659025  5099 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:42.718739  5238 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:01:42.712417  5415 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.728605  5448 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.705451  5419 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.743330  1617 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:42.655958  5423 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.733522  5099 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.763597  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.768826  2260 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:42.769069  1691 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:42.729548  5106 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.772272  1615 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:42.772900  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59388.8us
I20260709 13:01:42.763325  5436 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:42.659740  5412 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.774276  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.775542  1688 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:42.770486  5099 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.786280  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.791179  5188 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:42.791596  5188 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.794221  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.797258  1689 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:42.761881  5393 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.778877  4935 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8.
I20260709 13:01:42.802380  1694 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:42.803853  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:42.844812  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.772951  5447 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:42.845324  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 199709us
I20260709 13:01:42.849061  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:42.845731  1694 pending_rounds.cc:85] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 5
I20260709 13:01:42.849939  1694 pending_rounds.cc:107] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:01:42.850207  1694 raft_consensus.cc:2889] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.851429  1690 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:42.765249  5448 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.862953  5337 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.863881  5337 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.864733  5448 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.866119  5337 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.869865  1622 raft_consensus.cc:2410] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:01:42.875939  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.877591  5238 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:42.878531  5337 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:42.879011  5337 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.878252  5238 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.879413  5337 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.881299  5238 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.881889  5238 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:42.879252  1542 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:01:42.882970  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:42.883790  5396 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:42.884160  5396 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.884366  5234 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.879312  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.884879  5234 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.884533  5396 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:42.887255  5234 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.887437  5176 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.888057  5176 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.890139  5176 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.882400  5238 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.890904  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.891566  1541 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:42.892819  5238 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.892928  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.898286  5392 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:42.846346  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.247s (SENT) [suppressed 70 similar messages]
I20260709 13:01:42.909587  1693 raft_consensus.cc:2410] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:01:42.910796  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 64475.2us
I20260709 13:01:42.903967  1613 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:42.904964  1687 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
W20260709 13:01:42.905222  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.905493  5195 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:42.913208  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.918783  5195 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:42.913950  1692 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:01:42.919520  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 190986us
I20260709 13:01:42.914636  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:42.921075  1587 connection.cc:256] RPC call timeout handler was delayed by -7.6440650829999868s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:01:42.922781  5452 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:42.924268  5419 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:42.919899  5195 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.926900  5360 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.927947  5195 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:42.929128  5360 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.929718  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:42.929962  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.930886  5393 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:42.931960  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.931028  5415 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.934831  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.935468  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.936638  1691 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:42.936214  5188 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:42.938694  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:42.941627  5392 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:42.942513  1585 leader_election.cc:400] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:42.946847  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.955132  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:42.957067  1688 raft_consensus.cc:606] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:42.960969  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:42.962199  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.970801  5395 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:42.977941  5448 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:42.962807  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:42.963778  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.963162  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:42.979234  1587 connection.cc:256] RPC call timeout handler was delayed by -7.0897094540000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:01:42.979509   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:01:42.979691  1540 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:42.963531  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.980458  1541 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:42.980722  1687 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:42.964737  2260 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:42.966686  1539 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:42.966009  1542 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:42.983011  1542 pending_rounds.cc:85] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 7
I20260709 13:01:42.983253  1692 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:42.984280  1692 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:42.984413  1691 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:42.983268  1542 pending_rounds.cc:107] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:42.985679  1542 raft_consensus.cc:2889] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:42.978545  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:42.988869  1688 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:42.988020  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.989460  5415 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:42.990588  1585 leader_election.cc:403] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:01:42.991168  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48807.2us
I20260709 13:01:42.992004  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.992533  5188 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:42.993249  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.993844  1545 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:42.994488  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:42.994910  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:42.995152  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:42.965936  5396 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.997426  5396 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:42.997557  5337 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:42.999475  1540 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:01:42.979672  1587 connection.cc:256] RPC call timeout handler was delayed by -5.9261355909999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:01:43.005457  1587 connection.cc:256] RPC call timeout handler was delayed by -5.9261355909999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:01:43.005767  1587 connection.cc:256] RPC call timeout handler was delayed by -5.90723559099996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:01:43.006035  1587 connection.cc:256] RPC call timeout handler was delayed by -5.90723559099996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:01:43.006307  1587 connection.cc:256] RPC call timeout handler was delayed by -5.9000355910000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:01:43.001022  5436 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:43.014161  1687 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
W20260709 13:01:43.002780  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 118946us
I20260709 13:01:43.003636  1543 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:42.978844  1694 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
I20260709 13:01:43.007526  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:43.001998  5394 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:43.018344  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.019021  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.848377  5447 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.977124  1547 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:43.017055  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.017299  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.017500  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.014681  1687 pending_rounds.cc:85] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 9
I20260709 13:01:43.023753  5337 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:43.023499  5395 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:43.025679  5394 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:42.978564  5448 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:43.015359  2231 connection.cc:256] RPC call timeout handler was delayed by -2.7886420269999803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:01:43.062448  1687 pending_rounds.cc:107] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 9.10
W20260709 13:01:43.062779  2231 connection.cc:256] RPC call timeout handler was delayed by -2.5591420270000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19140000000000001s for a response
I20260709 13:01:42.967056  5452 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:43.013103  2259 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:43.058409  1693 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:43.037124  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.065428  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.064451  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:43.066334  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:43.062839  1687 raft_consensus.cc:2889] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.047212  1543 raft_consensus.cc:2410] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:43.039448  5414 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:01:43.066334  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.070374  1540 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:43.070880  2231 connection.cc:256] RPC call timeout handler was delayed by -2.462842027000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:01:43.072785  2231 connection.cc:256] RPC call timeout handler was delayed by -2.3260420270000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:01:43.075881  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.079509  5448 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.080179  5394 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:43.080763  5394 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:43.080670  1541 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:01:43.081895  5394 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.083916  5271 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.086982  1541 pending_rounds.cc:85] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 8
I20260709 13:01:43.087361  1541 pending_rounds.cc:107] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:43.087667  1541 raft_consensus.cc:2889] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.066883  5195 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.098165  5195 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.100384  5195 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:43.111023  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 60295.4us
I20260709 13:01:43.059712  5436 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:43.117944  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:43.067689  5452 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:43.080631  5448 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.117640  4935 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:43.120471  5440 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:43.152549  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.154323   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:43.190555  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 72696.2us
W20260709 13:01:43.194932  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.195098  1618 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:43.195488  5296 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:43.202836  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 187836us
I20260709 13:01:43.204222  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:43.204423  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:43.204938  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:43.229398  1687 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:43.205500  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:43.230592  1688 raft_consensus.cc:2410] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:43.206835  1696 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:43.207198  5392 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:43.071583  5338 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:43.211329  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.212339  1617 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:43.212229  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:43.213496  1614 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:43.214152  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.214269  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.236508  1543 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:01:43.215256  1544 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:43.215147  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.237254  1545 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.214183  1547 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:43.217847  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:43.055351  5447 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.154417  1622 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:43.229594  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.243055  1689 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:43.248754  1540 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:43.251843  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.241868  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:43.254588  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:43.255638  4938 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:43.255690  5412 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:43.256336  4938 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.257731  5359 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:43.258285  5176 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:43.259696  5359 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:43.256875  5412 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.261756  5412 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:43.256891  4938 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.231772  5392 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:43.276599  1619 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.260916  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.279203  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.282133  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:43.283257  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.284740  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.286194  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.289178  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.290036  1544 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:43.285528  1547 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.297652  2265 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:43.298703  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.301047  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 71533.2us
I20260709 13:01:43.301198  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.301051  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.305322  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.310271  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.311218  5313 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:43.311677  5313 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:43.312089  5313 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.311929  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.319588  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.320326  1543 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:43.320580  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.280438  5238 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.322934  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.320142  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:43.321159  1541 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:43.326709  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.332996  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.334090  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.334736  1542 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.342900  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.344220  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.348417  1619 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:43.243353  5439 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:01:43.353566  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.351083  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.353025  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:43.332437  5037 consensus_meta.cc:287] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 13:01:43.356564  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.312214  5392 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.353729  1587 leader_election.cc:400] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
I20260709 13:01:43.372476  1587 leader_election.cc:403] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.326295  5338 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:43.378185  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 107292us
I20260709 13:01:43.379349  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.349961  4935 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.388008  1545 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:43.388839  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65408.2us
I20260709 13:01:43.352299  5359 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:43.392740  5326 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:43.394596  2265 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:43.331379  5279 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:43.405395  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.409543  1546 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:43.409601  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.409629  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 107750us
I20260709 13:01:43.410733  1545 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:43.391445  5106 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:43.363094  5413 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:01:43.391744  4935 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.414431  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:43.417768  2258 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:43.419512  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:43.400089  5037 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.406503  5393 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:01:43.425424  5392 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:43.427044  5461 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:01:43.434057  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.388942  5238 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:01:43.419438  5106 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.447434  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.448181  1542 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.419329  4935 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.433247  5396 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:43.441191  5069 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:43.447058  5099 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.004s
I20260709 13:01:43.450421  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:01:43.448953  5464 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:43.464644  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.464828  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 48904.6us
I20260709 13:01:43.467041  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:43.468519  1538 raft_consensus.cc:2410] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:43.450207  5106 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.472186  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:43.471338  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 52213.5us
W20260709 13:01:43.485074  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56000.7us
I20260709 13:01:43.486011  1660 leader_election.cc:400] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 6. Current term is 7.
I20260709 13:01:43.461447  5396 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:43.465626  5069 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:43.493935  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.477128  5257 raft_consensus.cc:2764] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:01:43.497749  5413 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:43.508606  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.508090  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.493337  5396 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.471956  5099 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:43.514312  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 338) took 26968 ms (client timeout 15000 ms). Trace:
I20260709 13:01:43.495026  5069 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.484413  5279 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:01:43.527794  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54567.8us
I20260709 13:01:43.530526  1693 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:01:43.528529  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:43.430821  5440 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9.
W20260709 13:01:43.547566  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61723us
I20260709 13:01:43.550268  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:43.551460  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:43.527637  5301 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.000s
W20260709 13:01:43.554601  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.558351  5444 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.558909  5444 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:43.559402  5444 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.559556  1442 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:01:43.561146  1442 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.407258  5452 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.547087  5413 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:43.563377  5452 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.563457  5413 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.563993  5413 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:43.566154  5326 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:43.530087  5279 consensus_queue.cc:1243] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:43.566601  5326 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:43.567101  5326 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.567848  5099 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:43.568207  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:43.568959  5471 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:01:43.570964  5462 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:01:43.571347  5301 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11.
W20260709 13:01:43.523823  1444 rpcz_store.cc:269] 0709 13:01:16.408017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.408223 (+   206us) service_pool.cc:224] Handling call
0709 13:01:43.365540 (+26957317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.223739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.463973 (+240234us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.464024 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:01:32.464047 (+    23us) tablet.cc:662] Decoding operations
0709 13:01:32.465173 (+  1126us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.465249 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.465274 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:01:32.466354 (+  1080us) tablet.cc:701] Row locks acquired
0709 13:01:32.466395 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:01:32.466542 (+   147us) write_op.cc:270] Start()
0709 13:01:32.534244 (+ 67702us) write_op.cc:276] Timestamp: P: 1783602092466485 usec, L: 0
0709 13:01:32.534286 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.535065 (+   779us) log.cc:844] Serialized 4770 byte log entry
0709 13:01:33.280489 (+745424us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b
0709 13:01:34.953577 (+1673088us) op_driver.cc:464] REPLICATION: finished
0709 13:01:36.051164 (+1097587us) write_op.cc:301] APPLY: starting
0709 13:01:36.051326 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:36.051725 (+   399us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:36.051774 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:36.186534 (+134760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:36.186906 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:01:36.186966 (+    60us) write_op.cc:312] APPLY: finished
0709 13:01:36.187328 (+   362us) log.cc:844] Serialized 89 byte log entry
0709 13:01:36.650080 (+462752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:36.650556 (+   476us) write_op.cc:454] Released schema lock
0709 13:01:36.650650 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:36.651063 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:36.651087 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1435164,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":1049324,"apply.run_cpu_time_us":42816,"apply.run_wall_time_us":601853,"num_ops":12,"prepare.queue_time_us":347425,"prepare.run_cpu_time_us":37262,"prepare.run_wall_time_us":1805605,"raft.queue_time_us":329438,"raft.run_cpu_time_us":15279,"raft.run_wall_time_us":17938,"replication_time_us":2419065,"spinlock_wait_cycles":56320896,"thread_start_us":2262152,"threads_started":5,"wal-append.queue_time_us":2008764,"wal-append.run_cpu_time_us":52288,"wal-append.run_wall_time_us":2842870}]]}
I20260709 13:01:43.572489  1541 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:01:43.544909  5469 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:01:43.574486  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:43.576156  1544 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:43.576721  1442 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 6 to 7, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:01:43.583335  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.592178  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.598416  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 193641us
I20260709 13:01:43.597152  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:43.597558  5279 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:01:43.610610  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:43.617897  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 43516.7us
W20260709 13:01:43.624576  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.638564  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 87203.9us
W20260709 13:01:43.609503  5470 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:01:43.613305  5439 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:43.610137  5423 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:43.648723  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.657014  1544 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:43.609776  5338 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:43.649847  1661 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 4.206s (SENT)
I20260709 13:01:43.654323  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.665347  1540 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.680593  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.642405  5394 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.682647  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:43.684140  2260 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:43.684768  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:43.691488  1693 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:43.663643  5439 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.696746  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.700134  1544 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.700278  5238 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.697744  1687 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:43.700835  5337 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.701047  5238 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:43.701814  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52022.6us
I20260709 13:01:43.705170  5238 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:43.707556  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 686) took 1275 ms. Trace:
I20260709 13:01:43.707602  1692 raft_consensus.cc:1275] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:01:43.710214  1692 pending_rounds.cc:85] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 6
I20260709 13:01:43.710577  1692 pending_rounds.cc:107] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:01:43.710898  1692 raft_consensus.cc:2889] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:43.711838  1617 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:43.712019  5480 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:01:43.712927  5477 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:01:43.713815  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 68604.9us
I20260709 13:01:43.714138  1695 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:43.714576  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:43.707995  1621 rpcz_store.cc:276] 0709 13:01:42.431860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.659425 (+227565us) service_pool.cc:224] Handling call
0709 13:01:42.694143 (+ 34718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.698608 (+  4465us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:42.698675 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.714424 (+ 15749us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.086307 (+371883us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b180038c560. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:01:43.332225 (+245918us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:43.332264 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.332335 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.695883 (+363548us) raft_consensus.cc:1685] finished
0709 13:01:43.695905 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.707484 (+ 11579us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15171,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4188,"spinlock_wait_cycles":34885376,"thread_start_us":245717,"threads_started":1,"wal-append.queue_time_us":672966}
W20260709 13:01:43.723169  5468 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:01:43.723770  5465 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:01:43.724387  5226 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 13:01:43.725181  5487 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:43.725350  5474 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:01:43.727144  5467 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:01:43.728076  4938 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.727095  5279 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:43.730719  5279 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:43.731899  5279 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.733270  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.734490  1543 raft_consensus.cc:2376] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8. Re-sending same reply.
I20260709 13:01:43.735044  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.735685  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.723294  5463 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:01:43.682121  5414 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:01:43.726330  5483 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:01:43.709494  5439 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.756331  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.736282  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.767196  1539 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:43.768165  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.769423  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.770285  1544 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:43.729885  5069 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.716161  5436 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:43.758595  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:43.773506  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 59026.4us
I20260709 13:01:43.773694  1543 raft_consensus.cc:2376] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8. Re-sending same reply.
W20260709 13:01:43.761719  5486 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:01:43.759992  1442 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 5 to 6, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:43.753052  5337 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:43.774372  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:43.777912  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 80173us
W20260709 13:01:43.777694  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 131966us
I20260709 13:01:43.778139  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.695581  5394 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:43.786746  5472 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:01:43.788937  1693 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:43.800112  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.806406  1543 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:43.812145  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.773377  5436 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:43.814735  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.821750  1542 raft_consensus.cc:2393] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:43.816239  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 122915us
I20260709 13:01:43.779522  5423 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:43.824090  1442 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:43.781409  5337 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:43.834587  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:43.836381  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.837273  1539 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:43.840356  5504 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:43.841943  5504 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:43.843107  5504 consensus_queue.cc:1243] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:43.843256  5116 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:43.844669  5504 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:43.853659  5504 consensus_queue.cc:1243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:43.859228  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:43.860680  1660 leader_election.cc:400] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8.
I20260709 13:01:43.860963  1660 leader_election.cc:403] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.806891  5415 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:43.848438  1442 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 6 to 7, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:43.846710  1539 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:43.809688  5195 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:43.864322  1661 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.560s (SENT)
I20260709 13:01:43.864874  1543 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:43.868518  1546 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:43.826184  5436 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.874796  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.878262  1695 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:01:43.878710  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59405.4us
I20260709 13:01:43.827301  5337 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:43.881374  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:43.885154  1587 leader_election.cc:400] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
I20260709 13:01:43.885555  1587 leader_election.cc:403] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.892688  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.871984  5195 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:43.895805  5423 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.817437  5395 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:01:43.897188  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.895583  5195 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:43.902813  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:43.876749  5116 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:43.879947  5338 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:43.919317  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:43.934235  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:43.862387  5396 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.898159  5415 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8.
I20260709 13:01:43.946053  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:43.954386  5069 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:43.959213  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 79476.1us
I20260709 13:01:43.959939  5395 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:43.960316  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.961331  1543 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:43.966996  5338 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:43.967480  5338 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:43.968331  5338 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:43.970166  1540 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:01:43.971226  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 110702us
I20260709 13:01:43.972028  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:43.973647  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:43.909082  5116 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:43.978237  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 81469.2us
I20260709 13:01:43.946565  1539 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:43.957849  5413 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:43.970099  5392 consensus_meta.cc:287] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.005s
W20260709 13:01:44.013808  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 172222us
I20260709 13:01:44.016250  1617 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:44.016393  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:43.977384  5195 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.031865  5392 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:44.033556  5392 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:44.033955  5392 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:44.041059  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.043545  5495 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:01:44.044042  5495 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:01:44.044668  5392 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.045500  5396 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:44.045950  5392 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:44.046188  5396 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.046844  5501 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:01:44.049646  5313 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.000s
W20260709 13:01:44.051743  5412 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
W20260709 13:01:44.052145  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.022651  5296 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:44.059257  5296 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:44.060252  5296 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.060613  5413 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.020603  5415 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:44.024091  5326 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.063799  5415 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.064215  5415 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.065806  5326 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:44.020129  5226 consensus_queue.cc:1048] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:01:44.069415  5447 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.788s	user 0.009s	sys 0.002s
I20260709 13:01:44.069849  5447 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.070782  5493 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.071771  5394 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:44.073194  5448 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.849s	user 0.012s	sys 0.000s
I20260709 13:01:44.074028  5116 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.075497  5116 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.081213  5069 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:44.081859  5069 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.084321  5069 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.085438  5069 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.086043  5069 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.088680  5069 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:44.090932  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.032455  5506 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
W20260709 13:01:44.099213  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 122578us
I20260709 13:01:44.128328  1690 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:44.128861  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.131479  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.132669  1615 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:44.050148  5313 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:01:44.107932  4935 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.004s
I20260709 13:01:44.143739  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.032049  5503 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.157s
W20260709 13:01:44.137815  5106 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.004s
I20260709 13:01:44.170766  1547 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:44.031874  5444 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.169644  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.108290  5394 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:01:44.172343  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 212107us
I20260709 13:01:44.166365  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.143326  5418 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:44.122346  5448 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:44.052165  5412 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.173610  1621 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:44.175457  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:44.175698  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.150382  5176 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:01:44.185564  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:44.187924  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.143185  4935 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.172087  5106 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.174018  5491 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.188647  1615 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:44.189954  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.196201  1621 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:44.191015  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 217447us
W20260709 13:01:44.190752  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 53481us
I20260709 13:01:44.143185  5436 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.179893  5418 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:44.198441  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:44.206898  4935 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.212996  5337 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.219597  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.221292  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.204228  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:44.233634  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:44.238219  5448 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:44.238423  5447 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:44.238777  5448 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:44.216379  5418 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.239841  1615 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:44.223613  5479 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:44.243780  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.244839  1615 raft_consensus.cc:2410] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:44.248502  5479 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.248781  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.249702  1615 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:44.249918  5491 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:44.250423  5491 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.251291  5491 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.254743  1615 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:44.257210  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:44.259959  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.260375  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.260361  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:44.242389  5448 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.218089  5415 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.263931  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.264674  1615 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:44.239709  5503 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:44.265964  5511 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.266904  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:44.265704  5439 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.269982  1613 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:44.270566  4935 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:44.270748  5510 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:44.271198  4935 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.273841  5412 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.274493  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:44.274773  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.275995  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.279449  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:44.281126  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.271211  5510 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:44.286978  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.278308  5503 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.298799  1615 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:44.300292  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.278510  5436 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:44.249727  5479 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.306975  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.273881  4935 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.311511  5106 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.282428  5512 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:44.285971  5412 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.283722  5337 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:44.285916  5313 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.316660  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.317041  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:44.318228  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57937.2us
I20260709 13:01:44.317988  5444 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:44.347918  5444 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.348407  5415 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:44.349125  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.349700  1620 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.347937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.352444  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:44.353106  5508 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:44.353513  5508 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:44.353757  5438 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:44.354382  5508 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.355687  5508 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.356112  5452 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:44.290829  5510 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.358971  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.363034  1695 raft_consensus.cc:2368] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 10.
I20260709 13:01:44.362154  1621 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:44.364533  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.365149  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.366031  1689 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:44.367511  1621 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:44.370023  1621 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:44.381347  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.374980  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.376107  5439 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:44.334383  5509 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:01:44.333675  5514 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:01:44.378950  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 88452.7us
W20260709 13:01:44.380383  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 63474.1us
W20260709 13:01:44.393131  1587 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.619s (SENT)
I20260709 13:01:44.381366  1620 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:01:44.332063  5497 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.566s	user 0.000s	sys 0.005s
I20260709 13:01:44.383474  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.393996  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:44.385195  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.385492  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.386976  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.354374  5438 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:44.397203  5438 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.388173  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.361121  5452 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:44.398535  5438 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.399322  5452 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.399837  4938 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:44.400560  5452 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:44.401132  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.402792  5436 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.392628  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:44.409590  5359 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:44.410045  5359 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.412668  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.414568  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.415113  5359 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.416178  5359 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.417294  4938 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:44.417682  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1959) took 1202 ms. Trace:
I20260709 13:01:44.417861  4938 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.432137  1539 pending_rounds.cc:85] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 7
I20260709 13:01:44.432873  1539 pending_rounds.cc:107] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:01:44.433264  1539 raft_consensus.cc:2889] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.418071  1538 rpcz_store.cc:276] 0709 13:01:43.215137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.222310 (+  7173us) service_pool.cc:224] Handling call
0709 13:01:44.417439 (+1195129us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400021054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:44.417601 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355181440}
W20260709 13:01:44.440812  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46862.7us
I20260709 13:01:44.441478  1542 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.306314  5491 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:01:44.443885  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:44.446854  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.450837  1620 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.448140  1545 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:44.454262  1545 pending_rounds.cc:85] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 7
I20260709 13:01:44.453433  4938 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.454690  1545 pending_rounds.cc:107] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:44.455112  1545 raft_consensus.cc:2889] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:44.457599  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.457901  1544 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:44.457682  1619 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:44.448504  1615 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:44.462085  1615 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:44.466449  1622 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:44.471410  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:44.478094  2257 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:44.485601  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 92521.3us
I20260709 13:01:44.500559  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:44.501394  2257 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.506471  1620 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:44.507735  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:44.512935  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:44.514005  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70345.4us
I20260709 13:01:44.515115  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:44.517422  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:44.523766  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.524194  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.483820  5395 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:44.523042  1620 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:44.548141  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.549940  1620 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:01:44.550812  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46171.2us
W20260709 13:01:44.551766  1587 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.180s (SENT)
I20260709 13:01:44.552229  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:44.556118  5234 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.556694  5234 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.465212  5337 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:01:44.446338  5520 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:01:44.545047  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:44.561347  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:44.570530  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 182452us
I20260709 13:01:44.571741  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:44.525149  1619 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:44.525215  5415 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:44.518343  5512 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:44.570487  1620 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.573841  2266 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:44.546712  5503 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.525025  5444 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260709 13:01:44.596503  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.575260  5439 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.563176  5447 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:01:44.595736  5397 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:44.587702  5415 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:44.631027  1619 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:01:44.633592  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:44.643754  5448 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.646173  5448 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:44.647625  5485 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.884s	user 0.002s	sys 0.002s
I20260709 13:01:44.620483  5418 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.651713  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1743) took 1245 ms. Trace:
I20260709 13:01:44.652104  1613 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.653049  2266 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:01:44.653383  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 607) took 1719 ms. Trace:
I20260709 13:01:44.653779  1690 rpcz_store.cc:276] 0709 13:01:42.933502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.934726 (+  1224us) service_pool.cc:224] Handling call
0709 13:01:42.934997 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.134068 (+1199071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.653156 (+519088us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000b31d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:44.653326 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741578624}
I20260709 13:01:44.655211  5440 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.655750  5440 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:44.653401  1587 connection.cc:256] RPC call timeout handler was delayed by -1.182142816999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260709 13:01:44.653414  2266 pending_rounds.cc:85] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 7
I20260709 13:01:44.659878  2266 pending_rounds.cc:107] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:44.660174  2266 raft_consensus.cc:2889] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.659523  1540 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:44.660856  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1668428169999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:01:44.647696  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1989) took 1122 ms. Trace:
I20260709 13:01:44.661957  1620 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:44.661312  1546 rpcz_store.cc:276] 0709 13:01:43.525540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.526132 (+   592us) service_pool.cc:224] Handling call
0709 13:01:43.863777 (+337645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.872462 (+  8685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.647478 (+775016us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54000217d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:44.647614 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726629248}
W20260709 13:01:44.666180  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.668066  1620 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:44.669895  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1083428169999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:01:44.670356  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1083428169999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 13:01:44.670688  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0417428169999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 13:01:44.670990  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0417428169999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260709 13:01:44.673272  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.641594  5439 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.652078  1688 rpcz_store.cc:276] 0709 13:01:43.405892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.406008 (+   116us) service_pool.cc:224] Handling call
0709 13:01:43.414949 (+  8941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.419109 (+  4160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.419146 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.427668 (+  8522us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.648311 (+220643us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.648354 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.648424 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.647021 (+998597us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:44.651430 (+  4409us) raft_consensus.cc:1685] finished
0709 13:01:44.651451 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.651634 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":639,"raft.queue_time_us":13535,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8776,"spinlock_wait_cycles":62331648,"thread_start_us":219790,"threads_started":1,"wal-append.queue_time_us":268342}
W20260709 13:01:44.683701  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.684065  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.685247  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.686324  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:44.687065  1546 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:44.640413  5394 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:01:44.689338  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:44.694569  1546 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:44.695936  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.696290  5338 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.697167  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.698060  1546 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:44.699595  5447 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.700327  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.700186  5447 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.702129  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.703858  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:44.704506  1538 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:44.705354  5530 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:01:44.705627  5176 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:44.709585  5176 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:44.710398  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:44.711390  5502 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:44.711910  5502 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:44.716373  2257 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:44.719261  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:44.717492  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:44.702193  5447 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:44.722664  1542 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:44.747463  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.669744  1541 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:44.704633  5522 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:01:44.710376  5257 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:01:44.743206  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 199143us
I20260709 13:01:44.762212  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.772939  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.778940  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.781123  1542 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:01:44.783880  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 212266us
I20260709 13:01:44.781375  1691 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:44.788699  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:44.788913  1619 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:44.777374  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.694271  5496 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:01:44.792361  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:44.793285  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.793623  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:44.788314  1690 pending_rounds.cc:85] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 8
I20260709 13:01:44.736994  5436 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:44.800360  1690 pending_rounds.cc:107] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:44.803041  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:44.804225  1690 raft_consensus.cc:2889] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:44.804561  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.807714  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:44.749645  5511 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:44.722762  5397 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:44.737788  4935 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:44.813874  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.797859  1542 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:44.827095  1619 raft_consensus.cc:2410] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:44.740599  5448 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:44.785884  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:44.712872  5502 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:44.840726  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54952us
I20260709 13:01:44.842368  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.850979  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.852522  1542 raft_consensus.cc:2410] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:44.853272  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.799943  5438 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.762440  5116 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:01:44.816287  5498 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:01:44.803768  5195 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:44.720165  5439 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.871397  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.871862  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:44.869854  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.892122  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.894567  1687 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:44.867619  5530 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:44.865940  5512 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:44.866598  5412 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.866083  4935 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:44.828147  5397 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.900425  1689 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:44.867656  5508 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.803004  5415 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.912441  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:44.894323  5444 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:44.916886  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:44.912633  1546 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:44.862341  5419 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:01:44.861341  5448 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.876514  5511 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:44.918563  1687 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:44.916280  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:44.925146  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 360650us
I20260709 13:01:44.906049  5474 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:44.968880  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1634) took 1095 ms. Trace:
W20260709 13:01:44.913687  5510 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
I20260709 13:01:44.969419  1617 rpcz_store.cc:276] 0709 13:01:43.862911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.863176 (+   265us) service_pool.cc:224] Handling call
0709 13:01:44.957885 (+1094709us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400116a54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:44.958001 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308595072}
I20260709 13:01:44.967687  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:45.208432  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 240825us
I20260709 13:01:44.916445  5508 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:44.975773  5474 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:44.967052  5511 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:44.979779  5510 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:45.088663  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.202332  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.915030  5534 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:44.911361  5512 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:45.085028  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.200413  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 409115us
W20260709 13:01:45.214083  2266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.012s	sys 0.024s
I20260709 13:01:45.220077  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 700) took 1704 ms. Trace:
W20260709 13:01:45.229606  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 482207us
I20260709 13:01:45.230044  1692 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:45.203265  4938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.021s	sys 0.056s
W20260709 13:01:45.219879  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.246038  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.214108  1538 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.509s	user 0.015s	sys 0.000s
I20260709 13:01:45.229470  1618 rpcz_store.cc:276] 0709 13:01:43.509289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.509411 (+   122us) service_pool.cc:224] Handling call
0709 13:01:43.524267 (+ 14856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.528761 (+  4494us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:43.598238 (+ 69477us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.698549 (+100311us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.752469 (+ 53920us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.752631 (+   162us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:43.752664 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.752729 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.581124 (+828395us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b18003e11c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:44.662738 (+ 81614us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b18003e11c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:45.213759 (+551021us) raft_consensus.cc:1685] finished
0709 13:01:45.213803 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.213993 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23202,"prepare.queue_time_us":55984,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":39838,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":35952,"spinlock_wait_cycles":38209152,"thread_start_us":41455,"threads_started":1,"wal-append.queue_time_us":87949}
I20260709 13:01:45.252271  1538 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:45.062451  4935 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:45.219528  5503 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.005s	sys 0.031s
W20260709 13:01:45.263440  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.242424  4938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.021s	sys 0.057s
W20260709 13:01:45.234354  2266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.012s	sys 0.025s
W20260709 13:01:45.234658  5535 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.259s	user 0.003s	sys 0.003s
I20260709 13:01:45.265162  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:45.266182  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.266764  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 478154us
I20260709 13:01:45.249181  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:45.320493  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 512885us
I20260709 13:01:45.225298  5474 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:45.263033  5503 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.005s	sys 0.032s
I20260709 13:01:45.320742  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:45.316440  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.324803  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:45.232275  5536 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:45.381372  1693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.010s	sys 0.026s
W20260709 13:01:45.383733  1693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.010s	sys 0.026s
W20260709 13:01:45.394304  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 145381us
I20260709 13:01:45.395855  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:45.399112  1692 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:45.400877  5279 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:45.402520  5397 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:45.403196  5397 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.410393  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.026s	sys 0.066s
W20260709 13:01:45.410967  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.026s	sys 0.066s
I20260709 13:01:45.370213  5494 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:45.435154  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 522795us
I20260709 13:01:45.380792  5438 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.451030  5438 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:45.414826  5439 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:45.452216  5439 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.453231  5438 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:45.453085  5338 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.007s
W20260709 13:01:45.454567  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 58836.6us
I20260709 13:01:45.460860  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:45.465329  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:45.472450  1692 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:45.473294  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:45.454828  5541 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:45.441759  5546 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:45.489821  1694 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:45.490520  1660 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:45.488595  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:45.507506  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:45.482069  5536 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:45.508210  1621 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:45.508584  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:45.520110  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:45.520486  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:45.403738  5397 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:45.500809  5436 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.023s	sys 0.002s
I20260709 13:01:45.485215  5360 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:01:45.539561  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 275906us
W20260709 13:01:45.508747  1615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.009s	sys 0.017s
W20260709 13:01:45.561018  1615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.017s
I20260709 13:01:45.509501  5494 raft_consensus.cc:2764] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:01:45.510481  5359 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.094s	user 0.015s	sys 0.004s
W20260709 13:01:45.541564  5539 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 13:01:45.507748  5338 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:45.555815  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 235182us
I20260709 13:01:45.524386  5508 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:45.554828  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46303.7us
W20260709 13:01:45.535060  1696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.010s	sys 0.016s
I20260709 13:01:45.433948  5512 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:45.507647  5552 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:45.572072  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1923) took 1186 ms. Trace:
W20260709 13:01:45.581681  1696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.011s	sys 0.017s
I20260709 13:01:45.582443  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:45.558521  5439 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.502173  5546 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:45.606496  5511 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:45.560819  5436 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.002s
I20260709 13:01:45.608096  5510 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:45.641903  5537 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:01:45.647085  1615 rpcz_store.cc:276] 0709 13:01:44.385616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.469937 (+ 84321us) service_pool.cc:224] Handling call
0709 13:01:44.470682 (+   745us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:44.471535 (+   853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.471615 (+    80us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:44.472821 (+  1206us) log.cc:844] Serialized 52 byte log entry
0709 13:01:44.872344 (+399523us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:45.568210 (+695866us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.568688 (+   478us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.571640 (+  2952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.571740 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.571792 (+    52us) raft_consensus.cc:1685] finished
0709 13:01:45.571811 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.571998 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2701,"prepare.queue_time_us":747117,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":53442,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":49120,"spinlock_wait_cycles":5988096,"thread_start_us":1009828,"threads_started":2,"wal-append.queue_time_us":743928}
W20260709 13:01:45.729622  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 156620us
W20260709 13:01:45.682307  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 99962.7us
W20260709 13:01:45.731920  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.732724  1587 leader_election.cc:400] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 6. Current term is 7.
I20260709 13:01:45.684065  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1656) took 1086 ms. Trace:
I20260709 13:01:45.733986  1613 rpcz_store.cc:276] 0709 13:01:44.598080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.652847 (+ 54767us) service_pool.cc:224] Handling call
0709 13:01:44.653130 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.653517 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.653552 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.654015 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.881254 (+227239us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.881318 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.881509 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.683750 (+802241us) raft_consensus.cc:1685] finished
0709 13:01:45.683781 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.683985 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4370,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":101,"thread_start_us":226760,"threads_started":1,"wal-append.queue_time_us":360385}
W20260709 13:01:45.729696  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 118499us
I20260709 13:01:45.679952  1687 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:45.653270  5444 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:45.687804  5551 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.744920  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 163687us
I20260709 13:01:45.746025  5551 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:45.749169  5551 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:45.682809  5540 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
W20260709 13:01:45.711860  5542 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:01:45.680650  5552 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:45.701896  5554 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:01:45.711210  5538 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:01:45.763545  2257 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: [12.13-12.13]
I20260709 13:01:45.764133  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 538) took 1329 ms. Trace:
W20260709 13:01:45.773739  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 1971) took 2519 ms (client timeout 2547 ms). Trace:
I20260709 13:01:45.681542  5338 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:45.787875  1547 rpcz_store.cc:269] 0709 13:01:43.245790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.304027 (+ 58237us) service_pool.cc:224] Handling call
0709 13:01:45.764668 (+2460641us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400257454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:45.764817 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945472384}
I20260709 13:01:45.796697  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:45.787622  1540 rpcz_store.cc:276] 0709 13:01:44.434731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.434946 (+   215us) service_pool.cc:224] Handling call
0709 13:01:44.470036 (+ 35090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.661005 (+190969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.763840 (+1102835us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540038a254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:45.764067 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435320576}
I20260709 13:01:45.799109  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:45.799744  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:45.800099  1617 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
W20260709 13:01:45.774029  5547 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
W20260709 13:01:45.804564  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.807066  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 60752.6us
W20260709 13:01:45.809741  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 77160.6us
I20260709 13:01:45.771130  5415 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:45.774960  5552 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:45.799108  5553 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:01:45.786752  5554 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:45.812984  5556 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:01:45.835788  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:45.840129  1617 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:45.800998  5533 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:45.845189  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:45.851454  1661 leader_election.cc:336] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.955s (SENT)
I20260709 13:01:45.855237  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:45.856184  1617 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:45.860057  1692 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:45.863003  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:45.865728  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 601) took 1152 ms. Trace:
I20260709 13:01:45.828286  5554 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.869904  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:45.874282  1621 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:01:45.876084  1621 pending_rounds.cc:85] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 8
I20260709 13:01:45.877081  1621 pending_rounds.cc:107] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:45.877365  1621 raft_consensus.cc:2889] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:45.913424  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:45.914501  1692 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:45.869697  2266 rpcz_store.cc:276] 0709 13:01:44.707855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.707993 (+   138us) service_pool.cc:224] Handling call
0709 13:01:44.708292 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.708620 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.708644 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.709044 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.292098 (+583054us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.292155 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.292257 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.859839 (+567582us) raft_consensus.cc:1685] finished
0709 13:01:45.859869 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.860053 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1605,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":582652,"threads_started":1,"wal-append.queue_time_us":622580}
W20260709 13:01:45.957458  5570 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:01:45.963594  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 626) took 1213 ms. Trace:
I20260709 13:01:45.964239  1695 rpcz_store.cc:276] 0709 13:01:44.750391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.750518 (+   127us) service_pool.cc:224] Handling call
0709 13:01:44.750855 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.790885 (+ 40030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.790926 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.803033 (+ 12107us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.256215 (+453182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.256286 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.256410 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.402256 (+145846us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b48001d01d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:01:45.963202 (+560946us) raft_consensus.cc:1685] finished
0709 13:01:45.963234 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.963514 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30613,"raft.queue_time_us":35582,"raft.run_cpu_time_us":8410,"raft.run_wall_time_us":613697,"spinlock_wait_cycles":18871552,"thread_start_us":427593,"threads_started":1,"wal-append.queue_time_us":656364}
I20260709 13:01:45.968935  5546 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:45.969982  5503 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.970677  5503 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:45.971621  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 623) took 1232 ms. Trace:
I20260709 13:01:45.973435  5503 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:45.972169  1690 rpcz_store.cc:276] 0709 13:01:44.739189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.740066 (+   877us) service_pool.cc:224] Handling call
0709 13:01:44.788115 (+ 48049us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:44.831317 (+ 43202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.831359 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:44.832015 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:01:45.350717 (+518702us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:45.350844 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.350952 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.971319 (+620367us) raft_consensus.cc:1685] finished
0709 13:01:45.971347 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.971542 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7864,"raft.queue_time_us":10848,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":19953,"thread_start_us":461027,"threads_started":1,"wal-append.queue_time_us":641414}
I20260709 13:01:45.974946  5578 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:45.975459  5578 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:45.975968  5578 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:45.858881  5439 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:01:45.932065  5558 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:01:45.980994  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 540) took 1545 ms. Trace:
I20260709 13:01:45.981097  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1652) took 1456 ms. Trace:
W20260709 13:01:45.982853  5559 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:01:45.984529  5440 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:45.984555  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 622) took 1263 ms. Trace:
I20260709 13:01:45.985270  1688 rpcz_store.cc:276] 0709 13:01:44.721534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.721710 (+   176us) service_pool.cc:224] Handling call
0709 13:01:44.763185 (+ 41475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.789146 (+ 25961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.789176 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.813551 (+ 24375us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.412570 (+599019us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:45.557255 (+144685us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.648689 (+ 91434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.648957 (+   268us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.984328 (+335371us) raft_consensus.cc:1685] finished
0709 13:01:45.984350 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.984488 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18955,"prepare.queue_time_us":193720,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":278965,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":33085,"thread_start_us":715888,"threads_started":3,"wal-append.queue_time_us":705255}
I20260709 13:01:45.987022  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 1988) took 2493 ms. Trace:
I20260709 13:01:45.987385  1545 rpcz_store.cc:276] 0709 13:01:43.495235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.496809 (+  1574us) service_pool.cc:224] Handling call
0709 13:01:44.418592 (+921783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.455932 (+ 37340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.986815 (+1530883us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b5400021050. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:45.986947 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119132032}
I20260709 13:01:45.989317  5548 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:45.982041  5234 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:45.859421  5579 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:45.981607  1542 rpcz_store.cc:276] 0709 13:01:44.435633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.871096 (+435463us) service_pool.cc:224] Handling call
0709 13:01:44.875374 (+  4278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.895770 (+ 20396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.895805 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.896295 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.375674 (+479379us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:45.375721 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.375792 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.980689 (+604897us) raft_consensus.cc:1685] finished
0709 13:01:45.980728 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.980909 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64562,"raft.queue_time_us":24554,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":8523,"thread_start_us":435485,"threads_started":1,"wal-append.queue_time_us":643261}
I20260709 13:01:45.994463  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:46.000960  1692 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:46.005034  1690 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:45.859426  5397 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:45.828879  5415 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.043691  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:45.982555  1614 rpcz_store.cc:276] 0709 13:01:44.524265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.648001 (+123736us) service_pool.cc:224] Handling call
0709 13:01:44.648345 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.665349 (+ 17004us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:44.670098 (+  4749us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.248781 (+578683us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:45.262731 (+ 13950us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.262899 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:45.263101 (+   202us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.263353 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.263423 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.980881 (+717458us) raft_consensus.cc:1685] finished
0709 13:01:45.980902 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.981038 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21416,"prepare.queue_time_us":13055,"raft.queue_time_us":17027,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":57965,"spinlock_wait_cycles":9475328,"thread_start_us":485788,"threads_started":1,"wal-append.queue_time_us":671645}
I20260709 13:01:46.008096  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:45.933271  5545 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
I20260709 13:01:46.046988  1695 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:45.990612  5474 consensus_meta.cc:287] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 13:01:46.061878  5474 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.063057  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 628) took 1312 ms. Trace:
I20260709 13:01:46.064373  5474 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.064774  2261 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:46.051486  5546 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.066514  5546 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.069455  5546 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:46.076048  5565 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:01:46.076749  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:46.079512  5415 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:46.081610  2263 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:46.082265  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 892) took 1661 ms. Trace:
I20260709 13:01:46.082549  2263 rpcz_store.cc:276] 0709 13:01:44.420547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.420640 (+    93us) service_pool.cc:224] Handling call
0709 13:01:46.081289 (+1660649us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5eee 0000000000375939 00007f7f1f8291e0 00007f7f1f8f20c4 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:01:46.081442 (+   153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.082027 (+   585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.082213 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12963712}
W20260709 13:01:46.057632  5279 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.000s
I20260709 13:01:46.063583  1696 rpcz_store.cc:276] 0709 13:01:44.750985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.751152 (+   167us) service_pool.cc:224] Handling call
0709 13:01:44.751416 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.786879 (+ 35463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.786908 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.800575 (+ 13667us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.648757 (+848182us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.685817 (+ 37060us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.798370 (+112553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.798453 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.062784 (+264331us) raft_consensus.cc:1685] finished
0709 13:01:46.062810 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.062988 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106160,"prepare.queue_time_us":36889,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":179963,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":19088,"thread_start_us":895416,"threads_started":2,"wal-append.queue_time_us":1231237}
I20260709 13:01:46.086867  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1751) took 1218 ms. Trace:
W20260709 13:01:46.079710  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 209901us
I20260709 13:01:46.087179  1696 rpcz_store.cc:276] 0709 13:01:44.868733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.085976 (+1217243us) service_pool.cc:224] Handling call
0709 13:01:46.086372 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.086546 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.086569 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.086607 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.086663 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.086719 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.086818 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.053534  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:46.099174  1692 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 9 because replica has last-logged OpId of term: 8 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:01:46.099504  1696 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:46.100415  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1753) took 1186 ms. Trace:
I20260709 13:01:46.100965  1696 rpcz_store.cc:276] 0709 13:01:44.913600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.098892 (+1185292us) service_pool.cc:224] Handling call
0709 13:01:46.099270 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.100093 (+   823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.100353 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.985313  5586 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:46.103039  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 358071us
I20260709 13:01:46.008121  5494 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.008008  5511 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:46.106006  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.020s	sys 0.045s
W20260709 13:01:46.124734  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.021s	sys 0.045s
I20260709 13:01:46.008239  5440 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.126902  1696 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:46.129635  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:46.131960  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1754) took 1164 ms. Trace:
I20260709 13:01:46.133630  1696 rpcz_store.cc:276] 0709 13:01:44.967226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.116523 (+1149297us) service_pool.cc:224] Handling call
0709 13:01:46.126720 (+ 10197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.127583 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.131882 (+  4299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.135782  1696 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:46.137424  1696 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:46.141218  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 624) took 1401 ms. Trace:
I20260709 13:01:46.102389  5393 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.098265  5360 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:46.103009  5546 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.142894  1693 rpcz_store.cc:276] 0709 13:01:44.739549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.739710 (+   161us) service_pool.cc:224] Handling call
0709 13:01:44.740163 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.762308 (+ 22145us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:45.385296 (+622988us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.128259 (+742963us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.128898 (+   639us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.129098 (+   200us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:46.129374 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.134453 (+  5079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.134571 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.141007 (+  6436us) raft_consensus.cc:1685] finished
0709 13:01:46.141025 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.141162 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7745,"prepare.queue_time_us":705910,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":56552,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":23680,"thread_start_us":1194303,"threads_started":2,"wal-append.queue_time_us":724597}
I20260709 13:01:46.147451  1695 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:46.151288  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 315865us
I20260709 13:01:46.007632  5338 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.169982  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:46.172016  1622 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:46.142163  5503 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.141866  5439 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:46.184221  1617 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:46.052977  5579 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.172251  5567 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.132982  5440 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.151371  5393 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.142313  5590 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.148907  5585 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.170687  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:46.151330  5504 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.002s	sys 0.014s
I20260709 13:01:46.207857  1690 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:46.232295  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 541) took 1796 ms. Trace:
W20260709 13:01:46.216073  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 86551us
I20260709 13:01:46.239161  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:46.213820  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.240584  1541 rpcz_store.cc:276] 0709 13:01:44.436274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.875224 (+438950us) service_pool.cc:224] Handling call
0709 13:01:44.901970 (+ 26746us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.916436 (+ 14466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.916469 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.916961 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:01:45.479117 (+562156us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:45.500470 (+ 21353us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.231884 (+731414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.231985 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.232025 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:46.232037 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.232218 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751349,"prepare.queue_time_us":21842,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":14111,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":43566,"thread_start_us":257687,"threads_started":1,"wal-append.queue_time_us":852021}
I20260709 13:01:46.197486  5313 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.182605  5326 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:46.243824  1690 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: [3.3-7.5]
I20260709 13:01:46.243991  1614 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:46.244298  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 153427us
I20260709 13:01:46.250453  5550 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.126996  5494 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.127363  5586 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:46.254216  5583 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:01:46.254827  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:46.254963  5359 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.254647  5360 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.256054  5439 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.256209  5412 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:46.254840  5099 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.257965  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:46.231757  5504 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.002s	sys 0.014s
I20260709 13:01:46.167807  5546 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.265717  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:46.283113  1695 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:46.284639  1695 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:46.193858  5578 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.259346  4935 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:46.275543  1587 leader_election.cc:400] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 8. Current term is 10.
I20260709 13:01:46.252200  5326 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:46.272254  5359 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:46.280964  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 956284us
I20260709 13:01:46.281107  1690 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260709 13:01:46.281255  5099 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.288350  4935 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.318011  4935 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.319712  5586 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.231789  5590 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.284238  5412 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.322840  5554 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.325145  5554 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.325443  5412 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.287461  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:46.271346  5447 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.226553  5567 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.314802  5596 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.326766  5447 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.326938  5596 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:46.329969  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.311964  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:46.330732  2262 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:01:46.332397  5106 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:46.332763  5494 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.332774  5106 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.245699  5585 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.333451  5106 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.277801  5279 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:01:46.333794  5479 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:46.335147  5585 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.335530  5479 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:46.336105  5546 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.336028  5564 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:46.337639  1511 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:46.339116  5326 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:46.339623  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 64278.9us
I20260709 13:01:46.340277  5326 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.315542  5359 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.343245  5359 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.343995  5359 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:46.344429  5359 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:46.344769  5359 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.317440  5099 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.258829  5313 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.281817  5436 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:46.339104  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:46.353168  5359 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.355024   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:46.355895  1692 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:46.364570  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2426) took 1916 ms (client timeout 1648 ms). Trace:
I20260709 13:01:46.351786  5567 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.266044  5550 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.322363  5590 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:46.355564  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68227.4us
I20260709 13:01:46.319626  5440 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.399473  1689 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:46.398202  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:46.365417  1544 rpcz_store.cc:269] 0709 13:01:44.438775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.355023 (+1916248us) service_pool.cc:211] Skipping call since client already timed out
0709 13:01:46.355138 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:01:46.354727  5436 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.364108  5099 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:46.412552  5448 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:46.421270  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:46.414755  5440 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:46.423123  5440 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:46.423501  5440 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:46.394003  5479 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.426951  5479 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.428769  5550 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.429409  5479 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.429673  5596 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:46.429816  5593 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:46.431183  5106 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.432799  5585 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:46.433176  5585 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:46.433398  5106 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.364537  5586 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.434845  5586 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.433943  5585 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.435238  5586 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.435506  5313 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.435917  5585 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.436046  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:46.413507  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1654) took 1845 ms (client timeout 1712 ms). Trace:
I20260709 13:01:46.437016  5578 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:46.437248  1619 rpcz_store.cc:269] 0709 13:01:44.567998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.633338 (+ 65340us) service_pool.cc:224] Handling call
0709 13:01:46.413306 (+1779968us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400231c54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:46.413434 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355665664}
I20260709 13:01:46.387959  5554 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:46.393229  5439 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.438344  5554 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.438555  5439 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.339622  5549 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.387933  5397 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:46.440055  5397 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.415026  5436 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:46.440657  5554 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.442195  5397 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.442601  5418 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.363762  5546 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:01:46.444497  5546 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:46.444828  5546 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:46.409622  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.447476  1695 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 13. (term mismatch)
I20260709 13:01:46.447989  1695 pending_rounds.cc:85] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 12
I20260709 13:01:46.448276  1695 pending_rounds.cc:107] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 13:01:46.448570  1695 raft_consensus.cc:2889] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:46.351794  5444 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.467696  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:46.366071  4938 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:01:46.474045  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:46.477653  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:46.484891  2262 raft_consensus.cc:2410] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:01:46.410210  5359 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.440764  5439 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.486855  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:46.497908  5520 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:46.498392  5520 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.499039  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:46.499701  1691 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:46.499364  5520 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.500794  5520 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.501011  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:46.501916  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:46.502552  5564 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:46.504315  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:46.517199  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:46.517897  1688 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.478420  5549 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:01:46.445622  5546 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:46.520747  5546 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:46.485734  5313 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.411314  5590 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:01:46.522807  5567 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:46.523283  5567 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.523671  5567 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:46.525468  5606 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:01:46.478793  5099 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.527397  5099 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.528797  5106 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:46.530259  5412 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:46.531001  5412 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.539820  5550 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:46.541287  5550 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:46.541779  5550 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.549199  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:46.477952  5444 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.515580  5564 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.494983  5479 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:01:46.563868  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:46.564536  1542 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:46.532218  5412 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:46.570000  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:46.584576  1542 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:46.577350  1545 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:46.554526  5313 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:46.601567  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 539) took 2166 ms. Trace:
I20260709 13:01:46.603564  1541 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:01:46.605857  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:46.603525  1543 rpcz_store.cc:276] 0709 13:01:44.435202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.435350 (+   148us) service_pool.cc:224] Handling call
0709 13:01:44.474456 (+ 39106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.475433 (+   977us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:44.587699 (+112266us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.968607 (+380908us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.210469 (+241862us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.196621 (+986152us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b18004918c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1e7ae58f 00007f7f177ed571 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd
0709 13:01:46.214417 (+ 17796us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.221632 (+  7215us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.221851 (+   219us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:46.567703 (+345852us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.601053 (+ 33350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.601214 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.601285 (+    71us) raft_consensus.cc:1685] finished
0709 13:01:46.601302 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.601484 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2447733,"prepare.queue_time_us":194932,"prepare.run_cpu_time_us":302,"prepare.run_wall_time_us":5416,"raft.queue_time_us":1305033,"raft.run_cpu_time_us":583,"raft.run_wall_time_us":61313,"spinlock_wait_cycles":14550144,"thread_start_us":676372,"threads_started":3,"wal-append.queue_time_us":682301}
I20260709 13:01:46.554811  5106 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.614023  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:46.617486  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:46.606575  1542 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:46.597846  5195 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:46.623703  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:46.624384  1543 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11. Re-sending same reply.
I20260709 13:01:46.631191  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:46.603904  5491 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:46.634963  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:46.562004  1688 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:46.643502  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2377) took 1140 ms. Trace:
I20260709 13:01:46.643980  1688 rpcz_store.cc:276] 0709 13:01:45.503262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.987274 (+484012us) service_pool.cc:224] Handling call
0709 13:01:46.516990 (+529716us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:01:46.643424 (+126434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16045952}
I20260709 13:01:46.626362  5569 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:46.622812  5590 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:46.671272  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.639879  5593 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:46.637844  5585 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:01:46.666999  5569 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.667249  5474 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:46.672039  5552 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.000s
I20260709 13:01:46.622682  5550 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.675457  5176 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.643921  5491 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.663972  5436 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.677672  5593 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.676723  5590 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:46.744308  5614 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:01:46.750689  5609 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:01:46.751214  5608 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:01:46.668630  5564 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.721585  5474 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:46.755972  4935 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.760784  5436 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.688880  5569 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:46.741677  5593 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:46.788221  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 285497us
W20260709 13:01:46.799130  1693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.036s	sys 0.044s
W20260709 13:01:46.811149  1693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.037s	sys 0.045s
W20260709 13:01:46.814822  1587 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.648s (SENT)
W20260709 13:01:46.825232  1587 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.884s (SENT)
I20260709 13:01:46.825821  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:46.798930  5504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.055s	sys 0.084s
W20260709 13:01:46.848743  1587 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.978s (SENT)
W20260709 13:01:46.852581  1587 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.978s (SENT)
I20260709 13:01:46.853087  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:46.787015  4935 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.693747  5552 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.812289  5550 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:46.851184  5504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.059s	sys 0.088s
W20260709 13:01:46.858515  1587 leader_election.cc:336] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.172s (SENT)
W20260709 13:01:46.860252  2261 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.019s	sys 0.010s
I20260709 13:01:46.690202  5106 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.811645  5502 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:46.756057  5474 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.726722  5176 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.774803  5590 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:46.874079  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.883085  1587 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:46.868404  2261 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.019s	sys 0.010s
I20260709 13:01:46.850044  5436 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:46.870082  5195 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:46.888907  5479 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:46.919970  5582 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.962s	user 0.004s	sys 0.001s
I20260709 13:01:46.919871  5479 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.922195  5479 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.923487  5586 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.925642  5586 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:46.928360  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 69874us
I20260709 13:01:46.928824  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1762) took 1452 ms. Trace:
I20260709 13:01:46.929898  5195 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:46.888590  5552 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.899390  5440 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.890816  5444 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:46.929189  1693 rpcz_store.cc:276] 0709 13:01:45.476733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.151829 (+675096us) service_pool.cc:224] Handling call
0709 13:01:46.152076 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.246839 (+ 94763us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:46.265655 (+ 18816us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.838647 (+572992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.838732 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.838824 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.928583 (+ 89759us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b54001f63d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:46.928623 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.928764 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17043,"prepare.queue_time_us":21285,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3267,"raft.queue_time_us":25234,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5062,"spinlock_wait_cycles":217374464,"thread_start_us":555410,"threads_started":1,"wal-append.queue_time_us":661009}
I20260709 13:01:46.873054  5439 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:46.948365  1587 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.247s (SENT)
I20260709 13:01:46.959546  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:46.962584  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1755) took 1944 ms. Trace:
I20260709 13:01:46.962646  5567 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.963186  1692 rpcz_store.cc:276] 0709 13:01:45.018296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.127971 (+1109675us) service_pool.cc:224] Handling call
0709 13:01:46.150566 (+ 22595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.364289 (+213723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.962333 (+598044us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54002f49d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:46.962523 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471700352}
W20260709 13:01:46.967823  1587 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.432s (SENT)
I20260709 13:01:46.968466  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:46.914937  5554 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:46.933930  5447 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:46.982173  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 714) took 2205 ms. Trace:
I20260709 13:01:46.982672  1616 rpcz_store.cc:276] 0709 13:01:44.774425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.791863 (+ 17438us) service_pool.cc:224] Handling call
0709 13:01:44.801551 (+  9688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.894103 (+ 92552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.894150 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.894207 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:44.894255 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.979781 (+2085526us) spinlock_profiling.cc:243] Waited 92.3 ms on lock 0x7b5400062054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:46.979841 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.980021 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212294528}
I20260709 13:01:46.990041  5439 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:46.990640  5569 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.916227  5502 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:46.972599  5436 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:47.002737  5440 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.003309  5502 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.005606  5567 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:46.941565  5593 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:46.990247  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.016860  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.021271  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.025728  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.026643  1695 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.029497  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:47.047875  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.051116  1695 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:47.051975  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:47.052637  1587 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.622s (SENT)
I20260709 13:01:47.053110  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:47.055454  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.058923  1546 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:47.063081  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.063367  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.063829  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:47.064297  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.064644  2262 raft_consensus.cc:2368] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:01:47.065325  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.067040  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.068111  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.069124  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.069624  1538 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:47.071409  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.072144  1542 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.072317  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:47.072566  1587 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.820s (SENT)
I20260709 13:01:47.072844  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.072966  1546 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:47.073032  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:47.073979  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1747) took 2207 ms. Trace:
I20260709 13:01:47.074565  1689 rpcz_store.cc:276] 0709 13:01:44.866299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.913966 (+ 47667us) service_pool.cc:224] Handling call
0709 13:01:44.963596 (+ 49630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.400004 (+1436408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.073763 (+673759us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000b45d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:47.073926 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302072576}
I20260709 13:01:47.074018  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:47.076576  5618 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:47.076798  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.078461  5569 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.079770  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.080368  1687 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.073042  1547 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.083214  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.085630  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.073935  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.088047  1542 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.088546  1687 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:01:47.070403  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.091596  1538 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:01:47.094264  1544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.011s	sys 0.016s
W20260709 13:01:47.094808  1544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.011s	sys 0.016s
I20260709 13:01:47.097546  1585 leader_election.cc:400] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:01:47.097951  1585 leader_election.cc:403] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:47.105069  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.061492  5436 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:47.073958  5440 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:47.096868  5546 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.008s
I20260709 13:01:47.118785  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.117384  1542 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:47.151738  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:47.161015  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.109529  5554 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:47.171747  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.176599  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:47.179791  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47681.3us
I20260709 13:01:47.182114  5393 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:47.185264  5176 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:47.186499  5624 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:47.193276  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:47.194402  1616 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.174033  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.194926  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:47.098428  5569 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:01:47.194851  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.196759  1542 raft_consensus.cc:2368] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10.
I20260709 13:01:47.196244  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.199393  5579 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:47.207311  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.208438  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.211954  1615 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:47.196013  1547 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:47.213461  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.192947  1546 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:47.216488  1619 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:01:47.224200  1615 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:47.228256  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:47.271041  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.272773  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.273557  1617 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:47.274717  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.275471  1614 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:47.277449  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.277381  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:47.279793  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.279868  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.280853  1619 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.280920  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:47.215555  5436 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:47.300309  1616 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:47.304996  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:47.306262  1546 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:47.302349  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.302419  1616 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:47.307860  1547 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.301927  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.312757  1542 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:01:47.301457  5546 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:47.307571  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:47.320574  1546 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.321795  1541 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:47.325459  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.326470  1614 raft_consensus.cc:2410] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:01:47.322512  5548 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.036s
I20260709 13:01:47.331339  1547 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:47.406476  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.407462  2260 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:47.409621  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.354020  5436 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:47.365850  1694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2370) took 3002 ms (client timeout 1978 ms). Trace:
W20260709 13:01:47.424767  1694 rpcz_store.cc:269] 0709 13:01:44.363756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.363950 (+   194us) service_pool.cc:224] Handling call
0709 13:01:47.365637 (+3001687us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540012d9d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:47.365769 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516025216}
I20260709 13:01:47.371876  1540 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:47.382922  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.426923  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.427733  1691 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.428515  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.429754  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.430549  1689 raft_consensus.cc:2368] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
W20260709 13:01:47.370380  5548 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.018s	sys 0.036s
I20260709 13:01:47.431360  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.380566  5593 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.432482  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.433233  1689 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.433976  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.437228  5439 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:47.438839  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.418697  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:47.366460  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.382730  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 946) took 1100 ms. Trace:
I20260709 13:01:47.342296  1542 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:47.441009  2261 rpcz_store.cc:276] 0709 13:01:46.282591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.283228 (+   637us) service_pool.cc:224] Handling call
0709 13:01:46.289151 (+  5923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.289349 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:46.289653 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.372323 (+1082670us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.372971 (+   648us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.382227 (+  9256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.382301 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:47.382367 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.382457 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.382655 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8768,"prepare.queue_time_us":22259,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":30976,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":4962,"spinlock_wait_cycles":10468992,"thread_start_us":1073542,"threads_started":2,"wal-append.queue_time_us":688174}
I20260709 13:01:47.446905  1691 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.449591  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.434556  1689 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:47.451565  1691 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:47.452735  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.453572  1691 raft_consensus.cc:2376] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9. Re-sending same reply.
I20260709 13:01:47.462824  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.463431  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.364610  1546 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:47.411327  5116 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:47.498668  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.499738  1689 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:47.501051  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:47.476527  5536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.893s	user 0.014s	sys 0.013s
W20260709 13:01:47.511943  5536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.936s	user 0.014s	sys 0.013s
I20260709 13:01:47.512498  5536 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:47.514786  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.515652  1691 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:47.496722  2260 raft_consensus.cc:2410] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:47.497057  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.526271  2262 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:47.526679  1547 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:47.527226  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:47.528324  1546 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:01:47.531030  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.532423  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.418915  5579 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 13:01:47.544289  2262 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:47.418682  5503 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:01:47.548216  1546 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:47.516563  5116 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.558256  1546 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:47.559482  5116 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:47.494978  5439 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.561841  5439 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.563360  5394 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:47.563776  5394 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:47.564260  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.564589  5394 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.565649  1546 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:47.565764  5394 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:47.565955  2260 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:01:47.567212  5641 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:01:47.568760  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1761) took 2109 ms. Trace:
I20260709 13:01:47.576882  1617 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:47.513798  5536 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:47.589313  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 899) took 2324 ms. Trace:
I20260709 13:01:47.589890  2257 rpcz_store.cc:276] 0709 13:01:45.264386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.264516 (+   130us) service_pool.cc:224] Handling call
0709 13:01:45.264840 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:45.787249 (+522409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.588919 (+1801670us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54003ad4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:47.589195 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1146193664}
I20260709 13:01:47.593803  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:47.595294  5636 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:01:47.596452  5637 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:01:47.597612  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.598491  1615 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:47.605922  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.606091  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.617550  1616 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:47.618568  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.620534  1615 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:47.607232  1693 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:01:47.607793  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:47.621729  1695 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
W20260709 13:01:47.615783  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 377876us
W20260709 13:01:47.616350  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 45760.3us
W20260709 13:01:47.615790  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.569206  1696 rpcz_store.cc:276] 0709 13:01:45.459565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.138832 (+679267us) service_pool.cc:224] Handling call
0709 13:01:46.139181 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.169025 (+ 29844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.169094 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.181182 (+ 12088us) log.cc:844] Serialized 26 byte log entry
0709 13:01:46.926380 (+745198us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18003dd2c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:01:47.169017 (+242637us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:47.169076 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.169209 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.568412 (+399203us) raft_consensus.cc:1685] finished
0709 13:01:47.568439 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.568692 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73662,"raft.queue_time_us":33149,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":18409,"spinlock_wait_cycles":41667328,"thread_start_us":242356,"threads_started":1,"wal-append.queue_time_us":1204978}
W20260709 13:01:47.623196  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51583.2us
I20260709 13:01:47.464355  5436 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:47.624073  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.027s
W20260709 13:01:47.624382  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.027s
I20260709 13:01:47.624292  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:47.619778  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:47.625589  1689 raft_consensus.cc:2368] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:01:47.544301  5533 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:47.639690  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:47.635551  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:47.614569  5618 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:47.636615  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:47.641971  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.647482  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:47.630834  5496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.758s	user 0.041s	sys 0.032s
I20260709 13:01:47.641875  2261 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:47.716398  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.003s	sys 0.038s
W20260709 13:01:47.739590  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.003s	sys 0.038s
I20260709 13:01:47.622036  5440 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:47.723568  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 495419us
W20260709 13:01:47.749732  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.750164  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.724620  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 82389.6us
I20260709 13:01:47.752302  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:47.727357  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 79986.5us
I20260709 13:01:47.644552  5439 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.643419  1615 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:47.729182  5621 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.716490  5612 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:01:47.646230  5533 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.801767  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:47.751502  5496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.875s	user 0.042s	sys 0.038s
I20260709 13:01:47.812675  1615 raft_consensus.cc:2393] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:47.732697  5632 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:47.819666  5106 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:47.824556  5106 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:47.825086  5640 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:01:47.825263  5546 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:47.825795  5546 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:47.825652  5106 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:47.826596  5644 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:01:47.827937  1615 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:01:47.828238  5642 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:01:47.829305  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 550) took 1270 ms. Trace:
I20260709 13:01:47.829656  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:47.830053  5257 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:47.830858  5393 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:47.831501  5393 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.833813  5393 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.835153  5646 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:47.835697  5646 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.836105  5646 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:47.840420  5438 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:47.841019  5438 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.843891  5546 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.844724  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:47.845118  5554 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.000s
I20260709 13:01:47.845522  5554 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:01:47.840260  5195 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.829694  1539 rpcz_store.cc:276] 0709 13:01:46.558508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.558648 (+   140us) service_pool.cc:224] Handling call
0709 13:01:46.602404 (+ 43756us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.898976 (+296572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.899006 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.902891 (+  3885us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.083449 (+180558us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b48000030d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:01:47.213893 (+130444us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:47.213931 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.213990 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.829051 (+615061us) raft_consensus.cc:1685] finished
0709 13:01:47.829071 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.829251 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39138,"raft.run_cpu_time_us":2694,"raft.run_wall_time_us":427842,"spinlock_wait_cycles":10377088,"thread_start_us":578587,"threads_started":2,"wal-append.queue_time_us":566656}
W20260709 13:01:47.866178  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.012s
W20260709 13:01:47.867483  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.012s
I20260709 13:01:47.895916  5436 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.813232  5621 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.900041  5491 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.900918  5621 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.800917  5439 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:47.799527  5440 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:47.830538  5257 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:47.748121  5415 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.101s
W20260709 13:01:47.925992  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.927317  5257 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:47.929263  5257 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:47.933234  5440 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.935355  5439 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:47.942436  1616 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:47.863610  5393 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:47.909699  5621 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.950088  1614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.046s	sys 0.023s
W20260709 13:01:47.950716  1614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.047s	sys 0.023s
I20260709 13:01:47.945575  5393 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.879323  5394 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:01:47.959214  5393 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:47.963212  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.029s	sys 0.038s
W20260709 13:01:47.964627  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.029s	sys 0.038s
I20260709 13:01:47.945749  5438 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:47.946467  5415 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:47.998278  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.974895  5533 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:48.056695  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 1.74872e+06us
I20260709 13:01:48.068523  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:47.952697  5621 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:47.977463  5415 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:48.073149  1661 connection.cc:256] RPC call timeout handler was delayed by -1.7486413859999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:01:48.076565  5491 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.084609  5491 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:48.085938  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6739413859999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260709 13:01:48.066917  5438 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.086759  5536 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.089388  4938 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:48.085011  5491 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:48.102376  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.019s	sys 0.006s
W20260709 13:01:48.105007  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.019s	sys 0.006s
W20260709 13:01:48.092423  1661 connection.cc:256] RPC call timeout handler was delayed by -1.6091413859999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 13:01:48.108275  1661 connection.cc:256] RPC call timeout handler was delayed by -1.4282413859999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2049s for a response
W20260709 13:01:48.112126  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 266173us
I20260709 13:01:48.113250  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:48.112344  1661 connection.cc:256] RPC call timeout handler was delayed by -1.389541386000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:01:48.116125  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1437820399999623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:01:48.091037  5536 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.093242  4938 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:48.115474  5338 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.154479  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.760s (SENT) [suppressed 21 similar messages]
W20260709 13:01:48.159142  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44754.3us
I20260709 13:01:48.125548  5533 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:48.169840  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:48.181773  1659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.007s	sys 0.081s
W20260709 13:01:48.182224  1659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.082s
I20260709 13:01:48.171573  5579 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:48.172591  5646 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.136674  5575 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.095741  5438 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.174279  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.175930  5653 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.177577  5536 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:48.179522  4938 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:48.182710  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 558622us
W20260709 13:01:48.215760  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 462004us
I20260709 13:01:48.200928  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.217562  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.218158  1621 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:48.171591  5621 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:48.181437  5533 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:48.185314  5579 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:48.219866  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:48.224459  1587 leader_election.cc:400] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:01:48.220412  1622 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.223338  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.223670  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.228070  5667 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:48.232115  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.233225  1620 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:01:48.134912  5415 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.216468  5536 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.239926  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.194665  5338 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.238336  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:48.246018  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 493834us
I20260709 13:01:48.248116  2261 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:01:48.222681  5567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.018s	sys 0.042s
I20260709 13:01:48.223031  5439 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.230477  5533 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.292662  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.293345  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.234431  5440 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.200023  5575 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:48.297163  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58921us
I20260709 13:01:48.301885  1621 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.302515  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.250005  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.314373  1617 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:48.222885  5549 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:01:48.301169  5612 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:48.327934  5612 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.328413  5612 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:48.330281  1621 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.223176  5491 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.331588  1621 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:48.331965  5491 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:48.332602  1544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.013s	sys 0.035s
W20260709 13:01:48.332923  1544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.013s	sys 0.035s
I20260709 13:01:48.247068  5436 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:48.332206  5645 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.579s	user 0.000s	sys 0.003s
W20260709 13:01:48.326263  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76365.2us
I20260709 13:01:48.292085  5415 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.336587  1622 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
W20260709 13:01:48.337091  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.346242  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:48.349294  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:48.360760  1541 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:01:48.292493  5536 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.244699  5632 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:01:48.219978  5653 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:48.336020  5546 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.324412  5554 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:48.357981  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.372298  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.374765  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:48.343822  5629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.020s	sys 0.032s
W20260709 13:01:48.380628  5664 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:01:48.383038  5662 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:01:48.390717  5676 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:48.392820  5338 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:48.395370  5646 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:48.359511  5658 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
W20260709 13:01:48.417368  5650 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:48.407133  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.299302  5439 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.366755  5436 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:48.441092  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 320960us
I20260709 13:01:48.316195  5579 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.335675  5440 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.428898  5672 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:48.435352  5663 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:48.442180  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.422403  5576 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:48.414717  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:48.409447  5554 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.458477  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:48.443816  5436 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.468825  1661 leader_election.cc:400] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10.
I20260709 13:01:48.462162  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:48.454101  5672 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.478281  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:48.480356  5533 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.482836  5576 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:48.484159  5576 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.485221  5533 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:48.466603  5674 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.460948  5279 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:48.489066  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:01:48.471150  5106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.001s	sys 0.032s
I20260709 13:01:48.467689  5436 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:48.469597  5579 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.453572  5646 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:01:48.475471  5672 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:48.472333  5438 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:48.508816  1696 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.019s	sys 0.056s
W20260709 13:01:48.518919  1696 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.020s	sys 0.056s
W20260709 13:01:48.506088  5106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.001s	sys 0.032s
I20260709 13:01:48.503768  5674 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.488341  5414 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:48.505877  5568 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.524436  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 561) took 1417 ms. Trace:
I20260709 13:01:48.543157  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:01:48.589815  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46798us
W20260709 13:01:48.592025  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 427011us
I20260709 13:01:48.591336  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:48.513679  5676 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:48.510537  5533 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.587410  1542 rpcz_store.cc:276] 0709 13:01:47.106956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.443989 (+337033us) service_pool.cc:224] Handling call
0709 13:01:47.444425 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:47.444891 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.444930 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:47.461284 (+ 16354us) log.cc:844] Serialized 52 byte log entry
0709 13:01:48.107458 (+646174us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.107517 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.107612 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.524123 (+416511us) raft_consensus.cc:1685] finished
0709 13:01:48.524154 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.524355 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48815,"raft.queue_time_us":770,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14895,"thread_start_us":559383,"threads_started":1,"wal-append.queue_time_us":777300}
I20260709 13:01:48.605566  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.621155  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.519845  5279 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:48.613274  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 548) took 2056 ms. Trace:
I20260709 13:01:48.525889  5646 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.567858  5590 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:48.567065  5438 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:48.523741  5575 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:48.605276  5577 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:48.637441  1544 rpcz_store.cc:276] 0709 13:01:46.556713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.556852 (+   139us) service_pool.cc:224] Handling call
0709 13:01:46.557266 (+   414us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:47.095288 (+538022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.095338 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:47.128583 (+ 33245us) log.cc:844] Serialized 78 byte log entry
0709 13:01:47.617228 (+488645us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.343181 (+725953us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.612882 (+269701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.612960 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:48.613005 (+    45us) raft_consensus.cc:1685] finished
0709 13:01:48.613018 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.613197 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2675,"prepare.queue_time_us":887379,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3448,"raft.queue_time_us":178358,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":14824,"thread_start_us":1904871,"threads_started":4,"wal-append.queue_time_us":685938}
I20260709 13:01:48.601902  5674 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.662555  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 360254us
I20260709 13:01:48.629575  5568 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:48.672323  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.650764  5533 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.649693  5536 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:48.650678  5590 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:48.665858  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 187666us
W20260709 13:01:48.686200  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 94995.7us
I20260709 13:01:48.690172  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:48.696262  5393 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.007s
I20260709 13:01:48.696769  5393 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.680721  5682 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:48.697645  5682 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.698014  5682 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.697886  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.700018  1544 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:48.701363  1542 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:48.671260  5577 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:48.702911  5577 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.686118  5690 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:48.676486  5685 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:48.706176  5685 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.706570  5685 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:48.711735  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.677815  5533 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:48.719352  5676 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:48.686955  5590 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:48.727129  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 106053us
I20260709 13:01:48.728468  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.729868  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.689285  5568 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:48.712147  5439 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:48.741405  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 1941) took 1237 ms. Trace:
I20260709 13:01:48.718000  5440 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:48.741849  1616 rpcz_store.cc:276] 0709 13:01:47.503860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.633662 (+129802us) service_pool.cc:224] Handling call
0709 13:01:48.741230 (+1107568us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002a76d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:48.741345 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694159744}
I20260709 13:01:48.747399  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:48.749013  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 341984us
I20260709 13:01:48.751255  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:48.752162  1695 raft_consensus.cc:2410] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:01:48.747416  5536 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:48.753124  1688 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.754084  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:48.746438  5393 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:48.755370  5393 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:48.755748  5393 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:48.755755  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:48.714771  5279 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.756763  5393 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:48.762728  5681 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:01:48.778518  1693 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.743733  5575 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:48.767678  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.688122  5671 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:01:48.737573  5588 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:48.746517  5688 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:01:48.770771  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.772163  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.751120  5440 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:48.736811  5686 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:01:48.734012  5646 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:48.767019  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.783432  5693 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.784526  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 97758.1us
I20260709 13:01:48.803402  1687 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:48.788606  5438 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:48.741900  5695 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:48.814697  1693 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:48.823824  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:48.813606  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.772804  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:48.778332  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:48.832497  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:48.825831  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75663.8us
I20260709 13:01:48.844578  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:48.835386  5257 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.906s	user 0.010s	sys 0.005s
I20260709 13:01:48.809520  5575 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.753662  5536 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 13:01:48.805109  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:48.868731  2262 raft_consensus.cc:2410] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:48.840255  5393 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:48.887038  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.887943  1617 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 6.
I20260709 13:01:48.889154  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:48.889842  1617 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:48.845978  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:48.749431  5680 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:01:48.834486  5546 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:48.856564  5439 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:48.893409  1616 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:48.895612  1687 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:48.867980  5575 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:48.877178  5491 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.542s	user 0.013s	sys 0.000s
W20260709 13:01:48.903383  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 57487.8us
I20260709 13:01:48.837940  5440 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.911177  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.910516  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:48.878208  5536 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:48.914054  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:48.915508  1694 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:48.917296  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.921176  1617 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:48.922216  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:48.901152  5612 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.001s
I20260709 13:01:48.924512  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:48.928797  1694 raft_consensus.cc:2468] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 7.
I20260709 13:01:48.867574  5629 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:01:48.926083  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:48.932962  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.933439  1616 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:48.925205  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:48.933584  1620 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:48.895385  5700 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.906466  5564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.033s	user 0.009s	sys 0.018s
I20260709 13:01:48.935643  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:48.847020  5693 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.914356  5697 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:48.914897  5687 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:48.949204  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:48.937034  5438 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.950086  1620 raft_consensus.cc:2410] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:01:48.953894  5705 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:01:48.954449  5693 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:48.931445  5546 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:48.940946  5564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.072s	user 0.010s	sys 0.019s
I20260709 13:01:48.839676  5568 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.937813  5702 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.941438  5710 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:48.924240  5707 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:01:48.962235  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45004.3us
W20260709 13:01:48.910956  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 70660.8us
I20260709 13:01:48.983536  5702 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.987818  5682 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:48.989802  5415 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.004s
I20260709 13:01:48.936538  5612 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:48.989928  5685 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.972851  5436 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.979907  5546 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:49.049780  5546 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:48.959296  5629 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:48.944284  5700 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.060716  5629 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.061585  5629 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.062314  5700 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.062801  5629 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.064216  5707 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:48.973649  5698 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:01:48.958794  5689 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:01:49.064854  5707 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.001080  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:49.002589  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:49.067443  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64954.7us
W20260709 13:01:49.003255  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 161738us
W20260709 13:01:48.974798  5691 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:01:48.983964  5710 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:48.948243  5697 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:48.971837  5692 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.032626  1692 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:48.972744  5709 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.972487  5440 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:48.985723  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:49.040016  5674 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.041090  5436 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:49.042831  5672 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.001s
I20260709 13:01:49.087818  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:49.092268  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 91300.5us
I20260709 13:01:49.093242  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.043742  5612 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.048379  5702 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.072615  1691 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:49.080928  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 248531us
I20260709 13:01:48.974251  5590 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.105474  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.083753  5687 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:49.076999  5710 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.104140  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.103442  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.111209  1616 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:49.108042  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.112205  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.114519  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:49.119618  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2861991490000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:01:49.121248  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.148321  2261 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:49.122939  1546 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:01:49.128762  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:49.139919  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1670) took 1912 ms. Trace:
I20260709 13:01:49.149677  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.108796  5713 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.142477  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.144997  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.109555  5692 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.096335  5634 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.145959  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:49.148569  1539 raft_consensus.cc:2410] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:01:49.082304  5709 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.152333  1538 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:49.153469  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.105556  5440 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:49.096837  5671 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:49.107788  5579 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.006s
I20260709 13:01:49.150384  1613 rpcz_store.cc:276] 0709 13:01:47.227639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.227781 (+   142us) service_pool.cc:224] Handling call
0709 13:01:47.228154 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.255001 (+ 26847us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.255059 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:47.276808 (+ 21749us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.758112 (+481304us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.817069 (+ 58957us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.769287 (+952218us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b1800387220. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:01:49.114076 (+344789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.114172 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.114215 (+    43us) raft_consensus.cc:1685] finished
0709 13:01:49.139678 (+ 25463us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.139852 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26365,"prepare.queue_time_us":56964,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":70424,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":21025,"spinlock_wait_cycles":68779904,"thread_start_us":786357,"threads_started":2,"wal-append.queue_time_us":754152,"wal-append.run_cpu_time_us":2504,"wal-append.run_wall_time_us":1016216}
I20260709 13:01:49.087261  5550 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:01:49.106112  5564 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.154090  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.099882  5672 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.183229  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.121094  5687 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.130947  5438 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:49.181946  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.184746  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.192035  1613 raft_consensus.cc:2368] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13.
I20260709 13:01:49.194890  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.181020  5436 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.202503  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.199047  5693 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.183403  5702 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.210247  1544 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:49.215041  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.191105  5440 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:49.189100  5550 consensus_queue.cc:1243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:49.207772  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.198124  5692 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:49.195644  5687 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:49.252667  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.257266  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63747us
I20260709 13:01:49.258992  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.262346  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.262503  1616 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:49.259783  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.181761  5634 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.189188  5709 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.288050  1587 leader_election.cc:400] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
W20260709 13:01:49.288702  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 148341us
I20260709 13:01:49.293646  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.297634  1616 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:01:49.294220  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:49.299532  5701 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:49.304600  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.304876  1618 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:49.305236  1540 raft_consensus.cc:2376] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
I20260709 13:01:49.260758  5702 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.194499  5564 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.209527  5438 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.251704  5440 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.185978  5713 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.166036  5697 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.192960  5671 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.307338  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:49.195959  5722 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:01:49.307885  5702 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:49.312167  5634 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:49.319341  5716 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:01:49.257529  5723 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
W20260709 13:01:49.313148  5717 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:01:49.314514  5729 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:49.315366  1616 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:49.291604  5720 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:49.361709  1540 pending_rounds.cc:85] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 2
W20260709 13:01:49.362890  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55637.3us
I20260709 13:01:49.292289  5707 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.365422  5195 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.312469  5686 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:49.370129  1545 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:49.379057  1540 pending_rounds.cc:107] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:01:49.275789  5692 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.317270  5730 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:01:49.381243  1616 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:01:49.380493  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.384186  1540 raft_consensus.cc:2889] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:49.365945  5702 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.366474  5674 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.386361  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.404415  5590 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.378543  5701 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.411104  1538 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:49.383630  5686 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:49.392951  5697 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.396340  5634 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:49.402470  5195 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:49.422362  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.423990  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.424216  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.425155  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.425439  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.426174  1538 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:49.426856  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.427532  1547 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:01:49.428397  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.429854  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.422946  5634 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.415916  5550 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:49.435477  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.439483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.407835  5234 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:01:49.443408  5713 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.424994  5722 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.444240  5722 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.459251  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.453593  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.425177  5195 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.463272  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.446969  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.467753  1539 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:49.466414  1547 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:49.470602  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:49.462320  5724 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:01:49.469430  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.445753  5672 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.475011  1546 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:49.445317  5707 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.475018  5718 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:01:49.482102  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.419929  5701 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.474761  5674 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:49.477447  5550 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.483976  5720 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.508776  5440 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:49.505481  5674 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.488410  5707 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.512454  5550 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:49.525098  5728 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:01:49.518738  5438 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.484711  5634 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.527383  5440 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.530251  5674 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.530566  5564 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:49.535462  5725 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:01:49.564010  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.564873  2261 raft_consensus.cc:2393] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:49.565461  5590 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.566030  5590 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.568349  5590 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:49.544211  5731 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:01:49.548440  5575 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.000s
W20260709 13:01:49.549348  5393 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.000s
I20260709 13:01:49.551821  5701 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.532635  5671 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:49.576691  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 94657.7us
I20260709 13:01:49.558883  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.577384  1543 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.576169  5575 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.578919  1690 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:49.559214  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.538712  5440 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.583117  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.583633  5414 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:49.583936  1539 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 8: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:49.584102  5414 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.584760  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.586097  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.586956  1616 raft_consensus.cc:2410] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:49.588052  1616 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:01:49.589758  1540 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:49.590834  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.592372  1539 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:49.593039  5554 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.595935  5685 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:49.597430  1543 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:49.538264  5692 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.601958  4938 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.543771  5722 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.508024  5195 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.474306  5686 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.613063  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.555202  5709 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:49.570884  5629 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.005s
I20260709 13:01:49.578451  5707 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.620003  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.607762  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.616381  2261 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:49.628324  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.632179  5686 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:49.637830  5687 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.648322  1541 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:49.650353  5687 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.655961  5709 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.656847  1542 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:49.637010  5436 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.616053  5710 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.679029  5682 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:49.683504  5683 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.007s	user 0.004s	sys 0.000s
I20260709 13:01:49.684674  5575 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:49.639808  5533 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.686128  4938 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:49.687301  4938 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:49.687640  4938 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.688676  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.688519  4938 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.689534  4938 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.689845  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.691304  2261 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEARNER]: Advancing to term 8
I20260709 13:01:49.695030  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:49.654395  5550 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:49.697329  1622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 729) took 1727 ms (client timeout 1678 ms). Trace:
I20260709 13:01:49.697896  5550 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.699509  1511 leader_election.cc:400] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13.
I20260709 13:01:49.700425  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.701581  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 655) took 2268 ms. Trace:
I20260709 13:01:49.703395  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1678) took 2435 ms. Trace:
W20260709 13:01:49.704001  5735 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:01:49.707870  5710 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:49.710530  5694 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.871s	user 0.000s	sys 0.002s
I20260709 13:01:49.711825  5693 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:49.715188  5721 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
W20260709 13:01:49.697752  1622 rpcz_store.cc:269] 0709 13:01:47.969945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.009461 (+ 39516us) service_pool.cc:224] Handling call
0709 13:01:49.697151 (+1687690us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002ca954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:49.697255 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346538368}
I20260709 13:01:49.717646  1622 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:49.686200  5533 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:49.719588  5674 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.720270  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1675) took 2489 ms. Trace:
I20260709 13:01:49.720681  1614 rpcz_store.cc:276] 0709 13:01:47.230772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.342945 (+112173us) service_pool.cc:224] Handling call
0709 13:01:47.343322 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.343572 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:47.951208 (+607636us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.719757 (+1768549us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18000d0120. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287
0709 13:01:49.719877 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:49.719940 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:49.719999 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.720092 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.720210 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64667,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":300144,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":16893,"spinlock_wait_cycles":4974976,"thread_start_us":1244583,"threads_started":3,"wal-append.queue_time_us":661379}
I20260709 13:01:49.722528  5674 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.703804  1615 rpcz_store.cc:276] 0709 13:01:47.267635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.828905 (+561270us) service_pool.cc:224] Handling call
0709 13:01:48.742092 (+913187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.742266 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.742292 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.742333 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:48.742385 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.742440 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.703229 (+960789us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54002a76d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:49.703339 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099655936}
I20260709 13:01:49.729198  2261 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:49.686199  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.726940  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.731624  1615 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:49.732257  1614 pending_rounds.cc:85] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:01:49.702014  1696 rpcz_store.cc:276] 0709 13:01:47.433687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.623527 (+189840us) service_pool.cc:224] Handling call
0709 13:01:47.623806 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.861880 (+238074us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:48.519578 (+657698us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.722233 (+202655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.722292 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:48.722336 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.700010 (+977674us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b18001d5a80. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177bb2a6 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419
0709 13:01:49.701319 (+  1309us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540040e054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:49.701372 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.701514 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30215,"prepare.queue_time_us":214701,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":35,"raft.queue_time_us":30362,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10115,"spinlock_wait_cycles":553256064,"thread_start_us":773678,"threads_started":2,"wal-append.queue_time_us":330621}
I20260709 13:01:49.732791  1614 pending_rounds.cc:107] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:49.733160  1614 raft_consensus.cc:2889] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:49.731612  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.734179  1615 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.735617  1615 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:49.737502  5414 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.738003  5630 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:49.734484  5491 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:01:49.746739  5491 consensus_queue.cc:1243] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:49.747275  5491 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:49.747622  5491 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.748432  5491 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.749904  5491 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:49.731572  5632 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.751015  5632 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.751366  5632 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.734279  5621 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:01:49.739715  5414 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.739966  5569 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:49.753396  5569 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.754774  5630 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:49.755445  5569 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.756201  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.739832  5313 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:49.758324  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.741108  5106 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.759008  1620 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:49.759270  5106 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.731247  5701 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:49.741708  5551 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:49.760218  5701 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.760725  5551 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:49.761107  5551 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:49.761432  5106 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.741415  5629 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.732466  5546 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:49.695032  5653 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.715273  5702 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:49.742131  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.761996  5551 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:49.741974  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 55870.1us
I20260709 13:01:49.742260  5549 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.751786  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1765) took 1005 ms. Trace:
I20260709 13:01:49.752344  5621 consensus_queue.cc:1243] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:49.752727  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 732) took 1768 ms. Trace:
I20260709 13:01:49.760516  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.764026  1613 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:49.781877  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.763262  1615 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:49.775214  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.766703  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:49.782155  1621 rpcz_store.cc:276] 0709 13:01:47.984661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.333335 (+348674us) service_pool.cc:224] Handling call
0709 13:01:48.358953 (+ 25618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.456160 (+ 97207us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:48.461040 (+  4880us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.727353 (+266313us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.837474 (+110121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:48.837525 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:48.837568 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.950826 (+113258us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b180034a560. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:49.679714 (+728888us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b180034a560. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:49.752518 (+ 72804us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b5400417dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:49.752563 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.752676 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16872,"prepare.queue_time_us":11812,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":2311,"raft.queue_time_us":99615,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":45880,"spinlock_wait_cycles":248793984,"thread_start_us":367966,"threads_started":3,"wal-append.queue_time_us":286053}
I20260709 13:01:49.775619  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.779361  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.776221  1691 rpcz_store.cc:276] 0709 13:01:48.746730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.746916 (+   186us) service_pool.cc:224] Handling call
0709 13:01:48.747247 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:49.095680 (+348433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.751469 (+655789us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54001f77d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:49.751684 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668801408}
I20260709 13:01:49.766523  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.774960  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.785604  1538 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:49.634510  5440 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.775921  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.787401  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:49.766413  5741 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:49.798699  1542 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:49.798517  1511 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.765331  5702 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.795126  5496 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:01:49.803289  1620 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:49.765738  5554 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:49.795554  5552 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:49.804486  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:49.805128  1620 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.763255  5546 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.765961  5722 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.806502  5722 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.808853  5722 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.793840  5474 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.810046  5474 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.810410  5474 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:49.762570  5701 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.793359  5687 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:01:49.765487  5551 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:49.824179  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 841186us
I20260709 13:01:49.824970  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.826676  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.828087  1538 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:01:49.833137  1546 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:49.833357  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.837872  1538 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:49.837998  1620 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:49.786832  5549 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.843677  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.844787  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:49.845872  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.846473  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:49.847792  5715 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.848131  5549 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.848763  5440 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:49.848356  5715 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.849854  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:49.850900  5195 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.853123  5634 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.854964  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1774) took 1090 ms. Trace:
I20260709 13:01:49.855432  1688 rpcz_store.cc:276] 0709 13:01:48.764810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.765604 (+   794us) service_pool.cc:224] Handling call
0709 13:01:48.765922 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:48.834786 (+ 68864us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:48.866298 (+ 31512us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.963089 (+ 96791us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.570201 (+607112us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b180044e000. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177bb2a6 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1
0709 13:01:49.698298 (+128097us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180044e000. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:49.822883 (+124585us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b180044e000. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:01:49.823020 (+   137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.842128 (+ 19108us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.842355 (+   227us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:49.842413 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.842505 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.854748 (+ 12243us) raft_consensus.cc:1685] finished
0709 13:01:49.854768 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.854905 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":860024,"prepare.queue_time_us":779773,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":5462,"raft.queue_time_us":1004709,"raft.run_cpu_time_us":450,"raft.run_wall_time_us":51564,"spinlock_wait_cycles":43842944,"thread_start_us":90614,"threads_started":2,"wal-append.queue_time_us":186048}
I20260709 13:01:49.857548  5690 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:49.858033  5690 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:49.846487  2257 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:49.859485  5714 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.860013  5714 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.862219  5714 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.826272  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:49.865453  1691 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:49.865630  1696 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:49.857880  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1773) took 1094 ms. Trace:
I20260709 13:01:49.867017  1690 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:49.866310  1695 rpcz_store.cc:276] 0709 13:01:48.763049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.763627 (+   578us) service_pool.cc:224] Handling call
0709 13:01:48.763974 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:48.832593 (+ 68619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:48.832852 (+   259us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:48.836411 (+  3559us) log.cc:844] Serialized 52 byte log entry
0709 13:01:48.941289 (+104878us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.129484 (+188195us) log.cc:844] Serialized 14 byte log entry
0709 13:01:49.857572 (+728088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.857647 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.857687 (+    40us) raft_consensus.cc:1685] finished
0709 13:01:49.857701 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.857827 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":733944,"prepare.queue_time_us":261257,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":815600,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":23921,"thread_start_us":299296,"threads_started":3,"wal-append.queue_time_us":266890}
I20260709 13:01:49.820226  5313 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.804754  5554 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.869623  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:49.843765  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:49.878244  2259 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:49.889854  1688 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:49.884334  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:49.842968  5612 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.866391  5552 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:49.897352  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53675.4us
W20260709 13:01:49.898967  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62135.1us
I20260709 13:01:49.842759  5687 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.901444  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1671) took 2672 ms. Trace:
I20260709 13:01:49.866554  5674 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:49.906395  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.883204  5693 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:49.882712  5313 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.935684  1547 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:49.935735  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.934661  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:49.909582  1619 rpcz_store.cc:276] 0709 13:01:47.228766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.281635 (+ 52869us) service_pool.cc:224] Handling call
0709 13:01:47.282003 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:47.282785 (+   782us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:47.840161 (+557376us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4800032358. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:01:47.965732 (+125571us) log.cc:844] Serialized 14 byte log entry
0709 13:01:48.662125 (+696393us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.824096 (+1161971us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b2c00013bb8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:01:49.840581 (+ 16485us) log.cc:844] Serialized 26 byte log entry
0709 13:01:49.899219 (+ 58638us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:49.899258 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:49.899350 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:49.901143 (+  1793us) raft_consensus.cc:1685] finished
0709 13:01:49.901171 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:49.901364 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18451,"prepare.queue_time_us":97742,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":2345,"raft.queue_time_us":313687,"raft.run_cpu_time_us":2983,"raft.run_wall_time_us":559944,"spinlock_wait_cycles":66961536,"thread_start_us":1303135,"threads_started":4,"wal-append.queue_time_us":547310,"wal-append.run_cpu_time_us":2462,"wal-append.run_wall_time_us":1256917}
I20260709 13:01:49.937116  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.893285  5474 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:49.883550  5713 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:49.883663  5621 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:49.918985  5674 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.927004  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:49.978255  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 94108.9us
I20260709 13:01:49.927587  5632 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:49.903877  5715 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:49.899389  5706 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:49.932017  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 107148us
I20260709 13:01:49.889386  5418 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:49.891479  5554 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.935030  1696 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:49.993829  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.937216  1546 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:49.839900  5702 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:01:49.870426  5234 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:01:49.839857  5503 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:01:49.942116  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.974531  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.004853  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:49.948478  1690 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:50.005677  1693 raft_consensus.cc:2410] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:01:49.949263  1691 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:50.006103  1696 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:50.006911  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:49.905462  5496 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:49.897462  5440 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.914117  5653 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.648367   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:49.909117  5577 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:49.993049  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:49.980538  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:49.897297  5106 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:01:49.992458  5674 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:49.897608  5569 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:01:50.000245  1687 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:50.019551  1687 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:01:50.000919  2261 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:49.937749  1538 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:50.002197  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:49.932732  5701 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:49.938423  5693 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:50.004483  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64532.3us
I20260709 13:01:50.022130  5693 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.007006  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.007843  1691 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:49.911836  5690 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.024574  5690 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:49.947634  5313 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:50.009850  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.030556  5693 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.033098  5693 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.009968  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.010279  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:50.034268  1693 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:50.034474  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:50.035012  5588 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.035635  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:50.035488  5588 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.036710  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:49.950518  5533 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:50.037606  5588 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.037766  5533 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:50.038213  5533 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.038583  5533 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.041304  5700 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:50.011168  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:50.014464  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.015213  1541 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:49.995525  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.984680  5722 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:01:49.934707  5687 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.000747  5564 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:49.933454  5552 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.126452  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:50.087283  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 78626.6us
I20260709 13:01:50.038218  5588 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:50.004448  5579 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:50.140534  1693 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:50.079609  1692 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:50.018136  5394 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.143076  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:50.085657  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 63045.1us
I20260709 13:01:50.107771  1694 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:50.109500  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:50.111371  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 132050us
I20260709 13:01:50.081869  5713 consensus_queue.cc:1243] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:01:50.136665  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 100026us
I20260709 13:01:50.137414  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.148977  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.020048  5440 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.145754  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:50.087054  5577 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:01:50.111407  5747 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:01:50.151746  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:50.001776  5706 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.142437  2258 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:01:50.136569  5746 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:50.018733  5653 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.166801  1696 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:50.166512  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:50.171033  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.171936  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.172966  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.173545  1694 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:50.167276  1538 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:50.176368  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.178261  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.180821  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.189314  1687 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:50.182827  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.190089  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.190213  1692 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:50.190698  1687 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:01:50.181600  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.182003  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.191533  1696 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:50.150154  5710 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.153255  5394 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:50.193105  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.193940  1689 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:50.194425  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:50.195062  1688 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.200970  1617 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:50.202494  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:50.203996  1616 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:50.188462  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.206530  1694 raft_consensus.cc:2368] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:50.207556  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.208449  1694 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:50.139938  5564 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.210501  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.220062  1687 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:50.220214  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:50.221186  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:50.147380  5579 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.153578  5700 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:01:50.228955  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.174607  5585 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:50.230980  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:50.231527  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.177490  5569 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:50.175172  5568 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:01:50.178848  5551 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:01:50.249068  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.251914  1687 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:50.235898  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 66744.8us
W20260709 13:01:50.266990  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.261291  1689 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:50.182984  5496 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:01:50.223148  5588 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.264997  1688 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:50.275432  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:50.281564  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:50.188692  5708 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:01:50.283311  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:50.235611  5710 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:50.292621  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.257550  5700 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:50.253487  5503 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.305699  1688 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:50.306128  1687 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:01:50.257929  5632 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.263502  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:50.325842  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62478.2us
I20260709 13:01:50.326370  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:50.327539  1617 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:50.231257  5723 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:01:50.277874  5474 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:50.332484  1616 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:01:50.313356  5751 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:01:50.301066  5697 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:50.284513  5338 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.338162  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:50.338543  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 55324.5us
I20260709 13:01:50.337832  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:50.271334  5394 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:50.535506  5754 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:01:50.338128  5503 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:50.494707  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 166214us
I20260709 13:01:50.285243  5577 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.287209  5588 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.280239  5709 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:01:50.351722  5195 consensus_meta.cc:287] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.500s	user 0.003s	sys 0.008s
I20260709 13:01:50.351346  5667 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.473404  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:50.540132  5710 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.695048  5697 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.685312  1616 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:50.686923  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:50.497190  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 158285us
W20260709 13:01:50.677960  5758 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.385s	user 0.000s	sys 0.011s
W20260709 13:01:50.694960  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 356890us
I20260709 13:01:50.699271  5687 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:50.689627  5690 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.010s
I20260709 13:01:50.667306  5585 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.681491  5313 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.011s
W20260709 13:01:50.715627  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.730131  5440 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.738319  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:50.698942  5708 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.691165  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:50.754446  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 67597.6us
W20260709 13:01:50.694391  5760 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.387s	user 0.000s	sys 0.011s
I20260709 13:01:50.724872  5552 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:50.769981  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.677230  5755 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.706992  5496 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:01:50.808450  5496 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:50.808982  5496 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:50.810045  5496 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.814177  5496 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:50.820353  5338 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.822355  5338 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.829702  5690 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.830713  5690 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.834213  5632 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.834856  5632 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.837018  5632 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.838443  5690 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.844424  5709 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.845273  5709 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.847488  5106 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.848272  5106 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.844941  5704 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:50.851459  5704 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:50.853204  5704 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.854866  5704 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:50.850445  5106 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.862928  5579 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.781827  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:50.758076  5491 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.766916  5765 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:50.887691  5755 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:50.889082  5755 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.891906  5552 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:50.893187  5552 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:50.896857  5621 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:01:50.897590  5621 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:01:50.795792  5533 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.757s	user 0.009s	sys 0.009s
I20260709 13:01:50.899331  5533 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.783918  5313 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.797320  5766 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:50.799273  5551 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:50.775784  5585 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:50.804266  5554 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.792s	user 0.014s	sys 0.001s
W20260709 13:01:50.872013  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 90315.2us
I20260709 13:01:50.884608  5707 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:50.884235  5491 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.896634  5761 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:50.795140  5759 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.379s	user 0.000s	sys 0.011s
I20260709 13:01:50.811792  5503 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.930130  5564 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.940692  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 745) took 1121 ms. Trace:
I20260709 13:01:50.941076  1615 rpcz_store.cc:276] 0709 13:01:49.819619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.836734 (+ 17115us) service_pool.cc:224] Handling call
0709 13:01:49.837034 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.840915 (+  3881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:49.840947 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:49.841377 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.016970 (+175593us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18002da300. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:01:50.148283 (+131313us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:50.148314 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.148387 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.940368 (+791981us) raft_consensus.cc:1685] finished
0709 13:01:50.940388 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.940630 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3441,"raft.queue_time_us":3566,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":17938,"spinlock_wait_cycles":59714944,"thread_start_us":131137,"threads_started":1,"wal-append.queue_time_us":412898}
I20260709 13:01:50.935293  5631 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:50.868606  5708 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.943300  5631 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:50.936403  5554 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.937208  5491 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.930183  5707 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:50.758183  5697 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:50.931963  5546 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.949182  5633 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:50.949645  5697 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:50.950110  5633 consensus_queue.cc:1243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:50.950773  5768 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:01:50.952142  5764 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:50.952569  5764 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:50.952836  5414 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:50.953348  5414 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:50.768538  5682 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:50.784413  5653 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:50.933439  5579 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:50.953409  5764 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:50.982538  1614 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:50.938879  5761 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.906595  5313 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:50.950390  5697 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:50.907612  5766 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:50.987006  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 203) took 29006 ms (client timeout 15000 ms). Trace:
I20260709 13:01:50.990957  5708 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:50.991150  5634 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.138s	user 0.014s	sys 0.006s
I20260709 13:01:50.992275  5770 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:51.010043  5764 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.011265  5195 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.039975  5414 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.039610  5707 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.055362  5707 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:51.001567  5697 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.069095  5766 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.043130  5770 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:51.073941  5554 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:51.074604  5674 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 1.000s	user 0.013s	sys 0.000s
I20260709 13:01:51.075434  5585 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:50.987564  1442 rpcz_store.cc:269] 0709 13:01:21.980430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.987479 (+  7049us) service_pool.cc:224] Handling call
0709 13:01:50.986907 (+28999428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:44.230346 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:44.273216 (+ 42870us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:44.273275 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:01:44.273294 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:44.274316 (+  1022us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:44.274403 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:44.274427 (+    24us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:44.311795 (+ 37368us) tablet.cc:701] Row locks acquired
0709 13:01:44.311849 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:01:44.312041 (+   192us) write_op.cc:270] Start()
0709 13:01:44.312189 (+   148us) write_op.cc:276] Timestamp: P: 1783602104311956 usec, L: 0
0709 13:01:44.312214 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:44.348335 (+ 36121us) log.cc:844] Serialized 3664 byte log entry
0709 13:01:45.682867 (+1334532us) op_driver.cc:464] REPLICATION: finished
0709 13:01:46.195508 (+512641us) write_op.cc:301] APPLY: starting
0709 13:01:46.195608 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:46.355517 (+159909us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:46.414412 (+ 58895us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:46.907889 (+493477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:46.943597 (+ 35708us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:01:46.943671 (+    74us) write_op.cc:312] APPLY: finished
0709 13:01:46.944175 (+   504us) log.cc:844] Serialized 89 byte log entry
0709 13:01:47.281527 (+337352us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.281709 (+   182us) write_op.cc:454] Released schema lock
0709 13:01:47.281775 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:47.282207 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.282245 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2722131,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":494631,"apply.run_cpu_time_us":46546,"apply.run_wall_time_us":1086666,"cfile_cache_hit":34,"cfile_cache_hit_bytes":35513,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":1,"lbm_read_time_us":13595,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":9,"prepare.queue_time_us":186739,"prepare.run_cpu_time_us":40121,"prepare.run_wall_time_us":272428,"raft.queue_time_us":665149,"raft.run_cpu_time_us":9247,"raft.run_wall_time_us":523693,"replication_time_us":1329400,"thread_start_us":1366764,"threads_started":5,"wal-append.queue_time_us":830442,"wal-append.run_cpu_time_us":37752,"wal-append.run_wall_time_us":2916244}]]}
I20260709 13:01:51.075188  5674 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.052618  5533 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:51.059306  5709 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.071236  5761 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.086864  1616 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:51.052078  5195 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.015026  5631 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.086131  5706 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:51.189894  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.193390  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.194572  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:51.196120  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 295236us
I20260709 13:01:51.197082  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:51.197350  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 274965us
I20260709 13:01:51.188824  5634 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.200415  1661 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:51.093355  5761 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.205600  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:51.208158  1689 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:51.203826  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:51.211366  1696 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:01:51.215137  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.215863  1538 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:01:51.217347  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.218011  1542 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:51.220891  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.220523  5579 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:51.221532  1542 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:51.224129  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.224740  1542 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:51.225555  1538 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:51.203372  5533 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:51.226699  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.227134  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.227329  1542 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:51.227706  1546 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:51.228631  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:51.229419  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:51.203364  5773 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.215504  5700 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.214816  5766 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:51.203614  5634 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.231469  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.237932  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:51.241307  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:51.204102  5709 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:51.195590  5770 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.243742  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:51.249847  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:51.233529  5773 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.255446  5773 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.256220  5761 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:51.256857  5634 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.258054  5783 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.258529  5783 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:51.258904  5783 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.240219  5700 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.238417  5551 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:01:51.266093  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:51.267267  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:51.250974  5533 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:51.268784  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:51.269035  5533 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:51.267505  5667 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.006s
I20260709 13:01:51.270968  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:51.274334  5710 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:51.275995  5710 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.276427  5710 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.278746  5708 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:51.279227  5708 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:51.279644  5708 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:51.287382  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.291580  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 751) took 1114 ms. Trace:
I20260709 13:01:51.292039  1614 rpcz_store.cc:276] 0709 13:01:50.177168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.177317 (+   149us) service_pool.cc:224] Handling call
0709 13:01:50.177665 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.983074 (+805409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.291333 (+308259us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400417dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:51.291520 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1845028608}
I20260709 13:01:51.292435  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:51.293510  5771 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:51.282860  5503 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.294646  5503 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.294997  5503 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.295006  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:51.253373  5697 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:51.296195  2263 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:51.270769  5700 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:51.273552  5770 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.320892  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:51.323428  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 116348us
I20260709 13:01:51.280975  5667 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:51.320075  5674 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.250093  5579 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.296087  5394 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:51.325266  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74117.6us
I20260709 13:01:51.327572  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:51.339200  5667 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:51.339814  5667 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.340303  5667 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.337193  5394 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.354266  5536 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:51.350634  5782 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:51.353524  5394 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.386652  5782 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:51.387185  5784 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:01:51.389454  5195 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.389638  1538 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:51.392175  1538 pending_rounds.cc:85] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 5
I20260709 13:01:51.392441  1538 pending_rounds.cc:107] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:51.392671  1538 raft_consensus.cc:2889] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:51.394641  5686 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:51.395488  1545 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:01:51.397277  5667 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.398203  5686 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:51.400316  5667 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.400995  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:51.401609  2257 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.408782  2257 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:51.409828  1659 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:51.421926  5685 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:51.422550  5685 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:51.427577  5774 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:01:51.426367  5768 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:51.461417  5781 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:51.470988  5588 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:51.475673  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.490680  5768 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:51.492266  5768 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.493816  5768 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.438403  5711 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:51.542662  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:51.423681  5685 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:51.575970  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.548163  5711 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:51.536459  5773 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.582428  5685 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:51.591323  5701 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:51.603276  5708 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.631131  5711 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.641186  5783 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.644873  5783 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:51.715946  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.723489  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.727880  1614 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:01:51.730639  1616 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:01:51.732956  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:51.734369  1538 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.773598  2262 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:51.774837  5773 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.775805  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1803) took 1582 ms. Trace:
I20260709 13:01:51.776382  1696 rpcz_store.cc:276] 0709 13:01:50.193294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.193804 (+   510us) service_pool.cc:224] Handling call
0709 13:01:50.194176 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.212147 (+1017971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.775022 (+562875us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540012cad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:51.775515 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2338823936}
I20260709 13:01:51.779976  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:51.781247  1615 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.783982  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 627) took 2005 ms. Trace:
I20260709 13:01:51.784605  2261 rpcz_store.cc:276] 0709 13:01:49.778662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.781336 (+  2674us) service_pool.cc:224] Handling call
0709 13:01:49.802864 (+ 21528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.020416 (+217552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.783191 (+1762775us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400574254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:51.783655 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454920448}
W20260709 13:01:51.787607  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.788396  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.794050  5630 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.795233  5653 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:51.795315  5630 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.796166  5653 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.803040  5771 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.804051  5771 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.806527  5415 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.807370  5415 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.768849  5554 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:51.603838  5710 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.819237  1692 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:51.813892  5546 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:51.820482  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:51.817137  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:51.834484  1620 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:51.834285  5546 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.835419  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:51.835614  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:51.835817  5708 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.836228  1616 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.836441  1620 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:51.836838  5706 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.837074  5546 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.826998  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:51.812323  5554 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.838801  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:51.819350  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:51.840250  5554 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.837574  5706 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.819675  5692 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:51.843703  5706 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.843586  5692 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.837574  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:51.842751  5740 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.848610  5740 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.849946  1617 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:51.594564  5701 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.814488  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:51.812738  5438 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.855418  5706 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:51.855983  5706 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.855679  5438 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:51.856427  5706 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.857108  5700 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:51.819504  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1710) took 2044 ms. Trace:
I20260709 13:01:51.858186  5438 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:51.858533  1689 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:01:51.858765  1620 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:51.825865  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:51.860450  5700 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:51.860579  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.864821  5755 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.866670  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:51.867067  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.856415  5653 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.869272  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:51.869511  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:51.870160  5554 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:51.819782  5106 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.920399  1538 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:01:51.873148  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.873291  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:51.874204  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.854725  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1718) took 1566 ms. Trace:
I20260709 13:01:51.874090  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:51.922919  1693 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:51.858330  1618 rpcz_store.cc:276] 0709 13:01:49.774832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.834923 (+ 60091us) service_pool.cc:224] Handling call
0709 13:01:49.840199 (+  5276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:49.841102 (+   903us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:49.932855 (+ 91753us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.424879 (+1492024us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b180031bf40. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a 00007f7f1a8e4a2a
0709 13:01:51.727298 (+302419us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.728157 (+   859us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.728377 (+   220us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:51.771942 (+ 43565us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.818891 (+ 46949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.819017 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.819155 (+   138us) raft_consensus.cc:1685] finished
0709 13:01:51.819179 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.819332 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259261,"prepare.queue_time_us":228933,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":115,"raft.queue_time_us":284739,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":469,"spinlock_wait_cycles":3121536,"thread_start_us":161138,"threads_started":2,"wal-append.queue_time_us":1620239}
I20260709 13:01:51.886632  5674 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.872867  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:51.882256  5630 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:51.886168  5709 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:51.809896  5415 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:51.998392  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:51.924098  1545 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:51.923333  1539 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.010066  1544 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:51.820289  5710 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.015455  5709 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:52.016978  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.846496  5692 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.023619  1616 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:52.027658  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:52.028510  5711 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.029311  5711 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.028733  1540 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:51.940055  5394 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.010s
I20260709 13:01:51.922205  1621 rpcz_store.cc:276] 0709 13:01:50.198985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.202726 (+  3741us) service_pool.cc:224] Handling call
0709 13:01:50.230567 (+ 27841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.723830 (+1493263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:51.723899 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:51.725616 (+  1717us) log.cc:844] Serialized 26 byte log entry
0709 13:01:51.758492 (+ 32876us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:51.758548 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:51.758716 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:51.761062 (+  2346us) raft_consensus.cc:1685] finished
0709 13:01:51.761091 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:51.764813 (+  3722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1492225,"raft.queue_time_us":1539732,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":45246,"thread_start_us":32232,"threads_started":1,"wal-append.queue_time_us":32724}
I20260709 13:01:51.929782  5704 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.001121  5653 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.041749  5653 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.042825  5755 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.044116  1618 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:51.930976  5106 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.039584  5588 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:52.046236  5633 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:52.046743  1587 connection.cc:256] RPC call timeout handler was delayed by -1.2015852159999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:01:52.047003  5709 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.048161  5755 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:51.996297  5706 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:52.055591  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1889852159999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:01:52.057112  1615 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:01:52.060007  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0489893549999465s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:01:52.060362  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0078410979999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:01:52.063128  5633 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.066208  5633 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.074906  1539 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:52.074226  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.076121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.077154  5630 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.077838  5630 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.079660  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.080842  5554 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:52.080884  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:52.081784  5554 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:52.083658  1621 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:52.083372  5554 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.084628  5588 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.086216  5438 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.087035  5704 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.089694  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.054786  5394 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:52.126925  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.091298  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:52.090845  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.186154  1619 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.120887  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.186578  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.187163  1616 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:52.187364  1614 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.188215  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.130049  1618 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:01:52.188865  1616 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.190157  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:52.125628  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:52.126250  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:52.190402  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:52.122522  5768 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.010s
I20260709 13:01:52.090442  5711 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.195825  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:52.194111  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.171283  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:52.093255  5412 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:52.120106  5706 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:52.183360  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 93961.5us
I20260709 13:01:52.197844  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:52.198365  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.009s	sys 0.017s
I20260709 13:01:52.200554  2265 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:52.202167  5394 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.191843  5653 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.206918  1687 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:52.208324  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:52.215096  1616 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:52.215764  2261 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.121562  5440 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.184885  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 142842us
W20260709 13:01:52.216655  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.010s	sys 0.017s
I20260709 13:01:52.209326  5412 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:52.212065  1693 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:52.127549  5771 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.205353  1614 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:01:52.218533  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:52.220218  1688 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.184432  5633 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:01:52.227264  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56764.3us
I20260709 13:01:52.227370  5653 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:52.228524  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:52.228518  5653 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.229202  5653 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:52.230276  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.231882  5546 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.232776  5672 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:52.233196  5672 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:52.230726  2262 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
W20260709 13:01:52.234972  5503 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.939s	user 0.018s	sys 0.000s
I20260709 13:01:52.237371  1585 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.236719  5503 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.239149  1691 raft_consensus.cc:2368] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:52.240746  5692 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.241211  5692 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:52.241607  5692 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.241950  5782 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.230574  5653 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.244026  5503 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.244354  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.245934  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.247517  5546 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:52.247684  5630 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.248276  5546 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.234463  5672 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:52.267191  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49736.6us
I20260709 13:01:52.072296  5674 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.249784  5630 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.250262  5612 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.256542  5811 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.257177  5704 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.252038  5338 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.258005  5588 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.258508  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:52.266328  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 146326us
I20260709 13:01:52.266867  5496 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:52.267922  5672 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.273294  5394 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:52.268113  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:52.276021  5394 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.277745  5811 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.280036  5338 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:52.281582  5612 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.244042  5653 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.251250  5546 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.282558  5782 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:52.268563  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.290475  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:52.274842  5496 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.296841  5338 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:52.297716  5702 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:52.298018  5811 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.298537  5702 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.299340  5702 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:52.299842  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69721.7us
I20260709 13:01:52.301793  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.299142  5496 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.305027  5496 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.309442  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.311592  5630 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.313971  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.314848  1614 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:52.291028  5782 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:52.317432  5782 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.318012  5630 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.318948  5782 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.320791  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 674) took 1084 ms. Trace:
I20260709 13:01:52.318059  5701 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:52.321867  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53947.5us
I20260709 13:01:52.322775  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.324147  1696 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:52.325032  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.326212  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:52.321247  1689 rpcz_store.cc:276] 0709 13:01:51.236352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.239855 (+  3503us) service_pool.cc:224] Handling call
0709 13:01:51.254529 (+ 14674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:51.935199 (+680670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.320446 (+385247us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400454cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:52.320700 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388070784}
I20260709 13:01:52.328724  1694 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:52.329181  1620 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 7.
I20260709 13:01:52.327642  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.331360  5768 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:52.331809  5768 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:52.332237  5768 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.334568  5338 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.334920  5773 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:52.335300  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.335533  5773 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.329751  1616 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:52.336511  5773 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.327162  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.330308  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.338686  1614 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:52.340268  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44584us
I20260709 13:01:52.340879  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.341095  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.339035  1620 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:52.333948  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:52.339872  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.342409  2261 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:52.339473  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.341667  1614 raft_consensus.cc:2410] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:52.341643  1688 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:01:52.341970  5630 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:52.353538  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.353170  5630 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:52.355983  5630 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.356130  5412 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.291563  5394 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.351982  5701 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.221926  5440 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.339815  5612 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.364400  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.367463  1693 raft_consensus.cc:1217] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 13:01:52.367556  5701 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.368420  1693 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:01:52.370741  5706 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:52.371227  5706 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.365443  5702 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.371666  5706 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.360041  5438 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:52.373230  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.373574  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.370383  5701 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.357471  5546 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.378662  1616 raft_consensus.cc:2410] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:52.385432  2263 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:52.378896  5702 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.363953  5692 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.383718  5412 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.396857  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.395728  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.399550  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.400802  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:52.401392  2261 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
W20260709 13:01:52.406148  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 93199.4us
I20260709 13:01:52.393121  5674 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.414783  2259 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:52.416477  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:52.417639  5811 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:52.418224  5811 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:52.419273  5811 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.409279  1690 pending_rounds.cc:85] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 8
I20260709 13:01:52.423868  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.414662  5686 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:01:52.429008  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.424355  1690 pending_rounds.cc:107] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:01:52.430436  1690 raft_consensus.cc:2889] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:52.432548  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 98721.6us
I20260709 13:01:52.433928  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.435750  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.429890  5338 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.438555  5702 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:52.439281  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.439777  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.436239  1694 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 8.
I20260709 13:01:52.426324  5438 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:52.441520  1585 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.444983  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 747) took 2538 ms. Trace:
I20260709 13:01:52.445382  1622 rpcz_store.cc:276] 0709 13:01:49.906753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.906945 (+   192us) service_pool.cc:224] Handling call
0709 13:01:49.907342 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.183993 (+276651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.184038 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:50.184097 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:50.184142 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.444531 (+2260389us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54002cae54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:52.444604 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.444802 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635710720}
I20260709 13:01:52.448076  5106 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.451830  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.449069  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:52.453550  1512 connection.cc:256] RPC call timeout handler was delayed by -1.0196075549999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:01:52.459486  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.444991  5692 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.451083  5702 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:52.462128  5702 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.462558  5702 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.439299  5338 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.475160  5577 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:52.479211  5686 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:52.480037  5686 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:52.481154  5686 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.490186  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.473347  5106 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:52.500002  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 72991.8us
I20260709 13:01:52.496841  5546 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:52.501323  5106 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:52.514144  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 71862.3us
I20260709 13:01:52.513079  5813 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:52.507416  5338 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.522593  5394 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.528981  5394 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.509856  5811 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:01:52.537786  5769 consensus_queue.cc:1059] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:01:52.538751  1587 leader_election.cc:400] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:52.539183  1587 leader_election.cc:403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:52.539906  5536 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:52.540467  5536 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.540686  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.542155  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.543058  5440 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.544216  5440 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:52.545871  5440 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.549352  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:52.517282  5813 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.517560  5106 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.558255  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.568753  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:52.577613  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 58437.8us
I20260709 13:01:52.554951  5813 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:52.581171  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56988.7us
I20260709 13:01:52.587425  5704 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:52.587988  5714 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.588898  5629 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.589303  1616 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:52.526403  5773 consensus_queue.cc:1059] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:01:52.516464  5438 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:52.605513  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.607595  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:52.588020  5704 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.618239  2263 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:52.605127  1585 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:52.609490  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 67448.6us
I20260709 13:01:52.633471  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.634759  1585 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.640278  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:52.641738  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 116825us
I20260709 13:01:52.605458  5577 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.642683  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:52.643008  5823 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:01:52.642894  5577 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.645344  5577 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.645781  5440 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:52.657428  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 682) took 1317 ms. Trace:
I20260709 13:01:52.657779  5440 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:52.658821  5440 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.659996  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.660794  1615 raft_consensus.cc:2410] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:52.661701  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.645848  5394 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.662286  1615 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 6.
I20260709 13:01:52.647830  1613 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:01:52.648486  5818 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.648702  5672 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.623519  5704 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.649433  5635 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.578953  5768 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.651643  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:52.652175  5686 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.654686  5755 raft_consensus.cc:3055] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:52.663203  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 925) took 1373 ms. Trace:
I20260709 13:01:52.663913  1614 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [8.3-11.4]
W20260709 13:01:52.665380  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.705356  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.667268  5569 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.667761  1617 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:01:52.670218  5740 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.704344  2259 rpcz_store.cc:276] 0709 13:01:51.289621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.290230 (+   609us) service_pool.cc:224] Handling call
0709 13:01:51.290636 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.415386 (+1124750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.662938 (+247552us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540012e654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:52.663148 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2529286016}
I20260709 13:01:52.714745  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:52.715459  2263 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:52.716846  5813 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.673120  1618 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:52.675136  5787 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:52.717928  5787 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.675467  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.718825  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:52.719219  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 43921.3us
I20260709 13:01:52.719774  5740 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:52.720155  5740 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:52.676035  5692 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.720561  5740 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.720736  5692 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.722666  5577 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:52.657811  1692 rpcz_store.cc:276] 0709 13:01:51.340257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.341895 (+  1638us) service_pool.cc:224] Handling call
0709 13:01:51.342143 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.840107 (+497964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.657178 (+817071us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540040f954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:52.657368 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096100608}
I20260709 13:01:52.723095  5577 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:52.647377  5819 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:52.718822  5787 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.704236  5755 raft_consensus.cc:740] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.725075  5787 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:52.725828  5755 consensus_queue.cc:260] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.723553  5577 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.727159  5755 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:52.679587  5546 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:52.731132  5768 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.731338  5546 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:52.732740  5546 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.701823  5630 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.742070  5630 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.743640  1614 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:01:52.746969  1615 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:01:52.748196  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 96735.4us
I20260709 13:01:52.749640  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:52.752053  5692 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.720360  2230 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:52.756203  5706 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:52.756981  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.751154  5577 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.761773  5787 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:52.761561  5106 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:52.762220  5787 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.763250  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 749) took 2764 ms. Trace:
I20260709 13:01:52.763135  5740 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.763644  1619 rpcz_store.cc:276] 0709 13:01:49.998519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.998678 (+   159us) service_pool.cc:224] Handling call
0709 13:01:49.999059 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.186602 (+2187543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.762984 (+576382us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54002a80d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:52.763196 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5029436288}
I20260709 13:01:52.764775  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.764971  5813 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.765462  1619 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:52.766862  1615 raft_consensus.cc:1275] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:52.708154  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.678308  5414 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:52.711105  5394 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.711213  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:52.711752  5811 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:52.707132  5569 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.766954  5740 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:52.706334  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 106773us
W20260709 13:01:52.783497  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.798342  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:52.797240  1691 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 7.
W20260709 13:01:52.810251  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.813640  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.813889  5536 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.769781  5577 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:52.770785  5787 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.797755  5811 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:52.822865  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 185649us
W20260709 13:01:52.846133  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.811432  5692 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:52.811717  5630 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:52.848924  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1966) took 1007 ms. Trace:
I20260709 13:01:52.849937  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:52.852626  2263 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:01:52.808370  5813 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:01:52.854043  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.854806  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.852294  1616 rpcz_store.cc:276] 0709 13:01:51.841677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.590244 (+748567us) service_pool.cc:224] Handling call
0709 13:01:52.590567 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.602035 (+ 11468us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:52.626175 (+ 24140us) log.cc:844] Serialized 14 byte log entry
0709 13:01:52.848393 (+222218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:52.848521 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:52.848591 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:52.848685 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:52.848847 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":46092,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":1567,"thread_start_us":198158,"threads_started":1}
I20260709 13:01:52.845810  5811 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:52.862479  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 222292us
I20260709 13:01:52.843959  5503 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:01:52.852088  5630 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.870095  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.862480  5568 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.867209  5635 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.864128  5831 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.849682  5828 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:52.870157  5630 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.876238  5569 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.880591  5569 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.876248  5635 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.879642  5828 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:52.871198  5706 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.872387  5503 consensus_queue.cc:1243] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:52.868800  5813 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:52.897830  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54010.3us
I20260709 13:01:52.876334  5692 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.900126  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:52.901830  5783 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.902513  5783 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.903188  5503 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:52.903254  5783 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:52.906252  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.907125  1614 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:52.907694  1616 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:52.908728  5692 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:52.916050  5692 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.917008  5692 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.919590  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.920275  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.921408  1614 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:52.921968  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.924338  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.925884  1614 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:52.927201  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:52.877728  5106 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.928870  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:52.928373  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 77350.4us
W20260709 13:01:52.932507  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 110850us
I20260709 13:01:52.930424  1614 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:52.888680  5828 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:52.877683  5568 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.942888  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.928153  5830 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.939141  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.883052  5702 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:52.892357  5831 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:52.979341  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 120224us
I20260709 13:01:52.926925  5692 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:52.981503  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.944953  1616 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:52.942993  1661 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:52.946290  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:52.985333  2260 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:52.942736  5635 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:52.990165  1622 raft_consensus.cc:2393] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 9: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:01:52.992216  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 58932.7us
I20260709 13:01:52.993212  5782 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:52.993340  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:52.994976  1539 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:01:52.995703  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:52.996372  1540 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:52.996409  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:52.997530  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:52.998143  1538 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:52.998974  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61195.9us
I20260709 13:01:52.999941  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.000428  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.001075  1543 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:53.002094  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:52.990475  5714 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.003479  5714 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.003861  5787 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.005677  5714 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:53.005820  5787 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:52.990501  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:52.990644  5838 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:53.005570  1538 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:53.000078  5831 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:53.006338  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:53.007558  1539 raft_consensus.cc:3060] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.007639  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.008368  1615 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:01:52.991083  5835 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:53.000002  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.011994  5702 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:53.012507  1620 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.002563  1543 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.015981  5536 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:53.028740  1543 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:52.948578  5106 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.031185  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 81272us
I20260709 13:01:53.037986  1620 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:01:53.040208  1539 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
W20260709 13:01:53.042002  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.043074  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.043174  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.043866  1619 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:53.038429  1620 pending_rounds.cc:85] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 9
I20260709 13:01:53.045641  1620 pending_rounds.cc:107] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:01:53.045897  1620 raft_consensus.cc:2889] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.046985  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.047847  1616 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:53.048630  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:53.049474  1539 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:52.987771  5503 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:53.053227  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.053308  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.054412  1619 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:53.058730  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:53.059338  1543 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.075169  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.076491  1616 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.089201  1542 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.089582  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.090845  1542 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.091023  1620 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:53.092100  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.092655  1620 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.091032  1539 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.051035  5828 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.094511  1540 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:53.040997  5106 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:53.097229  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 97392.1us
I20260709 13:01:53.097654  5106 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.098093  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.098521  1546 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:53.098760  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:53.099656  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.060547  5831 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.106451  1538 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:01:53.110743  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.036551  5830 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:53.112339  5832 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.287s	user 0.004s	sys 0.000s
I20260709 13:01:53.112742  5779 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:53.113199  5779 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.113360  5830 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.114048  1545 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
W20260709 13:01:53.119776  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.145972  1614 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:53.136224  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.147445  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.136554  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.148057  1614 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.148248  2263 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:53.140188  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.149974  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.137120  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.117061  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2416) took 1323 ms. Trace:
I20260709 13:01:53.157044  1620 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:53.158552  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.160697  1617 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:53.157478  1687 rpcz_store.cc:276] 0709 13:01:51.865274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.865544 (+   270us) service_pool.cc:224] Handling call
0709 13:01:51.866194 (+   650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:52.215614 (+349420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.116741 (+901127us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54001f68d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:53.116987 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759587200}
I20260709 13:01:53.164232  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:53.046324  5704 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.168870  1690 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.165380  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.169661  1616 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.146486  5782 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.116400  5818 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:53.191978  5840 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:53.202366  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.204708  5826 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.205327  5826 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.207562  1541 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:53.209489  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.172972  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.174978  5782 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.177856  5831 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:53.183239  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 85253.9us
I20260709 13:01:53.184717  1617 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.162184  5630 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.114943  5503 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:53.209954  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.217912  2263 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:53.218779  1544 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.218550  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:53.134465  5811 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.220459  1545 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:53.240036  2259 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.242678  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.244062  2258 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
W20260709 13:01:53.259845  2258 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 937) took 1403 ms (client timeout 1698 ms). Trace:
I20260709 13:01:53.247362  5338 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.254997  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.256346  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:53.258586  1614 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:53.245971  1687 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:53.268977  1614 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.4-10.4]
W20260709 13:01:53.260524  2258 rpcz_store.cc:269] 0709 13:01:51.856018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.201989 (+1345971us) service_pool.cc:224] Handling call
0709 13:01:53.259791 (+ 57802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:53.274314  1620 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:53.274930  1616 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:01:53.279656  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:53.281473  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.241696  1440 catalog_manager.cc:5697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 8. New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.282127  1617 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:01:53.282764  5704 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.114573  5779 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:53.277796  5846 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:01:53.283016  1440 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:01:53.283919  5779 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.284659  1440 catalog_manager.cc:5697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:01:53.285857  5503 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:53.286693  5568 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:53.287667  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:53.288287  1692 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.291136  1538 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.293264  2261 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.294888  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:53.296525  1545 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:53.297917  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:53.299995  5630 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:53.300300  5820 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.806s	user 0.005s	sys 0.000s
I20260709 13:01:53.301865  5568 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:53.302380  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.302721  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.321796  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.322338  1620 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.304519  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47468 (request call id 767) took 1133 ms. Trace:
I20260709 13:01:53.305709  1619 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:53.306519  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.307559  5394 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.307819  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2073) took 2009 ms. Trace:
I20260709 13:01:53.308154  5834 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:53.309195  5826 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:53.290942  1440 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 8, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.318003  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.318549  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.319083  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2063) took 2105 ms. Trace:
W20260709 13:01:53.322865  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.322832  1622 rpcz_store.cc:276] 0709 13:01:52.171563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.446466 (+274903us) service_pool.cc:224] Handling call
0709 13:01:53.304311 (+857845us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400230854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:53.304457 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1228749184}
I20260709 13:01:53.292423  5813 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.328424  1692 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 8.
I20260709 13:01:53.329834  2262 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:53.330652  1617 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [8.3-11.4]
I20260709 13:01:53.331009  2258 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.327221  1661 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:53.338425  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.337534  1541 rpcz_store.cc:276] 0709 13:01:51.213430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.213615 (+   185us) service_pool.cc:224] Handling call
0709 13:01:51.228981 (+ 15366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.208192 (+1979211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.313240 (+105048us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400106654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:53.319006 (+  5766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4434421120}
W20260709 13:01:53.339804  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.276990  5338 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.314584  5503 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:53.357632  1616 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:53.355713  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:53.361958  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.324559  1547 rpcz_store.cc:276] 0709 13:01:51.297910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.298043 (+   133us) service_pool.cc:224] Handling call
0709 13:01:51.298416 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:51.298672 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:51.325628 (+ 26956us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.368384 (+ 42756us) log.cc:844] Serialized 14 byte log entry
0709 13:01:51.784380 (+415996us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b1800118900. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177bb2a6 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1
0709 13:01:51.786203 (+  1823us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800118900. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:52.229726 (+443523us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b1800118900. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177bb2a6 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f
0709 13:01:52.230877 (+  1151us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b48000030d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:01:52.860720 (+629843us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b1800118900. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf 00007f7f1a8f4038
0709 13:01:52.874158 (+ 13438us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.040298 (+166140us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.176168 (+135870us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b1800118900. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:53.239095 (+ 62927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.271267 (+ 32172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:53.307372 (+ 36105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.307503 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.307646 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1193233,"prepare.queue_time_us":1554551,"prepare.run_cpu_time_us":226,"prepare.run_wall_time_us":3227,"raft.queue_time_us":95798,"raft.run_cpu_time_us":4044,"raft.run_wall_time_us":878793,"spinlock_wait_cycles":161048704,"thread_start_us":320753,"threads_started":3,"wal-append.queue_time_us":457819,"wal-append.run_cpu_time_us":1914,"wal-append.run_wall_time_us":1011885}
I20260709 13:01:53.362830  5847 raft_consensus.cc:2804] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:53.362013  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.362852  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.364504  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:53.397389  2258 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:53.365154  5767 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:53.366401  1614 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:53.366899  5723 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:53.368039  5848 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:53.327988  5834 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:53.388917  5836 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.564s	user 0.001s	sys 0.001s
I20260709 13:01:53.370414  1440 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 8, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.320284  5769 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:53.324476  5394 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.375316  5338 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:53.375356  5686 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:53.379251  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 385989us
W20260709 13:01:53.384593  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.385169  1538 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:01:53.388134  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:53.388798  1511 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.389626  5813 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:53.391824  5811 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.393671  1687 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:53.395018  1620 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:53.401785  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.402066  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:53.404309  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48646.1us
W20260709 13:01:53.410064  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 136577us
I20260709 13:01:53.404228  5818 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.403676  5783 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:01:53.413740  5667 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:01:53.415153  5714 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:53.429152  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.474020  2263 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:53.359880  5503 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.431102  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:53.438777  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 50073.1us
W20260709 13:01:53.438853  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 50818.7us
I20260709 13:01:53.423642  5768 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:53.478089  5630 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:53.478999  5768 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:53.479156  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.479295  5630 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:53.479809  2266 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:53.479879  5630 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:53.480044  5394 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.481091  5394 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.480779  5630 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.445847  1440 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 7 to 10, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:01:53.481951  5630 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.445202  5764 consensus_queue.cc:1048] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:01:53.445927  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.483175  2261 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:01:53.446134  5723 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.483950  5723 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.484325  5723 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.484041  1440 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 8, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.446558  5813 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:53.426904  5769 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:53.359287  5826 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:01:53.440548  5338 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:01:53.415341  5847 raft_consensus.cc:697] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.490454  5338 consensus_queue.cc:1243] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:53.490208  5769 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:53.490903  5853 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 13:01:53.491590  5769 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:53.491392  5847 consensus_queue.cc:237] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:53.492533  5833 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:53.494592  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 696) took 1087 ms. Trace:
I20260709 13:01:53.494714  5577 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:53.495182  2260 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:53.465158  5706 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:53.477146  5503 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.471490  2258 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:01:53.453001  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.501724  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.497277  1585 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:53.477995  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.445013  5772 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.427433  5536 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:01:53.480131  5768 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.489032  5714 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.463985  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:53.498543  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.494978  1688 rpcz_store.cc:276] 0709 13:01:52.407523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.407664 (+   141us) service_pool.cc:224] Handling call
0709 13:01:52.426130 (+ 18466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:52.452140 (+ 26010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.452159 (+    19us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:52.472071 (+ 19912us) log.cc:844] Serialized 52 byte log entry
0709 13:01:52.768995 (+296924us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:52.812049 (+ 43054us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.373336 (+561287us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18003e2d80. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf 00007f7f1a8f4038
0709 13:01:53.373535 (+   199us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.373728 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.373807 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.387650 (+ 13843us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b18003e2d80. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:53.491826 (+104176us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:53.494365 (+  2539us) raft_consensus.cc:1685] finished
0709 13:01:53.494390 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.494532 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":543468,"prepare.queue_time_us":589884,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2434,"raft.queue_time_us":25769,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":15678,"spinlock_wait_cycles":141194752,"thread_start_us":198563,"threads_started":1,"wal-append.queue_time_us":221161}
I20260709 13:01:53.496392  5706 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:53.503204  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.418838  5767 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.544389  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:53.548183  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.549580  2258 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.508080  5704 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:53.509630  5692 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:53.519191  5706 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:53.539995  5536 consensus_queue.cc:1243] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:53.534920  5811 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.572829  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.556308  5848 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.486151  1440 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 7, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.544035  5782 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:53.582526  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 118650us
W20260709 13:01:53.583025  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 163404us
I20260709 13:01:53.588030  2260 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:01:53.553215  5702 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:53.589469  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.560523  5704 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.593811  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:53.575147  1659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:32925 timed out after 1.698s (SENT) [suppressed 9 similar messages]
I20260709 13:01:53.596647  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:53.571589  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 140215us
I20260709 13:01:53.553099  5813 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:01:53.601490  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.603040  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80820.7us
I20260709 13:01:53.581291  5831 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:53.588478  5811 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.581825  5692 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:53.610503  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.607879  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:53.594856  5536 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:53.616715  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.611742  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:53.569161  5852 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:01:53.621203  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.592903  5782 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.591511  5612 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:01:53.595991  5702 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:53.599713  5704 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:53.602151  5629 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:53.639366  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.688259  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.624526  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:53.674793  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:53.767496  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.809396  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 184974us
I20260709 13:01:53.669595  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:53.798947  2260 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:53.751227  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 139546us
W20260709 13:01:53.682047  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.725879  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.811144  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:53.622656  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 76296.8us
I20260709 13:01:53.814731  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:01:53.819111  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.603938  5850 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:53.611266  5811 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:53.821877  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.725224  5671 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.214s
W20260709 13:01:53.786300  5854 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:01:53.828997  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 154336us
I20260709 13:01:53.829839  5629 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:53.830039  5106 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:53.830364  5813 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:53.672567  5672 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:53.688433  5831 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:53.835186  5855 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:01:53.835491  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.836158  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.823042  5850 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.698124  5828 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:53.823523  5686 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.809047  5702 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:53.757259  5634 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:53.619801  5536 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:01:53.823004  5856 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:01:53.820043  5842 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.847208  5813 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:53.753961  5857 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:53.849597  1621 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:53.822819  5783 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.691431  5859 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 13:01:53.836983  5546 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:53.891323  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.895572  2262 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:53.843839  5612 consensus_queue.cc:1243] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:53.871043  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 261032us
I20260709 13:01:53.897198  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:53.692214  5195 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.338s
I20260709 13:01:53.688685  5858 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 13:01:53.841557  5767 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.850344  5847 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:53.854288  5672 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.807665  5692 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.669466  5714 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:53.755795  5848 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.889384  5634 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:53.893311  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 276026us
I20260709 13:01:53.873579  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:53.898262  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:53.860939  5850 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:53.899695  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.903172  1618 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:53.907899  1617 pending_rounds.cc:85] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 2
W20260709 13:01:53.887180  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.937455  1617 pending_rounds.cc:107] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:53.932045  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.937879  1617 raft_consensus.cc:2889] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.854698  5106 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:53.892447  5834 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:53.940099  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.944553  2260 raft_consensus.cc:2376] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
W20260709 13:01:53.946480  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 131872us
I20260709 13:01:53.947695  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:53.948513  2262 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:53.955435  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:53.957370  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:53.965713  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 154626us
I20260709 13:01:53.920379  5672 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:53.945757  5779 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
W20260709 13:01:53.972887  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.975704  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 1990) took 1031 ms. Trace:
I20260709 13:01:53.864434  5831 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.935294  5859 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.929793  5847 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:53.934541  5767 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.970328  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.893536  5826 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:01:54.009006  5876 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:54.015285  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59957.2us
I20260709 13:01:53.976178  1615 rpcz_store.cc:276] 0709 13:01:52.944077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.008976 (+ 64899us) service_pool.cc:224] Handling call
0709 13:01:53.009336 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:53.273033 (+263697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.273063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:53.273736 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:01:53.569586 (+295850us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:53.748587 (+179001us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.748811 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.748894 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:53.975510 (+226616us) raft_consensus.cc:1685] finished
0709 13:01:53.975530 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.975647 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353544,"prepare.queue_time_us":253703,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3333,"raft.queue_time_us":266385,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":6158,"thread_start_us":391349,"threads_started":2,"wal-append.queue_time_us":312579}
I20260709 13:01:53.919780  5783 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:53.892287  5842 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.037371  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:53.950417  5671 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
W20260709 13:01:54.050894  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.862214  1440 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.919708  5629 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.115770  5634 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:54.119889  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 169430us
I20260709 13:01:54.048462  5631 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:54.185480  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:54.057577  5861 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:54.018887  5195 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:01:53.971060  5813 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:54.152601  5546 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:54.186400  5856 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:01:54.001961  5536 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.055871  5857 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:54.045089  5767 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.054756  5859 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:54.186573  5772 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.230710  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 227184us
I20260709 13:01:54.191075  5876 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:54.202793  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 234687us
W20260709 13:01:54.212761  5769 consensus_meta.cc:287] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.000s
I20260709 13:01:54.202541  5106 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:54.236801  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51438.3us
I20260709 13:01:54.252990  2261 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:54.253432  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:54.232409  5723 consensus_meta.cc:287] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.003s
W20260709 13:01:54.235601  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 288206us
I20260709 13:01:54.262239  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:54.264731  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 134489us
W20260709 13:01:54.245551  5394 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.003s
I20260709 13:01:54.284251  5195 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:01:54.288949  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.289494  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.290710  5868 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:54.291152  5868 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:54.291501  5868 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.294976  5857 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.284497  5879 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.282349  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.303723  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.305668  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:54.318989  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:54.271998  5723 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:54.307598  5865 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:01:54.298367  5671 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:01:54.242388  5876 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:54.259145  5577 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.290203  5546 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.337091  1615 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:54.316100  5706 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.000s
I20260709 13:01:54.316473  2262 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:54.266557  5813 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.268064  5818 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:54.327064  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55464.4us
I20260709 13:01:54.342454  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:54.327333  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 65329.7us
W20260709 13:01:54.289498  5503 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.000s
I20260709 13:01:54.320393  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:54.335772  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 403873us
I20260709 13:01:54.343847  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:54.347028  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:54.335188  5630 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.853s	user 0.005s	sys 0.009s
I20260709 13:01:54.356576  1587 leader_election.cc:400] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:54.356932  1587 leader_election.cc:403] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:54.238956  5772 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.359287  5881 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:54.359863  5870 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:54.360505  5873 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.361035  5864 log.cc:927] Time spent T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.443s	user 0.000s	sys 0.002s
I20260709 13:01:54.361363  5871 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:54.365356  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.373567  5767 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.373021  1440 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 10, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.336457  5394 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:54.344864  5577 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:54.379325  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.379850  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.380712  5577 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.336967  5834 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:01:54.348511  5706 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:54.383841  5704 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.001s
I20260709 13:01:54.384332  5704 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.384956  5706 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.369551  5195 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.348759  5503 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.387049  5195 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.387449  5195 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:54.388031  5702 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:01:54.388535  5503 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:54.388504  5702 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.368913  5667 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.361761  5723 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.390146  5818 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:54.240000  5847 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.391642  5782 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.393076  5772 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:54.395943  5672 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.397682  5612 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.398483  5779 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.398854  5872 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:54.358130  5811 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.000s
I20260709 13:01:54.336849  5852 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:01:54.407178  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52243.3us
I20260709 13:01:54.367815  5870 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:54.462001  1613 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:54.404350  5706 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
W20260709 13:01:54.461743  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 112694us
W20260709 13:01:54.469077  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.465093  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 126650us
W20260709 13:01:54.471064  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.361863  5875 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.197s
I20260709 13:01:54.437886  5834 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:54.475104  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 171514us
I20260709 13:01:54.475870  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.476925  1510 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:54.404947  5880 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:54.485523  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 366005us
I20260709 13:01:54.405172  5877 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.456794  5779 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:54.440181  5612 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:54.481645  1538 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:54.456645  5872 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:54.497656  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.498235  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.498555  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.488919  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:54.493153  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 137380us
I20260709 13:01:54.488168  5629 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.464524  5870 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.503988  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.400779  5873 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.504779  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.504053  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:54.498323  1541 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:54.506351  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:54.468183  5783 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:54.507258  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.485523  5723 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:54.534310  5723 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.534706  5723 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.536162  1613 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:54.536089  5868 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.538914  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.510527  1547 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:54.540982  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.512655  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.513640  2262 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:54.514756  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.518484  2261 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:54.543928  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:54.544899  5887 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:54.545481  5887 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:54.546527  5887 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.462321  5878 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:01:54.491467  5877 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.550752  5877 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.557196  5873 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.558234  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:54.558473  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.462472  5811 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.506942  5834 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:54.517551  5195 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.522769  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.500866  5629 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.564994  1542 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:54.522398  1440 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.523141  5779 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.575866  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:54.576756  2262 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:54.494802  5818 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:01:54.504518  5394 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:01:54.531340  5885 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:54.586601  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.532675  5783 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:54.588847  1547 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:01:54.532812  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.491869  5842 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.533874  5702 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.562314  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.591779  1541 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
W20260709 13:01:54.565618  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 207944us
I20260709 13:01:54.569123  5106 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:54.499940  5872 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.568449  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:54.571561  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.598562  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.599140  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.570792  5834 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:54.573077  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1735957010000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:01:54.631434  1587 connection.cc:256] RPC call timeout handler was delayed by -1.1168957009999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:01:54.631867  1587 connection.cc:256] RPC call timeout handler was delayed by -1.0736957010000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260709 13:01:54.525982  5874 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:54.488404  5831 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:01:54.637511  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 136662us
I20260709 13:01:54.580691  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.640005  1538 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:01:54.506664  5880 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:54.590546  1539 raft_consensus.cc:2368] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
W20260709 13:01:54.580103  5850 consensus_meta.cc:287] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:01:54.641031  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.570710  5629 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:54.562374  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 204051us
I20260709 13:01:54.599915  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:54.538478  5868 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:54.634075  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101369us
W20260709 13:01:54.647410  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47569.7us
I20260709 13:01:54.645164  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:54.654421  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:54.630331  5818 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:54.633385  5842 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:54.665644  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:54.666548  2262 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:54.641851  5874 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.683660  5874 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.670682  5834 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.650135  5783 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:54.691718  1622 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:54.688112  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.682206  1440 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.587080  5612 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.651204  5704 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.694329  1615 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:01:54.654016  5106 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:54.657541  5831 consensus_queue.cc:1243] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:01:54.656322  5897 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.652838  5871 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:54.705329  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:54.707226  1621 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:01:54.711369  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:54.714457  1618 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.648078  5850 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.715377  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.708056  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:54.690589  5890 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:54.721762  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:54.722189  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.694545  5869 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:54.653227  5848 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:01:54.788573  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 77660.4us
I20260709 13:01:54.702584  5106 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.694911  5783 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:54.730968  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:54.748718  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 94422.2us
I20260709 13:01:54.754793  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:54.725549  2261 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:54.769726  1618 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:54.751849  1538 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:54.763708  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:54.758232  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.731906  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.762118  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.750798  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:54.809002  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.798072  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:54.796324  2262 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
W20260709 13:01:54.793510  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.708756  5897 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:54.690016  5842 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.894002  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.719745  5847 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.896116  1538 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:54.837440  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.707584  5672 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.897864  2260 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.896601  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:54.738797  5850 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:54.731297  5886 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:54.902576  1693 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:54.799060  5828 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.938s	user 0.004s	sys 0.009s
I20260709 13:01:54.767261  5394 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.914808  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 116866us
I20260709 13:01:54.823132  5818 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:54.761847  5195 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.907035  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.902170  5783 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.767167  5879 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:54.724076  5868 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.741591  5858 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:54.902678  5106 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.935359  2259 raft_consensus.cc:2410] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:01:54.943262  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.822552  5859 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
W20260709 13:01:54.971069  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.973826  5811 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:54.975987  5874 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.977192  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:54.978121  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:54.978588  1546 raft_consensus.cc:2368] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10.
I20260709 13:01:54.978678  5412 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:54.979136  5412 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:54.979902  5412 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.981065  5412 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:54.981436  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:54.981985  1622 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:54.982137  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:54.720752  5871 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.982779  1693 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:54.984268  5871 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:54.984840  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:54.985221  5782 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.985363  1614 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:54.942997  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:54.945528  5631 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:54.946682  5772 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.947355  5903 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:54.950294  5536 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:54.954768  5667 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.955700  5873 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:55.041042  1617 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:54.955473  5869 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:54.961431  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 635) took 1648 ms. Trace:
I20260709 13:01:54.912016  5702 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:54.778527  5629 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.916774  5672 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:54.962872  5897 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.737164  5880 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.761210  5723 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.993777  2260 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:54.939767  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:54.742944  5882 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.216s
I20260709 13:01:55.102087  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:55.002802  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.103386  1691 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:54.941968  1538 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:54.937649  5893 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:55.001260  5631 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.044255  5887 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:55.104871  5631 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.008665  5877 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.105350  5887 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.107586  5877 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.108330  5887 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:55.010757  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.109790  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.080925  1614 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:55.021009  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:55.021523  2231 leader_election.cc:336] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.514s (SENT)
W20260709 13:01:55.111099  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 89612.1us
W20260709 13:01:55.111732  2231 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.547s (SENT)
I20260709 13:01:55.112128  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:55.113153  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.022284  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.114708  1621 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:55.025038  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.033321  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.035446  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:55.021009  1660 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.116262  2266 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:55.116581  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 95637.5us
I20260709 13:01:54.961447  5842 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.047987  1542 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:01:55.119772  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.120330  1542 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.050916  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:55.048233  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.123145  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.047384  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.978175  5874 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.124257  1547 raft_consensus.cc:2393] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:55.124734  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:55.125344  1547 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:55.047910  1689 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:55.049212  2259 rpcz_store.cc:276] 0709 13:01:53.313238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.313367 (+   129us) service_pool.cc:224] Handling call
0709 13:01:54.961214 (+1647847us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54006a0254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:54.961347 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3674513792}
W20260709 13:01:55.050220  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47913.3us
I20260709 13:01:55.057204  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.057827  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.058091  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:54.926836  5847 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:54.939210  5394 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.130604  1539 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:55.131402  1547 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:55.103842  5723 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.018573  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:55.132891  5394 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.133471  1547 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:01:55.102667  1540 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:55.054021  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.132936  1539 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:54.944128  5818 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.125417  1691 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:55.172561  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.172997  1541 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
W20260709 13:01:55.079177  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.020117  5772 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.138808  1690 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:01:55.173988  1690 pending_rounds.cc:85] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 3
I20260709 13:01:55.174340  1690 pending_rounds.cc:107] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:01:55.174672  1690 raft_consensus.cc:2889] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.138139  2266 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:55.175515  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.176034  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.176535  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:55.146548  1542 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:01:55.003196  5858 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.002974  5868 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:55.178722  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 157779us
I20260709 13:01:55.039332  5873 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:55.179527  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:55.189674  1538 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.147289  5702 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:55.193058  5702 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:55.199088  5870 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:01:55.199734  5870 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.208103  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:55.208844  2263 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:54.757246  1440 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 1 to 8, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:55.100085  5672 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.222786  1617 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:55.217046  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:55.202576  5870 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.213716  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.179801  5893 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:55.180260  5394 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:55.225199  5704 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:55.233013  5875 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:55.077207  5898 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:01:55.270035  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.237183  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:55.181071  5828 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:55.058797  5667 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.260126  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:55.295606  2263 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:01:55.265865  1538 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:55.297673  1545 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:55.302371  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:01:55.302963  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89370.1us
I20260709 13:01:55.303045  1619 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:55.304507  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51013.2us
W20260709 13:01:55.305840  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45837.4us
I20260709 13:01:55.248716  5714 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:55.241966  5629 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.249078  5887 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:55.254213  5878 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:55.211948  5686 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.062s
W20260709 13:01:55.312480  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 75390.9us
I20260709 13:01:55.319260  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:55.315989  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.325634  1615 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:55.324890  1693 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
W20260709 13:01:55.311412  5851 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:01:55.303694  5893 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:55.335189  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:55.356686  2263 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.291601  5394 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:55.340523  1615 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:55.344496  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.311728  5891 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:55.313357  5887 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:55.262885  5867 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:01:55.355772  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.321905  5723 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:55.326171  5870 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:55.316319  5874 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:55.384936  2259 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:55.372417  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 432765us
I20260709 13:01:55.309413  5704 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.315817  5878 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:55.373312  2262 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:01:55.388638  2262 pending_rounds.cc:85] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 8
W20260709 13:01:55.374933  5872 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:01:55.388931  2262 pending_rounds.cc:107] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:01:55.389204  2262 raft_consensus.cc:2889] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:55.373867  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57969.8us
I20260709 13:01:55.373099  5887 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:01:55.374114  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68948.5us
I20260709 13:01:55.391461  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:55.391855  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.382405  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:55.365290  2260 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:01:55.361552  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.369314  5634 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:55.374607  5869 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:55.380196  2261 raft_consensus.cc:1275] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:55.381162  5629 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:55.398306  5686 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.411945  5869 consensus_queue.cc:1243] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:55.412093  2261 pending_rounds.cc:85] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 10
I20260709 13:01:55.412559  2261 pending_rounds.cc:107] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:55.412515  5686 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.388660  5723 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.399418  5704 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.405359  5858 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.408597  1696 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:01:55.412955  5874 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:55.404527  5914 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:55.412981  2261 raft_consensus.cc:2889] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.379736  5891 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.419554  1619 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:55.425772  1617 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:55.428732  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.430991  1691 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 9.
I20260709 13:01:55.429821  2263 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
W20260709 13:01:55.431135  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 414964us
I20260709 13:01:55.389827  5878 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.402469  5782 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:01:55.444793  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 331102us
W20260709 13:01:55.447512  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56154.6us
W20260709 13:01:55.448042  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.448463  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.439924  5831 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:55.419746  5828 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.419410  5874 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.376446  5672 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.423720  5914 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:55.394479  5872 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.459534  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.464303  1542 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:01:55.460501  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.461823  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.464841  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.463313  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:55.465451  1538 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:55.465540  1543 raft_consensus.cc:2368] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14.
I20260709 13:01:55.465266  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.443897  5782 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:55.446357  5634 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.450038  5629 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:55.487462  1622 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.006s
I20260709 13:01:55.458323  5914 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.454348  5916 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:55.443557  5871 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:55.456763  5818 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:55.560920  1687 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.006s
I20260709 13:01:55.561410  1687 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:55.511108  1615 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:55.493034  1546 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:55.497664  1547 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:55.493017  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.490751  1622 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:01:55.559815  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:55.505355  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60766.3us
I20260709 13:01:55.564930  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.566437  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.578159  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.579062  1619 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:55.567004  5893 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:55.459065  5394 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.571065  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.588064  1613 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 9: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:01:55.495230  5911 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:01:55.470316  5905 log.cc:927] Time spent T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:01:55.504475  5910 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:55.598537  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.493709  5629 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.499866  5634 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.582154  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:55.583617  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.588215  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 117145us
I20260709 13:01:55.572386  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.590525  5893 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:55.609584  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.610852  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:55.496567  5908 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:01:55.614823  5842 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:55.572202  5714 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:55.487818  5906 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:55.616209  5906 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.617180  5906 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.457032  5828 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:55.600327  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 208432us
I20260709 13:01:55.498400  5667 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.494053  5868 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.619427  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.619683  5828 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:55.620253  5818 raft_consensus.cc:2764] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:55.620579  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.621361  5818 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:55.621742  5818 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.622051  5818 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.622220  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.624557  1587 leader_election.cc:400] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11.
I20260709 13:01:55.625209  1542 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:01:55.625886  1587 leader_election.cc:400] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10.
I20260709 13:01:55.626803  5702 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:55.628211  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:55.628353  5702 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:55.628762  5702 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.629133  5702 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.487248  5834 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:01:55.469844  5630 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:01:55.468120  5783 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.636194  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:55.640906  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2501) took 1036 ms. Trace:
I20260709 13:01:55.641474  1541 rpcz_store.cc:276] 0709 13:01:54.596763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.634543 (+ 37780us) service_pool.cc:224] Handling call
0709 13:01:55.633438 (+998895us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400257454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:55.633545 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260776832}
I20260709 13:01:55.630887  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:01:55.632843  5667 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.664840  5667 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.504336  5873 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.667375  5873 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:55.669072  5878 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.670962  5868 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:55.500171  5106 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.671411  5868 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.671819  5868 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:55.673049  5106 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.674794  5828 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:55.675800  5828 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:55.676136  5828 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:55.677007  5828 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.493716  5891 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.678191  5828 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.664332  1691 raft_consensus.cc:606] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:55.602993  5536 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:55.679930  1613 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:55.513154  5887 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.696012  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:55.696805  1613 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.624523  5893 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.630447  5850 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:55.708088  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.708812  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:55.713879  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.714663  1543 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:55.709461  1616 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:55.715241  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.716763  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.713917  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.720323  1694 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 8.
I20260709 13:01:55.724078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.718513  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.725080  1692 raft_consensus.cc:1217] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Deduplicated request from leader. Original: 3.3->[4.4-10.7]   Dedup: 8.6->[10.7-10.7]
I20260709 13:01:55.725142  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.725795  1692 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: [4.4-10.7]
W20260709 13:01:55.726591  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 166906us
I20260709 13:01:55.730504  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:55.731408  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.702898  5764 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:55.729715  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:55.729882  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.588725  5916 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.591240  5723 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.731959  1661 leader_election.cc:400] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14.
I20260709 13:01:55.733428  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:55.712399  5536 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:55.736459  1613 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:55.736120  1541 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:55.737190  1694 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:55.747582  1661 leader_election.cc:403] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:01:55.765439  1613 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:55.767088  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:55.768015  5871 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:55.724339  5850 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.770227  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:55.776527  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.770501  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.730803  5870 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.774010  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.774734  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.777614  1541 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:55.777599  1539 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:55.735445  5927 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:55.789921  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.794081  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.678709  5921 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:01:55.796810  1541 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:55.764499  5920 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.775331  5882 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:55.773602  5930 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:55.794116  5878 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.742759  5933 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:01:55.796236  5871 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:55.799688  5927 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.800693  5667 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.779194  5867 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:55.832369  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.837399  5918 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:55.841955  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.844262  5783 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:55.846585  2258 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:55.847828  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:55.848423  2266 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:55.849645  5914 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.858690  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:55.859299  5932 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:55.860003  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.861164  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.862249  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:55.863442  5893 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:55.833509  5872 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:55.872041  1510 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:55.795630  5870 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:55.873418  5901 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:55.829981  5935 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.163s
I20260709 13:01:55.981074  5935 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:55.980832  5536 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.991180  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:55.999714  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:55.922374  5704 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:55.763787  5876 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:55.813488  5920 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:56.013410  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 304894us
I20260709 13:01:55.884543  5702 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:55.929428  5818 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:56.021871  2266 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:01:56.022594  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.057283  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:55.834132  5930 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:56.065171  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:56.032186  5878 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:56.071641  1687 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:01:55.984059  5850 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:56.087944  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:56.054600  5887 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:56.089833  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:56.097659  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2504) took 1346 ms. Trace:
W20260709 13:01:56.093631  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.072s	sys 0.080s
W20260709 13:01:56.098351  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.072s	sys 0.080s
I20260709 13:01:56.101583  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:56.098241  1545 rpcz_store.cc:276] 0709 13:01:54.751524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.751639 (+   115us) service_pool.cc:224] Handling call
0709 13:01:54.751919 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.309090 (+557171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.097376 (+788286us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400256f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:56.097586 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254823680}
I20260709 13:01:56.102675  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:56.103870  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:01:56.104753  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 371417us
W20260709 13:01:56.113940  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 343782us
I20260709 13:01:56.121090  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:56.123075  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.215742  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 158582us
W20260709 13:01:56.224645  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 103638us
W20260709 13:01:56.277745  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.279047  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 154530us
I20260709 13:01:56.085660  5878 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:56.119835  5893 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:56.282181  2260 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:01:56.282356  2261 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.020190  5871 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:56.110481  5952 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.286371  5916 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:56.363057  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.120s (SENT)
I20260709 13:01:56.364954  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:56.365985  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 60493.8us
I20260709 13:01:56.305130  2263 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:56.286207  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.305620  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:56.299726  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:56.277454  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:56.363929  5952 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:56.294934  2266 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:56.101332  5872 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.213629  5928 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
W20260709 13:01:56.396515  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 96952.4us
W20260709 13:01:56.367785  5828 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.635s	user 0.023s	sys 0.018s
I20260709 13:01:56.216156  5921 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:56.287140  5704 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:01:56.397653  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 92194.7us
I20260709 13:01:56.317406  5672 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:01:56.305896  5887 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:56.431244  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 327420us
I20260709 13:01:56.442173  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:56.443987  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:56.424870  5878 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:56.379935  5957 raft_consensus.cc:2764] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:01:56.446326  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:56.407361  5870 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:56.483686  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 958) took 1119 ms. Trace:
I20260709 13:01:56.474905  5946 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:56.605491  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 238855us
I20260709 13:01:56.485702  5898 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.495568  5702 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:56.282819  5917 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:56.501974  1588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.011s	sys 0.029s
W20260709 13:01:56.618871  1588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.020s	sys 0.032s
I20260709 13:01:56.535205  1538 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:56.383074  5869 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
W20260709 13:01:56.474789  5934 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.472s	user 0.001s	sys 0.000s
I20260709 13:01:56.542900  1692 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:56.412801  5872 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:56.429972  5916 consensus_queue.cc:1048] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:01:56.286126  5935 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 13:01:56.440438  5927 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:56.482761  5878 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:56.534224  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2494) took 2021 ms. Trace:
I20260709 13:01:56.537941  5948 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:56.534653  5956 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.152s
I20260709 13:01:56.511499  5893 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:56.537318  5950 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
W20260709 13:01:56.536427  5939 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:01:56.533463  5778 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.599459  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 153277us
W20260709 13:01:56.603781  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 494027us
W20260709 13:01:56.665050  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.472931  5551 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:56.484790  5828 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.603459  2265 rpcz_store.cc:276] 0709 13:01:55.364030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.365796 (+  1766us) service_pool.cc:224] Handling call
0709 13:01:55.379388 (+ 13592us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.385458 (+  6070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.385485 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.386988 (+  1503us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.488923 (+101935us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:55.547744 (+ 58821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.547843 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.483429 (+935586us) raft_consensus.cc:1685] finished
0709 13:01:56.483454 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.483620 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5863,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3251,"thread_start_us":77489,"threads_started":1,"wal-append.queue_time_us":195165}
I20260709 13:01:56.483743  5933 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
W20260709 13:01:56.620100  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.621261  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 579) took 1009 ms. Trace:
I20260709 13:01:56.624799  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:56.621742  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 185873us
I20260709 13:01:56.627837  1615 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:56.679750  1614 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:01:56.606734  5818 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:56.648829  5920 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:56.678665  1538 rpcz_store.cc:276] 0709 13:01:55.612250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.534601 (+922351us) service_pool.cc:224] Handling call
0709 13:01:56.535017 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.620644 (+ 85627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.621182 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:56.647485  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.647930  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:01:56.681641  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.681787  1616 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
W20260709 13:01:56.650252  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.645690  1540 rpcz_store.cc:276] 0709 13:01:54.512832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.512936 (+   104us) service_pool.cc:224] Handling call
0709 13:01:54.513196 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.135013 (+621817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.533990 (+1398977us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540003b454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:56.534169 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355332352}
I20260709 13:01:56.652048  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:56.653015  1621 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:56.683266  1619 raft_consensus.cc:2368] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:01:56.608661  5946 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:56.683805  5946 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:56.684552  5966 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:01:56.685196  5975 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:56.657294  1622 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:56.652841  5948 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:56.673280  5868 consensus_meta.cc:287] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.001s	user 0.010s	sys 0.000s
W20260709 13:01:56.629182  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.658586  5338 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:56.670461  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.773077  2262 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:01:56.774117  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.619212  5898 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:56.669827  5778 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:56.692764  5882 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.879s	user 0.005s	sys 0.004s
I20260709 13:01:56.693188  5920 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:56.694126  5933 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:56.694410  5954 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:56.694741  5945 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:56.695369  5958 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.696178  5970 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:01:56.696458  5965 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:01:56.656335  5878 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:56.700079  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:56.659752  5930 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:56.681960  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2429) took 1738 ms. Trace:
I20260709 13:01:56.670008  5551 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.610790  5704 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.274833  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:56.802860  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:57.358098  1622 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:01:57.062849  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.020965  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:56.790961  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2423) took 1974 ms. Trace:
I20260709 13:01:57.007454  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:57.231693  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.255440  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:57.074920  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.360100  1696 rpcz_store.cc:276] 0709 13:01:54.722999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.723148 (+   149us) service_pool.cc:224] Handling call
0709 13:01:56.681233 (+1958085us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b540012cad4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:56.697785 (+ 16552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179757952}
I20260709 13:01:57.149981  5869 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:57.364825  5869 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.365576  1696 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:01:56.799333  5964 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:01:57.367218  5869 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:56.685727  5975 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.367905  5551 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:56.799297  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.812124  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2006) took 1533 ms. Trace:
I20260709 13:01:57.369550  5878 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:56.966583  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:57.357542  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.446863  1617 rpcz_store.cc:276] 0709 13:01:55.278505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.375142 (+ 96637us) service_pool.cc:224] Handling call
0709 13:01:55.425537 (+ 50395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.426132 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.811825 (+1385693us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b5400232150. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:56.812042 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89600768}
I20260709 13:01:56.783413  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:57.359845  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:57.378921  1689 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:57.379635  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2430) took 2367 ms (client timeout 1947 ms). Trace:
I20260709 13:01:57.387253  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.383397  1690 rpcz_store.cc:276] 0709 13:01:54.943772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.943945 (+   173us) service_pool.cc:224] Handling call
0709 13:01:54.944206 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.185369 (+241163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.681752 (+1496383us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000b45d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:56.681908 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445266816}
W20260709 13:01:57.238310  5934 log.cc:927] Time spent T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:01:57.387416  5920 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.038573  5927 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.379213  5958 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.379292  5882 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14.
W20260709 13:01:57.379850  5946 consensus_meta.cc:287] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.004s
I20260709 13:01:56.994738  5569 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.330981  5872 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.329703  5772 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:56.791635  5818 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.680825  5828 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:57.021562  5984 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:01:57.407384  1622 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:01:56.775105  5948 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:57.359470  5933 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:56.809692  5952 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:57.502594  5963 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:57.502979  5958 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.503855  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1785) took 1913 ms. Trace:
I20260709 13:01:57.491842  5569 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:57.504792  5938 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.200s	user 0.014s	sys 0.016s
I20260709 13:01:56.772243  5982 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.422885  1660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.020s	sys 0.017s
W20260709 13:01:57.505580  1660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.020s	sys 0.017s
W20260709 13:01:57.423328  1545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.014s	sys 0.024s
W20260709 13:01:57.506795  1545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.014s	sys 0.024s
I20260709 13:01:57.508718  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:57.509220  5882 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:57.509660  1620 raft_consensus.cc:2410] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 4.
I20260709 13:01:56.790922  5868 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.504289  1613 rpcz_store.cc:276] 0709 13:01:55.590575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.768183 (+177608us) service_pool.cc:224] Handling call
0709 13:01:55.768896 (+   713us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.990995 (+222099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.991029 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.004229 (+ 13200us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.303175 (+298946us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:56.303237 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.303347 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.503641 (+1200294us) raft_consensus.cc:1685] finished
0709 13:01:57.503660 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.503796 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96034,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":460430,"threads_started":2,"wal-append.queue_time_us":1322848}
W20260709 13:01:57.506954  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.512447  5868 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:01:57.465164  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.469111  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.514832  5842 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.515069  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:57.515780  1690 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:57.515455  5842 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.516824  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:57.470310  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.519925  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:57.416975  5945 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.808686  5338 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.004885  5723 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.437s
I20260709 13:01:57.420363  5954 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:01:57.428732  5714 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.005s	sys 0.014s
I20260709 13:01:57.492688  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.387140  5970 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.500891  5920 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.498056  5818 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.486163  5927 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.517693  1687 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:01:57.466905  1693 rpcz_store.cc:269] 0709 13:01:54.991860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.994166 (+  2306us) service_pool.cc:224] Handling call
0709 13:01:57.358866 (+2364700us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540040ea54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:57.358985 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480159616}
I20260709 13:01:57.523586  1690 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:01:57.528939  1540 raft_consensus.cc:1217] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 10.11->[11.12-13.13]   Dedup: 13.13->[]
W20260709 13:01:57.505651  5918 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.668s	user 0.013s	sys 0.003s
I20260709 13:01:57.550854  1540 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
I20260709 13:01:57.528249  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2120) took 2067 ms. Trace:
W20260709 13:01:57.544422  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.532616  5714 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.005s	sys 0.015s
I20260709 13:01:57.546700  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 583) took 1933 ms. Trace:
I20260709 13:01:57.554767  1541 rpcz_store.cc:276] 0709 13:01:55.613334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.545575 (+1932241us) service_pool.cc:224] Handling call
0709 13:01:57.545972 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.546211 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.546252 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.546312 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:57.546358 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.546435 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.546607 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.556706  1541 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:01:57.557435  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 584) took 1943 ms. Trace:
I20260709 13:01:57.557826  1541 rpcz_store.cc:276] 0709 13:01:55.613570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.556037 (+1942467us) service_pool.cc:224] Handling call
0709 13:01:57.556422 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.557129 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.557370 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.544422  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:57.559737  1620 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 8.
I20260709 13:01:57.552536  1689 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:01:57.553388  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.561934  1541 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 13:01:57.562927  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 585) took 1949 ms. Trace:
I20260709 13:01:57.525890  5978 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:57.563388  1541 rpcz_store.cc:276] 0709 13:01:55.613816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.561225 (+1947409us) service_pool.cc:224] Handling call
0709 13:01:57.561629 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.562590 (+   961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.562863 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.575212  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:57.551489  1546 rpcz_store.cc:276] 0709 13:01:55.460788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.577893 (+117105us) service_pool.cc:224] Handling call
0709 13:01:55.578257 (+   364us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:55.578665 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.578699 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:55.579358 (+   659us) log.cc:844] Serialized 78 byte log entry
0709 13:01:55.720075 (+140717us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:01:55.737509 (+ 17434us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.738321 (+   812us) log.cc:844] Serialized 14 byte log entry
0709 13:01:55.738737 (+   416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.738916 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.527953 (+1789037us) raft_consensus.cc:1685] finished
0709 13:01:57.527973 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.528171 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23934,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":14396,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":11413,"thread_start_us":140345,"threads_started":1,"wal-append.queue_time_us":247941}
I20260709 13:01:57.583448  5987 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:57.585968  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:57.588068  5818 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.589777  5927 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.591301  5778 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:57.591310  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:57.592633  5569 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:57.592912  5927 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:57.593309  5927 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:57.593676  5927 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.594244  5338 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.592402  5878 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.547646  5868 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:01:57.598824  5818 raft_consensus.cc:2764] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:01:57.631696  1546 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [8.8-11.10]
I20260709 13:01:57.618924  5569 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.637966  5877 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:57.637782  5569 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.638396  5877 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:57.489894  5946 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.563519  5918 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:57.516752  5982 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.642799  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 587) took 2028 ms. Trace:
I20260709 13:01:57.648200  5986 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:01:57.648545  5990 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:01:57.648691  5986 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.509838  5882 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.649145  5986 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:57.600283  5978 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.647686  1546 rpcz_store.cc:276] 0709 13:01:55.614330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.576607 (+1962277us) service_pool.cc:224] Handling call
0709 13:01:57.631308 (+ 54701us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:57.641220 (+  9912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.642731 (+  1511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.526856  5945 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.652344  5991 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.506714  5933 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.620635  5828 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.626439  5868 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:01:57.656688  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61207us
I20260709 13:01:57.663586  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:01:57.686879  1512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.234s	user 0.027s	sys 0.093s
W20260709 13:01:57.691221  1512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.028s	sys 0.093s
I20260709 13:01:57.693184  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:57.694244  1541 raft_consensus.cc:1217] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[10.10-11.11]   Dedup: 10.10->[11.11-11.11]
I20260709 13:01:57.694380  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:57.694864  1541 raft_consensus.cc:1240] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 13:01:57.695261  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2122) took 2234 ms. Trace:
I20260709 13:01:57.698778  1546 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 10. Ops: []
I20260709 13:01:57.695698  1545 rpcz_store.cc:276] 0709 13:01:55.461348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.124432 (+663084us) service_pool.cc:224] Handling call
0709 13:01:56.124801 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.125128 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.125155 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.222247 (+ 97092us) log.cc:844] Serialized 52 byte log entry
0709 13:01:57.507427 (+1285180us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:57.663634 (+156207us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.693701 (+ 30067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.693784 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.693822 (+    38us) raft_consensus.cc:1685] finished
0709 13:01:57.693835 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.695204 (+  1369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29808,"raft.queue_time_us":258124,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":10996,"thread_start_us":1228009,"threads_started":2,"wal-append.queue_time_us":1210995}
I20260709 13:01:57.597800  5954 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:57.702069  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 589) took 2086 ms. Trace:
I20260709 13:01:57.651489  5898 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:57.706080  1546 rpcz_store.cc:276] 0709 13:01:55.616117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.654075 (+2037958us) service_pool.cc:224] Handling call
0709 13:01:57.696354 (+ 42279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.701792 (+  5438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.702013 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.704906  1545 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 11. Ops: []
W20260709 13:01:57.736110  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 214241us
I20260709 13:01:57.739624  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 592) took 2122 ms. Trace:
I20260709 13:01:57.740120  1545 rpcz_store.cc:276] 0709 13:01:55.617013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.704234 (+2087221us) service_pool.cc:224] Handling call
0709 13:01:57.704610 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.739109 (+ 34499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.739315 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.742216  1546 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 13. Ops: []
I20260709 13:01:57.701653  5952 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:57.754607  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 593) took 2137 ms. Trace:
I20260709 13:01:57.701386  5818 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.701637  5872 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:57.755088  1546 rpcz_store.cc:276] 0709 13:01:55.617288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.709439 (+2092151us) service_pool.cc:224] Handling call
0709 13:01:57.742041 (+ 32602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.754275 (+ 12234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.754531 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.709273  5933 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:57.757827  1545 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:57.760666  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 594) took 2143 ms. Trace:
I20260709 13:01:57.761072  1545 rpcz_store.cc:276] 0709 13:01:55.617540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.757125 (+2139585us) service_pool.cc:224] Handling call
0709 13:01:57.757460 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.760383 (+  2923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.760607 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.706825  5930 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:01:57.758071  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57021.7us
I20260709 13:01:57.767095  1545 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:57.743947  5882 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.769623  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 731) took 2170 ms. Trace:
I20260709 13:01:57.769101  1546 raft_consensus.cc:1240] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:57.771477  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2507) took 2066 ms. Trace:
I20260709 13:01:57.773527  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2510) took 2067 ms. Trace:
I20260709 13:01:57.770978  1688 rpcz_store.cc:276] 0709 13:01:55.596732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.597150 (+   418us) service_pool.cc:224] Handling call
0709 13:01:55.633370 (+ 36220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.796083 (+162713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.796128 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.796194 (+    66us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:55.796244 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.766931 (+1970687us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540023b754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:57.766986 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.767126 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373668736}
I20260709 13:01:57.774063  1545 rpcz_store.cc:276] 0709 13:01:55.705791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.762352 (+2056561us) service_pool.cc:224] Handling call
0709 13:01:57.764048 (+  1696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.773202 (+  9154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.773449 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:57.773435  1546 rpcz_store.cc:276] 0709 13:01:55.705015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.759885 (+2054870us) service_pool.cc:224] Handling call
0709 13:01:57.768873 (+  8988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.771179 (+  2306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.771414 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:57.762204  5955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.009s	sys 0.026s
I20260709 13:01:57.783244  5915 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:01:57.783939  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.736182  5877 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.767738  5994 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.795003  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:57.702780  5991 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.775432  5978 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:57.787720  5955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.010s	sys 0.026s
I20260709 13:01:57.805897  5994 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.780628  5569 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.803143  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.801508  5952 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:57.787194  5975 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.806207  5915 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:57.823446  5946 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.823668  5897 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:57.824183  5946 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:57.824699  5946 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.825409  5991 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.825968  5991 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.802170  5927 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.835491  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.826406  5994 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.830113  5999 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.844000  5946 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:57.844627  5981 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:01:57.845103  5952 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.826406  5991 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.849335  5876 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:57.853040  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:57.833447  5970 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.859441  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:57.863710  6002 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.848742  5948 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.872246  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:57.874363  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:57.840339  5982 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:57.853986  5994 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:57.870354  5999 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.881384  5991 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:57.866400  5946 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:57.882495  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:57.887323  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:57.887940  1545 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:57.869848  5954 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:01:57.885155  5850 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.013s	sys 0.018s
I20260709 13:01:57.893956  6004 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:57.896529  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:57.929827  1546 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
W20260709 13:01:57.896960  5968 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 1.247s	user 0.014s	sys 0.012s
W20260709 13:01:57.926769  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.940085  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.939471  1688 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:01:57.942198  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:57.885773  5994 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:57.951179  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:58.011938  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 127618us
I20260709 13:01:57.895408  5946 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.014096  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 588) took 2399 ms. Trace:
I20260709 13:01:58.012576  1546 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:01:57.885072  6002 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:01:57.930684  5850 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.014s	sys 0.018s
I20260709 13:01:57.885321  5945 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.019519  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.021795  1546 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:01:58.022346  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.015739  1543 rpcz_store.cc:276] 0709 13:01:55.614577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.649703 (+2035126us) service_pool.cc:224] Handling call
0709 13:01:57.650187 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.650408 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:01:57.762577 (+112169us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.904469 (+141892us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.013773 (+109304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.013832 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:58.013886 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.013955 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.014049 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8078,"prepare.queue_time_us":168037,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":12211,"raft.run_wall_time_us":26866,"spinlock_wait_cycles":10402048,"thread_start_us":311162,"threads_started":3}
I20260709 13:01:58.023877  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.023948  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.024499  1688 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.025309  1696 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:58.031790  5948 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.036270  5994 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:58.040879  6012 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:01:58.041401  1690 raft_consensus.cc:2410] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:58.042321  5818 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:57.930558  6010 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.043520  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.049692  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.053140  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.056461  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.057322  1696 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:58.059785  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.000524  6004 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:57.930992  5954 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.069615  5914 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.071061  5999 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.071969  5612 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.051661  5948 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:58.052516  5915 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:58.073125  6002 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.058396  5569 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.052735  5945 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:01:58.090161  5686 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.091955  5946 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.082269  5948 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.095002  5986 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:58.108970  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 160452us
I20260709 13:01:58.052747  6010 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.110985  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 580) took 2498 ms. Trace:
W20260709 13:01:58.100634  5551 consensus_meta.cc:287] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.004s
I20260709 13:01:58.115123  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1817) took 1108 ms. Trace:
I20260709 13:01:58.115525  1687 rpcz_store.cc:276] 0709 13:01:57.006435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.006651 (+   216us) service_pool.cc:224] Handling call
0709 13:01:58.114918 (+1108267us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000b45d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.115062 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355249536}
I20260709 13:01:58.111403  1538 rpcz_store.cc:276] 0709 13:01:55.612543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.699460 (+1086917us) service_pool.cc:224] Handling call
0709 13:01:57.358162 (+658702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.379854 (+ 21692us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:01:57.813509 (+433655us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.108705 (+295196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.108784 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:58.110708 (+  1924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.110778 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.110928 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":843,"prepare.queue_time_us":376217,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1912,"raft.queue_time_us":113555,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5177,"thread_start_us":700299,"threads_started":3,"wal-append.queue_time_us":209694}
I20260709 13:01:58.117663  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2437) took 2407 ms. Trace:
I20260709 13:01:58.123067  6010 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.127748  6004 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.126394  1692 rpcz_store.cc:276] 0709 13:01:55.710492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.731147 (+ 20655us) service_pool.cc:224] Handling call
0709 13:01:55.746871 (+ 15724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.620527 (+873656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.117398 (+1496871us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002b8ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:58.117600 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830215424}
I20260709 13:01:58.134634  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 655) took 1399 ms. Trace:
I20260709 13:01:58.136447  5782 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.137428  5782 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.135105  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.138828  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.139096  5842 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.140331  1692 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: [3.3-8.6]
I20260709 13:01:58.128254  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.141788  1687 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:01:58.131233  6013 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:01:58.130851  5948 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.132309  5954 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.131235  5847 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.148468  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1824) took 1074 ms. Trace:
I20260709 13:01:58.149734  1692 rpcz_store.cc:276] 0709 13:01:57.067570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.139681 (+1072111us) service_pool.cc:224] Handling call
0709 13:01:58.140042 (+   361us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:01:58.141863 (+  1821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.142100 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.151425  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.134989  2265 rpcz_store.cc:276] 0709 13:01:56.734916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.735090 (+   174us) service_pool.cc:224] Handling call
0709 13:01:56.802166 (+ 67076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.411760 (+609594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.411817 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.423122 (+ 11305us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.666851 (+243729us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:57.666896 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.134219 (+467323us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54003a4654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:01:58.134268 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.134309 (+    41us) raft_consensus.cc:1685] finished
0709 13:01:58.134321 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.134557 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4450,"raft.queue_time_us":21693,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":20805,"spinlock_wait_cycles":1384124288,"thread_start_us":175882,"threads_started":1,"wal-append.queue_time_us":304553}
I20260709 13:01:58.153645  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.152419  1692 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:58.155853  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.130651  5986 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.162036  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.164322  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:58.166934  1545 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:58.163954  1687 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:01:58.159000  1543 raft_consensus.cc:2410] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:01:58.165817  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1823) took 1098 ms. Trace:
I20260709 13:01:58.174925  1687 pending_rounds.cc:85] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 4
I20260709 13:01:58.175447  1687 pending_rounds.cc:107] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:01:58.175073  1688 rpcz_store.cc:276] 0709 13:01:57.067247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.047835 (+980588us) service_pool.cc:224] Handling call
0709 13:01:58.060987 (+ 13152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.061191 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:58.064386 (+  3195us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.165487 (+101101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.165540 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:58.165591 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.165659 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.165772 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5382,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":5503,"thread_start_us":66431,"threads_started":1}
I20260709 13:01:58.114439  5551 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.182348  1687 raft_consensus.cc:2889] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:58.166165  5867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.692s	user 0.019s	sys 0.013s
I20260709 13:01:58.193847  5551 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.197274  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2017) took 1572 ms. Trace:
I20260709 13:01:58.180405  5106 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.235919  1696 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:58.303085  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.303617  1696 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:01:58.247586  5779 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.251035  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.250595  1544 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:58.299047  1618 rpcz_store.cc:276] 0709 13:01:56.624637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.624745 (+   108us) service_pool.cc:224] Handling call
0709 13:01:56.651014 (+ 26269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.651481 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:56.659854 (+  8373us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.511737 (+851883us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b18003ae8e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:01:58.087367 (+575630us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b18003ae8e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a 00007f7f1a8e4a2a
0709 13:01:58.142902 (+ 55535us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:58.149348 (+  6446us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.149482 (+   134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:58.149515 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.149579 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.197003 (+ 47424us) raft_consensus.cc:1685] finished
0709 13:01:58.197029 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.197206 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14879,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":5041,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":2030,"spinlock_wait_cycles":15344256,"thread_start_us":55230,"threads_started":1,"wal-append.queue_time_us":1485424}
I20260709 13:01:58.306402  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.306861  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.308285  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.309015  1688 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:58.310021  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.311542  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.312039  1696 raft_consensus.cc:2376] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14. Re-sending same reply.
I20260709 13:01:58.312966  1688 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.314918  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:58.298997  5867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.825s	user 0.019s	sys 0.013s
I20260709 13:01:58.315182  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.310753  5852 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.316515  1696 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 10 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:01:58.317891  5852 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.317238  1688 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.318581  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.305564  5106 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.320281  1696 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:58.326118  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.326915  1696 raft_consensus.cc:2376] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12. Re-sending same reply.
I20260709 13:01:58.321652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.329815  1688 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:58.334676  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.332484  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.322809  6010 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.334447  1695 raft_consensus.cc:2410] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:01:58.325266  5106 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.339037  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.346853  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.338555  5869 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.341075  6010 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.354485  6010 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:58.364483  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54697.1us
I20260709 13:01:58.368175  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.368528  1688 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:01:58.369415  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.370530  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.379827  5874 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.381117  5874 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.357473  5869 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.384934  5831 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:58.385337  5831 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:58.386447  5878 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:58.369503  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.388350  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.389202  1694 raft_consensus.cc:2376] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12. Re-sending same reply.
I20260709 13:01:58.388787  1688 raft_consensus.cc:2376] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14. Re-sending same reply.
I20260709 13:01:58.387061  5878 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:58.399672  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:58.400887  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.402146  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:58.386194  5831 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.403456  5831 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.411614  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:01:58.411885  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.417646  1696 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:01:58.419905  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:58.420890  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:58.423484  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.426584  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.428972  6016 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.422784  5906 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:58.421216  5876 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:58.430827  5906 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.424953  5612 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.419248  5851 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.427275  5850 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.425951  5783 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.425711  5974 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:58.446274  5813 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.004s	sys 0.007s
W20260709 13:01:58.448268  5813 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.007s
W20260709 13:01:58.441109  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.424204  5999 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:58.431270  5906 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:58.418784  6010 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:01:58.422935  6002 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:58.449257  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.446595  5850 consensus_queue.cc:1243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 11.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:58.452862  1694 raft_consensus.cc:2393] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.455786  1692 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:01:58.456121  1692 pending_rounds.cc:85] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 6
I20260709 13:01:58.444532  5106 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.456347  1692 pending_rounds.cc:107] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:01:58.458244  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.458706  1692 raft_consensus.cc:2889] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.448673  5852 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.449772  5783 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.468107  5917 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.468683  5917 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.462433  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.471446  6022 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:58.471788  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.462677  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.464449  5779 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.479328  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.451251  5999 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:58.454316  6002 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.499153  6002 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.500077  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 586) took 2886 ms. Trace:
I20260709 13:01:58.500530  1541 rpcz_store.cc:276] 0709 13:01:55.614055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.564517 (+1950462us) service_pool.cc:224] Handling call
0709 13:01:57.693956 (+129439us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.695304 (+  1348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.499858 (+804554us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000217d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.500009 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296865152}
I20260709 13:01:58.502517  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:58.503844  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.483969  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.472039  6022 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.483296  5779 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.490583  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.490870  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.491222  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.475687  1691 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:58.496136  5106 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.497234  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:58.507373  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.521831  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.523162  1542 raft_consensus.cc:606] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:58.523958  1542 raft_consensus.cc:614] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:58.485436  5999 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.524636  1547 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:58.526574  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.527184  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.529264  2258 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:58.525589  5988 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.530972  5988 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.528723  5917 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.536140  5612 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:58.541293  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:58.556727  5869 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.545327  5988 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.559532  1694 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:01:58.567003  6022 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.568198  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.569976  5927 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.570192  2263 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 13. Ops: []
I20260709 13:01:58.571412  5779 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.548228  5818 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.572312  5871 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.572873  5871 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.572775  5818 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.573236  5878 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.576376  1693 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9.
I20260709 13:01:58.576874  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1833) took 1044 ms. Trace:
I20260709 13:01:58.577222  1693 rpcz_store.cc:276] 0709 13:01:57.532540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.496893 (+964353us) service_pool.cc:224] Handling call
0709 13:01:58.576820 (+ 79927us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.574390  5878 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:58.583524  1511 connection.cc:256] RPC call timeout handler was delayed by -1.7567777880000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2277s for a response
W20260709 13:01:58.584983  5951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.154s	user 0.038s	sys 0.057s
I20260709 13:01:58.585515  1541 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:01:58.585959  1687 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.587250  1693 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.632550  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.633208  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:58.588754  1512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.866s (SENT) [suppressed 34 similar messages]
I20260709 13:01:58.604043  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.608700  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.580101  5961 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:58.611946  5818 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.618047  5927 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.618572  5941 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:58.618986  5893 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.619405  5887 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:58.619844  5930 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.620859  1619 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:01:58.644990  1687 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:58.621758  1618 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.622525  1615 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.647053  1615 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:58.645239  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1825) took 1271 ms. Trace:
I20260709 13:01:58.645641  1694 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:58.649258  1622 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:58.645928  1617 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.607910  5871 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.623955  5906 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:58.625627  5783 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.631057  5988 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.634382  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45669.7us
I20260709 13:01:58.634439  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.609922  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.659907  1546 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.636632  1620 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:01:58.644109  1693 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:01:58.661784  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:58.590814  5951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.162s	user 0.038s	sys 0.058s
I20260709 13:01:58.647838  1615 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.546645  5952 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:58.648874  1691 rpcz_store.cc:276] 0709 13:01:57.374392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.386962 (+ 12570us) service_pool.cc:224] Handling call
0709 13:01:58.645036 (+1258074us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400002154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.645180 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295601408}
I20260709 13:01:58.650097  1617 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:58.653049  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.658254  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.636449  1613 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:58.661078  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.648825  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.662600  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.665205  1615 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.668891  1543 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:01:58.665908  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.671341  1622 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:58.664011  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.666787  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.646163  5927 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:58.673367  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 129399us
I20260709 13:01:58.670073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.679481  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.681139  1616 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:01:58.668889  1617 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:58.680616  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.682263  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.682221  1617 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:58.682770  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.683075  1613 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:58.685194  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.685959  1543 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.686857  1541 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:58.687927  1622 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:58.688493  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.690363  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.647233  5961 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.654721  5893 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.650476  5941 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.654402  5887 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.656075  5930 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.698828  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:58.722232  1620 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:01:58.761250  1615 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:58.761854  1615 pending_rounds.cc:85] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 9
I20260709 13:01:58.762146  1615 pending_rounds.cc:107] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:58.762454  1615 raft_consensus.cc:2889] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:58.665124  5988 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.772847  1538 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:58.773114  1619 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:58.767750  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.773972  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.674796  5952 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.777204  1543 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:58.774783  1622 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:58.785346  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.787082  1543 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.693997  5818 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:01:58.790011  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.772562  5930 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.772593  5988 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:58.794288  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.795085  1543 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:58.800218  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.800782  1543 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:58.804993  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.807729  5961 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.809441  5952 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.809582  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.810878  5999 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:58.815515  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 124977us
I20260709 13:01:58.799779  5930 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:58.827431  1543 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:01:58.831418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:58.834183  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.833465  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.844530  5972 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:58.845043  5999 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:58.845414  5972 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.845762  5972 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:58.846961  5877 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:58.846517  5972 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.848305  5961 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:58.825963  5906 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:58.852926  1544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2500) took 4283 ms (client timeout 2002 ms). Trace:
W20260709 13:01:58.853331  1544 rpcz_store.cc:269] 0709 13:01:54.569831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.569986 (+   155us) service_pool.cc:224] Handling call
0709 13:01:58.852715 (+4282729us) spinlock_profiling.cc:243] Waited 3.54 s on lock 0x7b54000848d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.852812 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8152318336}
I20260709 13:01:58.861083  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.862210  1693 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.863077  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.864082  1687 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:58.865051  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.867975  5944 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.868300  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.868643  5944 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:58.869370  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2439) took 1294 ms. Trace:
I20260709 13:01:58.869876  1689 rpcz_store.cc:276] 0709 13:01:57.575430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.867969 (+1292539us) service_pool.cc:224] Handling call
0709 13:01:58.869298 (+  1329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:58.873709  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:58.876542  5872 consensus_queue.cc:1059] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:58.877350  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.878178  1545 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:58.879071  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.880007  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.877351  5872 consensus_queue.cc:1243] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:58.880956  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:58.881799  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 1819) took 1816 ms (client timeout 2182 ms). Trace:
W20260709 13:01:58.883348  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.849639  5988 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:58.887392  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:58.894086  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:58.854454  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.895553  1544 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:58.866431  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:58.897264  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 59085us
I20260709 13:01:58.890115  1694 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:01:58.882180  1695 rpcz_store.cc:269] 0709 13:01:57.065794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.066002 (+   208us) service_pool.cc:224] Handling call
0709 13:01:58.881599 (+1815597us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b540040f454. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.881739 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235278592}
I20260709 13:01:58.898639  6042 raft_consensus.cc:3055] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:58.899076  6042 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:58.899920  6042 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.901160  6042 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:58.902709  5887 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.903121  5893 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:58.895159  1545 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11. Re-sending same reply.
I20260709 13:01:58.906457  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49324 (request call id 17) took 3083 ms. Trace:
I20260709 13:01:58.906845  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:58.907035  1542 rpcz_store.cc:276] 0709 13:01:55.822606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.927497 (+104891us) service_pool.cc:224] Handling call
0709 13:01:58.906192 (+2978695us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b5400106154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d4853 00007f7f1f8a260a 00007f7f18e287d4 00007f7f18e28762 00007f7f18e28691 00007f7f18e2860c 00007f7f18e278c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.906339 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5801341824}
I20260709 13:01:58.907860  5944 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:58.910373  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:01:58.911691  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.893770  5988 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:58.913715  5631 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.913511  5988 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:58.914772  5988 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:58.888475  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:58.917060  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.917166  1693 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:58.917614  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.923569  1616 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:58.923503  1687 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:58.928761  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.931357  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.935459  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1839) took 1105 ms. Trace:
I20260709 13:01:58.935853  1692 rpcz_store.cc:276] 0709 13:01:57.829804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.360857 (+531053us) service_pool.cc:224] Handling call
0709 13:01:58.455457 (+ 94600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.459212 (+  3755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.935272 (+476060us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b54002f49d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.935402 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216882944}
I20260709 13:01:58.892288  1546 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:58.904654  5941 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:58.942598  1547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 2119) took 3476 ms (client timeout 2740 ms). Trace:
I20260709 13:01:58.889261  5972 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:58.947819  1547 rpcz_store.cc:269] 0709 13:01:55.460475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.572089 (+111614us) service_pool.cc:224] Handling call
0709 13:01:58.937128 (+3365039us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b5400106154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:58.937203 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6704038144}
I20260709 13:01:58.943681  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:58.945436  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.944929  1510 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:58.949072  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:58.949656  2266 raft_consensus.cc:2410] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:01:58.972965  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.978691  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.949890  2262 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:01:58.989437  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 45133.2us
W20260709 13:01:58.992372  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.015614  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.025390  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:58.953619  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.026063  1544 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
W20260709 13:01:59.026679  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 73145.3us
I20260709 13:01:59.027635  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.028277  1692 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:59.035431  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.036587  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.037173  2265 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:59.039922  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:59.041700  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:01:59.042608  1585 connection.cc:256] RPC call timeout handler was delayed by -1.4834647580000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
I20260709 13:01:59.043946  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:59.044214  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.045711  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.051492  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.052137  1544 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:59.052898  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.056293  1693 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
W20260709 13:01:59.056962  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 112120us
I20260709 13:01:59.059194  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 581) took 3446 ms. Trace:
I20260709 13:01:59.059674  1540 rpcz_store.cc:276] 0709 13:01:55.612808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.697633 (+1084825us) service_pool.cc:224] Handling call
0709 13:01:57.528731 (+831098us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.551251 (+ 22520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.058971 (+1507720us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54000483d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:59.059127 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659568000}
I20260709 13:01:59.062762  1510 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.071841  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:59.072649  1618 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.071841  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:59.076951  5704 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:59.075282  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:59.078053  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:59.075282  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.078948  1619 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:59.079388  1688 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:59.081597  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:59.089035  1617 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:59.089457  1617 pending_rounds.cc:85] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 9
I20260709 13:01:59.089682  1617 pending_rounds.cc:107] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:59.089913  1617 raft_consensus.cc:2889] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.098026  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.055192  5941 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:58.947446  5848 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.136s
I20260709 13:01:59.122443  1618 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:59.068766  5634 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.024699  5887 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:01:59.131969  1693 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:01:59.090801  5818 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.137809  1544 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:01:59.138872  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:59.133384  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70755.9us
I20260709 13:01:59.139452  1544 raft_consensus.cc:2376] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12. Re-sending same reply.
I20260709 13:01:59.139755  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.140071  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.140796  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:59.091391  5971 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.108319  5930 consensus_queue.cc:1243] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:01:59.149394  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 300118us
I20260709 13:01:59.154717  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.155522  1693 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:59.159857  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115969us
I20260709 13:01:59.077728  5704 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.180274  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:01:59.180886  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 134328us
I20260709 13:01:59.161908  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:01:59.150718  6029 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.433s	user 0.010s	sys 0.000s
I20260709 13:01:59.137645  5630 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.191459  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.186493  1617 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:01:59.151697  6004 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.141924  5893 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:59.135154  5612 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:01:59.198865  1540 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.192334  1688 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:59.141603  6043 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.195544  1616 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:59.200736  1616 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.198057  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:59.199077  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:01:59.148147  5723 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:01:59.149308  5818 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.204191  1613 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:59.204571  1613 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.204938  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.205515  1617 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:59.153276  5941 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:59.203200  1616 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.194765  6004 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.214376  5927 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.215929  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:01:59.229249  1621 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:59.210127  1693 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:59.213472  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:59.217993  1616 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.205317  1613 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.231854  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.152561  5971 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.202512  6043 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.227427  1617 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:01:59.207782  5878 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.006s
W20260709 13:01:59.206499  6002 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.006s
I20260709 13:01:59.215322  5630 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:59.232676  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.242774  1617 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.244326  1545 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:59.226217  6004 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.225847  6048 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:59.251498  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.245693  5887 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.246578  6042 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.247150  6002 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:01:59.249125  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 67579.8us
I20260709 13:01:59.249730  1540 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:59.256629  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.257709  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.260039  1545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:01:59.260690  1545 raft_consensus.cc:606] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.258194  1541 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:01:59.242316  6043 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.269315  1616 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:59.269820  1616 pending_rounds.cc:85] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 10
I20260709 13:01:59.272696  1616 pending_rounds.cc:107] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:59.273083  1616 raft_consensus.cc:2889] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:59.266127  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 191388us
I20260709 13:01:59.251753  6048 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.254838  5887 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.279986  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:59.282943  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.284648  5818 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:59.287109  6045 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:59.293895  1613 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:59.294405  5971 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.296554  1690 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.252422  5630 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.298946  5630 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:01:59.299361  6047 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:59.300427  5704 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.301275  1539 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:01:59.283283  5887 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:59.302778  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 595) took 3685 ms (client timeout 3184 ms). Trace:
I20260709 13:01:59.303299  6002 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:59.303148  1539 rpcz_store.cc:269] 0709 13:01:55.617811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.884392 (+266581us) service_pool.cc:224] Handling call
0709 13:01:59.302577 (+3418185us) spinlock_profiling.cc:243] Waited 3.31 s on lock 0x7b54000523d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:59.302706 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7607895424}
I20260709 13:01:59.305362  1690 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:01:59.306195  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.306854  1688 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:01:59.309012  1539 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:01:59.299163  1541 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:59.330108  1539 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:59.332430  1539 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.333974  1541 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:59.304138  5813 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.340394  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.341322  1688 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:59.357257  1544 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
W20260709 13:01:59.359326  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.385291  1693 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:59.387212  1688 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:59.394634  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:01:59.394531  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 243641us
I20260709 13:01:59.398561  1693 raft_consensus.cc:2410] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:01:59.330266  6048 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.363523  5813 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.401916  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.407979  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.407480  5893 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.414577  5893 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.275934  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.417088  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.419464  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:59.402595  5887 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.421598  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.421962  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.424727  6054 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.425203  6054 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.425628  6054 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.426021  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.432335  6055 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.411512  6046 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:59.420501  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.436110  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:59.437053  1660 connection.cc:256] RPC call timeout handler was delayed by -1.33975277899998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:01:59.437695  2261 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:51160
I20260709 13:01:59.438026  5877 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:59.438355  2261 raft_consensus.cc:606] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.439322  5667 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:59.439767  5667 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:59.440670  5667 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.441854  6043 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.442466  5667 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.443797  1660 leader_election.cc:400] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:01:59.444166  1660 leader_election.cc:403] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:59.444752  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.444968  5503 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:01:59.445523  5783 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.445935  5783 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:59.445919  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:59.446519  5783 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.448153  5878 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.448567  5878 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.452327  6043 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.449539  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.448946  5878 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.453428  5848 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
W20260709 13:01:59.470366  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 194522us
W20260709 13:01:59.470686  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51322.2us
I20260709 13:01:59.471362  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:59.457553  5394 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:59.472409  5394 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:59.472824  5394 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.473132  6057 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.473531  6057 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.473852  6057 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.474920  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:59.476263  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.480913  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:59.480944  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.474660  5887 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.484905  6069 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.485679  6069 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.486086  6069 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.486356  6004 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.487468  1543 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.488896  6004 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.491454  5878 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.492385  6054 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.493249  5878 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:59.495002  6070 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.501408  6070 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:59.501865  6070 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:59.505926  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.497076  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.497748  5945 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.506914  5945 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.507350  5945 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.507131  5783 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:59.508049  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.509497  5783 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.498768  5972 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:59.510941  5972 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:59.513293  5972 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:01:59.541779  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.543009  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46012.2us
I20260709 13:01:59.544064  1512 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.549244  5991 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:59.549970  5960 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:59.550145  1543 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:01:59.550604  1543 pending_rounds.cc:85] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 4
I20260709 13:01:59.550866  1543 pending_rounds.cc:107] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:01:59.551120  1543 raft_consensus.cc:2889] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.494493  6054 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:01:59.553745  1661 connection.cc:256] RPC call timeout handler was delayed by -1.1220092899999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:01:59.555274  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.557156  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.557178  6004 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:01:59.557255  5878 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.561259  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.559382  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.567530  1543 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:59.560994  6055 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:59.571550  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:01:59.573725  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.574426  5857 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.554425  5991 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:59.577566  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.577551  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.567329  6004 consensus_queue.cc:1243] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:59.582087  6055 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.583195  5916 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.566491  5848 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:59.566665  5672 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:01:59.557701  6065 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:59.578554  5503 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.564595  5891 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:01:59.601181  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.594455  6055 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.591771  6069 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.575546  5878 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.601181  5848 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.617563  1689 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.619279  5848 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:59.611344  5857 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:59.596556  1543 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.576350  6054 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:59.588649  5991 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.609555  1693 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:01:59.626147  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.610493  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.613517  1692 pending_rounds.cc:85] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 3
I20260709 13:01:59.627192  1692 pending_rounds.cc:107] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 11.4
I20260709 13:01:59.627388  1696 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:01:59.627511  1692 raft_consensus.cc:2889] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.627673  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.613634  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.613945  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.621832  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.629068  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.629484  1689 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:59.629649  1687 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.628541  1695 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:59.629091  1691 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:59.630908  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.631812  1695 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:59.632174  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.632922  1691 raft_consensus.cc:2376] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 9. Re-sending same reply.
I20260709 13:01:59.623559  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.634429  1694 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:59.634533  1691 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:01:59.635064  1691 pending_rounds.cc:85] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 5
I20260709 13:01:59.635350  1691 pending_rounds.cc:107] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:01:59.635537  1694 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 13:01:59.635627  1691 raft_consensus.cc:2889] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.637063  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.637625  1689 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:59.640200  1539 pending_rounds.cc:85] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 3
I20260709 13:01:59.640513  1539 pending_rounds.cc:107] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:01:59.640726  1539 raft_consensus.cc:2889] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:59.637637  1543 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:59.610124  6055 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.578166  6070 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.603832  5972 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.645910  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.633656  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.651738  1689 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:01:59.654646  1687 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:01:59.642396  5857 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:01:59.657092  5878 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.665342  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.665580  6054 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.666256  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.666438  5842 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.667032  5842 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.667284  2263 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:01:59.667547  5842 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.666133  6054 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.668785  2265 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:59.668769  1689 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:01:59.667450  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.669694  6054 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:59.666258  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.670143  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:01:59.670596  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.670745  5629 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.671365  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.671614  5629 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.670717  5988 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.672197  5629 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.672847  5704 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.673257  5704 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:01:59.673619  5704 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.672363  5988 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.674844  5988 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.675794  1543 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 13:01:59.676965  1512 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.680455  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:01:59.683450  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.682279  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:01:59.690485  5857 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.695674  6069 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.697454  5704 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.702822  6065 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:59.703431  6065 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:59.704324  6065 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.643352  5891 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:01:59.647436  5980 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:01:59.642491  5394 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.711349  2265 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.689656  5631 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:59.716714  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:01:59.727914  1687 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:59.729238  5394 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.730403  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.684398  6004 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:01:59.686815  5672 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:01:59.713178  5916 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.737501  5631 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:01:59.755311  5631 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:01:59.758880  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1800) took 1128 ms. Trace:
I20260709 13:01:59.759430  1620 rpcz_store.cc:276] 0709 13:01:58.629915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.660814 (+ 30899us) service_pool.cc:224] Handling call
0709 13:01:59.758559 (+1097745us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b54002b70d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:01:59.758779 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118732032}
I20260709 13:01:59.763007  5842 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.767599  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.773532  6070 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:01:59.747131  6004 consensus_queue.cc:1243] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 10.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:01:59.777729  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.779915  5842 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.770890  6057 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.785327  6057 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.775470  5980 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.792176  5980 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.795692  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:01:59.800343  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.800848  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.801054  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.804430  6058 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:59.804845  6058 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:01:59.798640  5980 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.815449  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:01:59.816124  1692 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:01:59.813915  2261 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEARNER]: Advancing to term 9
I20260709 13:01:59.817492  1585 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.814836  2259 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:01:59.817988  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.812350  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.818826  2265 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:01:59.822888  6043 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:59.817088  5857 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.823506  6043 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:01:59.823782  5857 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.824513  6043 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.827214  6058 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.828442  6058 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:01:59.835894  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.009s	sys 0.002s
W20260709 13:01:59.836398  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.009s	sys 0.002s
W20260709 13:01:59.836776  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 674954us
I20260709 13:01:59.837631  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:59.838753  6064 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.839267  6064 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.839646  6064 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.820745  5887 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:01:59.806649  5945 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.852571  5945 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.858547  2261 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:01:59.860597  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:59.863168  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.863726  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.864265  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.864714  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.866066  1510 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.866956  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.868022  1510 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.870209  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.874553  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.875733  2265 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:59.875756  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.877020  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.879189  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.873920  2261 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:59.882900  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.883808  2259 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:01:59.887068  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:01:59.888051  2258 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:59.886600  2257 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:01:59.890333  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.874953  5980 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.872296  6065 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.894783  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.872013  5811 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:59.906955  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.900636  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.901444  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:01:59.881820  5704 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.903242  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.882196  5887 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:59.909883  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.885737  6063 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.911680  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.915428  5887 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:59.916115  5887 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.916431  5887 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.916744  5887 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.912230  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:01:59.906005  5988 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.919263  2259 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 10: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:01:59.919699  6064 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.909325  6055 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.920576  5988 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.921737  6064 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.922554  2260 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:59.922468  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56665.2us
W20260709 13:01:59.931310  6081 log.cc:927] Time spent T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:59.931507  5887 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:01:59.901304  6070 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:59.898548  5980 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:01:59.934429  5887 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:01:59.908236  6043 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:59.908497  5972 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:59.963752  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:01:59.965252  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62078.7us
I20260709 13:01:59.922111  6055 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.966351  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:01:59.966892  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.969933  2259 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:59.970180  2257 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.923316  6063 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:59.905826  5629 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:01:59.910393  6056 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:01:59.963702  5980 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.971984  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.975798  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.977308  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:01:59.972493  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 62652.6us
I20260709 13:01:59.973945  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.965576  5972 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:01:59.983963  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.984306  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:01:59.984944  2261 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:59.985551  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:01:59.987085  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.987877  6064 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.981288  5887 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:01:59.988276  6064 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:01:59.988749  6064 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.991745  5629 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:01:59.981570  5988 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:59.980406  6043 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:59.995471  6043 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.995847  6043 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:59.998740  6065 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:00.002140  2257 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:01:59.978282  6063 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.010896  6093 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:00.011544  6093 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:00.012480  6093 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:00.014969  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.015699  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:01:59.981873  5394 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:00.016247  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.980978  5972 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:59.986642  6056 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.026152  2261 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:00.014838  6051 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:00.017824  6084 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:59.974938  5631 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:02:00.034776  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:01:59.981213  5916 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:02:00.020207  5887 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:59.980834  5704 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:02:00.021019  5394 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.982918  5503 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:02:00.033071  5629 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:00.047793  5848 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:00.040637  5887 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:00.054708  5848 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:00.055025  5887 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.055668  5848 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.056877  5848 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.059023  5503 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:00.059450  5503 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:00.059881  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1790) took 1442 ms. Trace:
I20260709 13:02:00.062965  2264 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: [10.9-12.10]
I20260709 13:02:00.060269  1614 rpcz_store.cc:276] 0709 13:01:58.617863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.626231 (+  8368us) service_pool.cc:224] Handling call
0709 13:01:58.626580 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.773637 (+147057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.773675 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.773726 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:58.773756 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.059677 (+1285921us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54001eb254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:00.059716 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.059828 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337788288}
I20260709 13:02:00.068451  5631 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:00.050789  5394 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:00.074929  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59318.2us
I20260709 13:02:00.041105  6064 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.070144  5629 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:00.176795  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.078310  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:00.197795  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 119575us
I20260709 13:02:00.198798  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:00.060324  5503 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.080687  5631 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:00.216768  6097 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:02:00.231495  6095 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:02:00.233907  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2135) took 1434 ms. Trace:
I20260709 13:02:00.234429  1541 rpcz_store.cc:276] 0709 13:01:58.799286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.334836 (+535550us) service_pool.cc:224] Handling call
0709 13:01:59.364362 (+ 29526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:59.364796 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.364837 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:59.917053 (+552216us) log.cc:844] Serialized 52 byte log entry
0709 13:01:59.968981 (+ 51928us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:59.986222 (+ 17241us) log.cc:844] Serialized 14 byte log entry
0709 13:02:00.020566 (+ 34344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.020647 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.233587 (+212940us) raft_consensus.cc:1685] finished
0709 13:02:00.233615 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.233825 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686,"prepare.queue_time_us":22578,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":3571,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":4305,"thread_start_us":51557,"threads_started":1,"wal-append.queue_time_us":106478}
I20260709 13:02:00.243002  6099 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:00.247390  5980 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.252348  5629 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.260352  6064 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.261304  6064 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.208372  5631 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:00.267844  5631 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.277208  6094 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:00.278023  6094 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:00.282671  2261 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:00.287214  6102 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:00.291987  5916 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.292702  5916 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.296612  2261 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.298032  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:00.269511  5631 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.317296  5848 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:00.324661  5630 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:02:00.326738  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.326520  6063 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.338554  5394 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.297215  5980 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:00.351671  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 152967us
I20260709 13:02:00.354530  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.355999  1587 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.358717  1587 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.360062  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:00.344702  6102 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:00.318442  6043 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.353276  5848 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:00.359257  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 325891us
I20260709 13:02:00.374236  2258 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:00.367290  6094 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.384626  6043 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.378736  5916 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:00.389138  5972 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.370918  5848 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:00.356416  6099 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:00.392663  6104 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:00.403986  5394 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.393592  6064 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:00.370854  6102 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.397769  6106 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.386093  5887 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:00.407436  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47442.6us
I20260709 13:02:00.394457  6043 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.406910  6051 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.391039  5848 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.411396  6051 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.419613  6110 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:00.425742  6051 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.426017  6110 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.420818  6099 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.423269  5972 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:00.422284  6102 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.436491  1545 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.419857  6043 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.424031  5848 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:00.441485  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.443919  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.444185  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:00.444934  6110 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:00.448019  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.452376  5503 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.452939  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:00.459558  5887 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.461879  5813 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:00.464097  5952 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:02:00.469137  1619 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.443552  6043 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.472411  6043 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.473156  1694 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
W20260709 13:02:00.473701  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.443327  6111 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:02:00.476649  5857 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:00.479219  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:00.480387  5972 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:00.480981  5972 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:00.481844  5972 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:00.485741  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.489094  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.489351  1614 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:00.489748  1613 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:00.490919  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.492841  6106 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.493525  6106 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.500806  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.501506  1618 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:00.504908  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.505527  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.506269  1613 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:00.507418  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.509363  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.510083  1618 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.511016  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.512017  1615 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.516048  6106 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:00.516909  1619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1808) took 1334 ms (client timeout 1639 ms). Trace:
W20260709 13:02:00.517379  1619 rpcz_store.cc:269] 0709 13:01:59.182025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.185531 (+  3506us) service_pool.cc:224] Handling call
0709 13:02:00.470603 (+1285072us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400341cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:00.516852 (+ 46249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2914769280}
I20260709 13:02:00.518784  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:00.519852  1693 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:00.523626  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:00.525938  6057 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.549201  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.549913  1615 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.560284  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.561221  1615 raft_consensus.cc:2410] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:02:00.561105  6093 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.561712  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.562350  1619 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:00.561046  1618 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:00.564936  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.565075  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.565557  1613 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:02:00.565821  1622 raft_consensus.cc:2410] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:00.564240  1614 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 13. Ops: []
I20260709 13:02:00.561923  6093 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:00.563439  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.569830  6093 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.571242  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.571935  1614 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:00.572822  1619 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.573830  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.574492  1615 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:00.577431  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.577732  5982 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:00.578197  5982 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:00.578575  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.579375  1613 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.582748  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.583444  1618 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.583119  5982 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.584559  5982 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.587962  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:00.588575  1541 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.589039  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:00.590394  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:00.590855  1546 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.591672  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:00.592193  1544 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.595974  1618 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:02:00.597522  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:00.598171  1539 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:00.600335  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.600962  1614 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 9.
I20260709 13:02:00.602515  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.603142  1613 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:00.605391  6063 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:00.605060  1539 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:00.674398  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:00.610585  1541 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:00.675210  1618 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.580339  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.676429  1619 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.677140  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.619076  1615 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:00.620213  1544 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
W20260709 13:02:00.626041  6049 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.219s	user 0.000s	sys 0.002s
W20260709 13:02:00.628921  6119 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:00.684931  1622 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.685097  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.645809  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2516) took 2057 ms. Trace:
I20260709 13:02:00.685895  1621 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.685937  1545 rpcz_store.cc:276] 0709 13:01:58.588673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.306201 (+717528us) service_pool.cc:224] Handling call
0709 13:01:59.328836 (+ 22635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.437875 (+1109039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.645526 (+207651us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400047ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:00.645743 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547003776}
W20260709 13:02:00.657367  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.672112  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:00.673465  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:00.689121  1693 raft_consensus.cc:2376] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12. Re-sending same reply.
I20260709 13:02:00.681005  6093 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.690164  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:00.679033  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.690323  6093 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.691430  1693 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.682277  5503 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:00.682789  1618 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:00.681661  1613 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.694118  1614 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:00.699244  1619 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:00.700805  1615 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:00.701599  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.703649  6112 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:00.704268  6112 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:00.704761  6112 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:00.703138  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.706029  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.706765  5848 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.707144  5848 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:00.707500  5848 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.710260  6093 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.713801  6055 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:02:00.702548  6063 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:00.717621  5503 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.727504  5503 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:00.727865  5503 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:00.728204  5503 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:00.724336  5848 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:00.748391  1587 leader_election.cc:336] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.822s (SENT)
I20260709 13:02:00.749287  5503 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.714447  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.751910  5857 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:00.752737  5503 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.755231  1660 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:00.758203  5503 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:00.756084  5848 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:00.757884  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:00.760327  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:00.759661  6112 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.760910  5848 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:01.004868  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 244625us
I20260709 13:02:01.005661  1660 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:00.762256  1693 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:00.831161  1694 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:00.880631  6057 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.007534  6057 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.883276  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1899) took 1174 ms. Trace:
I20260709 13:02:01.007984  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:00.884375  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:01.008560  1694 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:00.890987  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:01.009536  6057 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:01.009750  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 118891us
I20260709 13:02:01.010059  6057 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:00.882011  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:00.865376  6004 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:01.010982  2265 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:01.011041  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:00.897310  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.011161  6004 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.928081  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:00.940426  1587 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.829s (SENT)
I20260709 13:02:00.896414  2258 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:02:00.900959  6048 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:00.975663  6062 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.561s	user 0.003s	sys 0.000s
I20260709 13:02:00.967701  1617 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:00.987427  1545 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:01.001341  5982 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:01.001753  1621 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:01.004966  5848 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:01.012239  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:01.019611  5982 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.020181  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:01.020992  6046 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:01.021476  6046 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:01.021854  5982 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.022324  6046 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.023350  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.024405  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.025352  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.005999  6112 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.007838  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.026566  1693 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:01.027416  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.028056  1693 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 9: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:01.028833  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.008311  1696 rpcz_store.cc:276] 0709 13:01:59.708758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.486424 (+777666us) service_pool.cc:224] Handling call
0709 13:02:00.486819 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.487221 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:00.487275 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.487827 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.882971 (+395144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:00.883009 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.883070 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:00.883109 (+    39us) raft_consensus.cc:1685] finished
0709 13:02:00.883120 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:00.883226 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12138,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"thread_start_us":394782,"threads_started":1,"wal-append.queue_time_us":93295}
I20260709 13:02:01.029968  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.018328  5848 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:00.984560  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2540) took 1945 ms (client timeout 1915 ms). Trace:
I20260709 13:02:01.025981  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:01.030850  5848 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.019529  6058 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:01.031627  6058 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:01.031733  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 91344.7us
W20260709 13:02:01.032397  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.032917  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.032506  6058 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.030926  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.034402  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.012609  5945 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:01.035374  5945 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:01.035442  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.036011  1696 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.036490  1617 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.015506  5878 raft_consensus.cc:2764] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:01.012552  6055 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:02:01.038856  6042 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.039987  1689 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:02:00.986379  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.041113  1587 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.915s (SENT)
I20260709 13:02:01.016477  1512 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:01.030879  1540 rpcz_store.cc:269] 0709 13:01:59.039176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.140885 (+101709us) service_pool.cc:224] Handling call
0709 13:02:00.984360 (+1843475us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5400083ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:00.984470 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41045248}
I20260709 13:02:01.042784  5982 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:01.043352  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:01.043483  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:01.043728  5982 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:01.045040  5982 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.044556  5945 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.049026  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 988) took 1179 ms. Trace:
I20260709 13:02:01.043957  1545 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:01.044219  5813 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:01.038394  6055 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:01.049402  2260 rpcz_store.cc:276] 0709 13:01:59.869372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.869493 (+   121us) service_pool.cc:224] Handling call
0709 13:01:59.869772 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.923187 (+ 53415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.048804 (+1125617us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54005d11d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:01.048969 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120980224}
I20260709 13:02:01.050053  6055 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:01.050239  6069 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:01.051463  6069 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:01.051838  6069 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:01.052603  6069 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.053557  6069 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.054055  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.051019  6055 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.056236  1695 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:01.057355  2265 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:02:01.057518  2257 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:01.063172  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:01.063747  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:01.064893  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.063217  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.013406  6004 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.006503  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:01.075107  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 68672us
I20260709 13:02:01.075568  1696 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:01.076455  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:01.019528  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 749) took 2188 ms (client timeout 2877 ms). Trace:
W20260709 13:02:01.077499  1690 rpcz_store.cc:269] 0709 13:01:58.830789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.831098 (+   309us) service_pool.cc:224] Handling call
0709 13:02:01.019351 (+2188253us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540031ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:01.019464 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067954048}
I20260709 13:02:01.079222  6112 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:01.079641  6112 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:01.079998  6112 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:01.084376  1617 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:01.098825  1617 pending_rounds.cc:85] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 9
W20260709 13:02:01.085369  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.087033  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.415729  1695 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:01.416018  1617 pending_rounds.cc:107] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:01.416464  1617 raft_consensus.cc:2889] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.417429  1695 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:01.084967  5878 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:01.267144  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.711521  5878 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:01.711964  5878 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.273388  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:01.274376  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 197982us
I20260709 13:02:01.713438  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:01.714318  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:01.715561  5106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.007s
I20260709 13:02:01.715647  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:01.394644  6112 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.717608  6112 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.718158  6112 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:01.718787  5877 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:01.408686  1587 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.393s (SENT)
I20260709 13:02:01.064792  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.720455  1693 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:01.720956  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2484) took 1046 ms. Trace:
I20260709 13:02:01.417290  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1815) took 2208 ms. Trace:
I20260709 13:02:01.721243  1693 rpcz_store.cc:276] 0709 13:02:00.674746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.064536 (+389790us) service_pool.cc:224] Handling call
0709 13:02:01.720886 (+656350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.721554  1617 rpcz_store.cc:276] 0709 13:01:59.210294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.215009 (+  4715us) service_pool.cc:224] Handling call
0709 13:01:59.227306 (+ 12297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:00.962435 (+1735129us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b5400357b20. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a85806f 00007f7f1a8d0f60 00007f7f1a8d27de 00007f7f1a8dcb49 00007f7f1a8dd416 00007f7f1a8d9d8f 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62
0709 13:02:01.416995 (+454560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.417204 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21108480}
I20260709 13:02:01.101673  1694 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
W20260709 13:02:01.719861  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 311221us
I20260709 13:02:01.722720  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2481) took 1049 ms. Trace:
I20260709 13:02:01.723049  1694 rpcz_store.cc:276] 0709 13:02:00.673504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.007763 (+334259us) service_pool.cc:224] Handling call
0709 13:02:01.722667 (+714904us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:01.723682  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.419389  1695 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:01.424266  6102 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:01.724135  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.724390  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1910) took 1067 ms. Trace:
I20260709 13:02:01.724393  6102 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.432276  6048 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:01.432336  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.445359  1616 raft_consensus.cc:1217] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-11.8]   Dedup: 8.6->[9.7-11.8]
I20260709 13:02:01.725701  6048 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.726308  1620 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:02:01.456617  6042 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.465094  1696 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: [9.4-11.5]
W20260709 13:02:01.497078  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.527966  6059 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 2.115s	user 0.006s	sys 0.003s
W20260709 13:02:01.530440  5972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.007s	sys 0.010s
W20260709 13:02:01.536556  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.548468  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.557323  6002 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:01.572710  2258 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEARNER]: Advancing to term 10
I20260709 13:02:01.574826  6055 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.578349  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:01.582423  6077 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 1.863s	user 0.009s	sys 0.000s
I20260709 13:02:01.584476  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:01.587360  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:01.611552  5982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.001s
I20260709 13:02:01.621918  6101 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:01.630877  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.495s	user 0.013s	sys 0.006s
I20260709 13:02:01.631395  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:01.638291  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:01.644825  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 762) took 1582 ms. Trace:
I20260709 13:02:01.726329  1616 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [4.4-11.8]
I20260709 13:02:01.736703  6101 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.737262  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2033) took 1232 ms. Trace:
I20260709 13:02:01.737736  1616 rpcz_store.cc:276] 0709 13:02:00.504915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.444658 (+939743us) service_pool.cc:224] Handling call
0709 13:02:01.445105 (+   447us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:02:01.736922 (+291817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.737200 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.728255  6048 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.718493  6112 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:01.739459  6112 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:01.741086  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.605s	user 0.014s	sys 0.006s
W20260709 13:02:01.741425  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 2.62196e+06us
I20260709 13:02:01.742826  5944 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.743372  5944 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.744014  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:01.745759  5944 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:01.747016  5667 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:01.747622  5667 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:01.748493  5667 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.747025  2265 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:01.751888  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:01.753983  2265 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:01.750689  1689 rpcz_store.cc:276] 0709 13:02:00.062321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.062551 (+   230us) service_pool.cc:224] Handling call
0709 13:02:01.039672 (+977121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.040346 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.644565 (+604219us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540031ecd0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:01.644750 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218273536}
I20260709 13:02:01.756059  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1911) took 1099 ms. Trace:
I20260709 13:02:01.683189  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:01.687238  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:01.756243  1689 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:01.756398  1696 rpcz_store.cc:276] 0709 13:02:00.656688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.464508 (+807820us) service_pool.cc:224] Handling call
0709 13:02:01.464828 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:01.755809 (+290981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.755997 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.771469  1689 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:01.772626  1696 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [3.3-9.7]
I20260709 13:02:01.772439  1689 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.773276  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2480) took 1100 ms. Trace:
W20260709 13:02:01.696353  5999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.006s	sys 0.006s
W20260709 13:02:01.773836  5999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.007s	sys 0.006s
I20260709 13:02:01.774356  1696 rpcz_store.cc:276] 0709 13:02:00.673292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.771951 (+1098659us) service_pool.cc:224] Handling call
0709 13:02:01.772303 (+   352us) raft_consensus.cc:1471] Updating replica for 5 ops
0709 13:02:01.772991 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.773228 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.060793  5848 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.789033  1690 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:01.770898  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55323.1us
I20260709 13:02:01.791381  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:01.704820  6064 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:02:01.792059  6064 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:01.793730  2266 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:02:01.795991  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.796722  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.801020  5957 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:01.801532  5957 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.803263  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:01.804026  1619 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:02:01.804279  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:01.715999  5106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.007s	sys 0.007s
I20260709 13:02:01.724979  1695 rpcz_store.cc:276] 0709 13:02:00.656449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.418776 (+762327us) service_pool.cc:224] Handling call
0709 13:02:01.419083 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.724116 (+305033us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.724322 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.447683  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:01.807204  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2474) took 1176 ms. Trace:
I20260709 13:02:01.807637  1692 rpcz_store.cc:276] 0709 13:02:00.630394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.447418 (+817024us) service_pool.cc:224] Handling call
0709 13:02:01.807129 (+359711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.809438  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1915) took 1077 ms. Trace:
I20260709 13:02:01.810736  1692 rpcz_store.cc:276] 0709 13:02:00.731604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.808431 (+1076827us) service_pool.cc:224] Handling call
0709 13:02:01.808800 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.809029 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.809066 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.809119 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:01.809163 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.809240 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.809372 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.739024  6101 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.773334  1689 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.775025  1687 raft_consensus.cc:2393] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:02:01.673525  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0d80 after lost signal to thread 434
I20260709 13:02:01.775125  2263 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:01.776103  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:01.816430  1643 debug-util.cc:398] Leaking SignalData structure 0x7b0800097000 after lost signal to thread 1479
W20260709 13:02:01.817699  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1700 after lost signal to thread 1571
W20260709 13:02:01.690285  5945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.003s	sys 0.009s
I20260709 13:02:01.779435  6102 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:01.781672  5982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.001s
W20260709 13:02:01.818989  5945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.003s	sys 0.009s
I20260709 13:02:01.782927  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38818 (request call id 2026) took 1295 ms. Trace:
W20260709 13:02:01.819762  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08003d55a0 after lost signal to thread 1646
I20260709 13:02:01.819483  1620 rpcz_store.cc:276] 0709 13:02:00.488011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.490565 (+  2554us) service_pool.cc:224] Handling call
0709 13:02:01.782723 (+1292158us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000f9bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:01.782862 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839133440}
W20260709 13:02:01.820240  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba100 after lost signal to thread 1647
I20260709 13:02:01.821165  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2472) took 1191 ms. Trace:
I20260709 13:02:01.821543  1687 rpcz_store.cc:276] 0709 13:02:00.629841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.682901 (+1053060us) service_pool.cc:224] Handling call
0709 13:02:01.821102 (+138201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.791540  5848 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:01.783735  2257 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:01.783984  6002 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:01.756647  5877 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.785954  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1878) took 2177 ms. Trace:
I20260709 13:02:01.786578  2264 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:01.725720  6094 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:01.787259  5972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.008s	sys 0.010s
I20260709 13:02:01.696945  5891 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:01.822772  6057 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:01.823117  1643 debug-util.cc:398] Leaking SignalData structure 0x7b0800385cc0 after lost signal to thread 1720
W20260709 13:02:01.841673  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5020 after lost signal to thread 1721
I20260709 13:02:01.736696  6042 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.823606  2265 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:01.796165  6145 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:02:01.833412  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1914) took 1102 ms. Trace:
I20260709 13:02:01.855208  1695 rpcz_store.cc:276] 0709 13:02:00.731320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.806584 (+1075264us) service_pool.cc:224] Handling call
0709 13:02:01.832737 (+ 26153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.832972 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.833007 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.833058 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:01.833104 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.833203 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.833333 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.855892  1691 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:01.835532  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:01.843034  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1920 after lost signal to thread 2290
I20260709 13:02:01.849565  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1907) took 1193 ms. Trace:
I20260709 13:02:01.852677  6094 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.856670  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1900) took 1334 ms. Trace:
W20260709 13:02:01.856853  1643 debug-util.cc:398] Leaking SignalData structure 0x7b08000b95a0 after lost signal to thread 2291
I20260709 13:02:01.856886  1690 rpcz_store.cc:276] 0709 13:02:00.655792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.078356 (+422564us) service_pool.cc:224] Handling call
0709 13:02:01.078601 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.789370 (+710769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.849325 (+ 59955us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400451854. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:01.849507 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633536768}
I20260709 13:02:01.836382  1688 rpcz_store.cc:276] 0709 13:01:59.608294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.608448 (+   154us) service_pool.cc:224] Handling call
0709 13:01:59.608828 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.609305 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.609359 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.609978 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.704812 (+ 94834us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:59.705972 (+  1160us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.717883 (+ 11911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.717955 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.581837 (+1863882us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:01.785644 (+203807us) raft_consensus.cc:1685] finished
0709 13:02:01.785764 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.785899 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25154,"prepare.queue_time_us":606,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":12381,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":17528,"spinlock_wait_cycles":7472384,"thread_start_us":59568,"threads_started":1,"wal-append.queue_time_us":95780}
I20260709 13:02:01.821048  5667 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.857103  1691 rpcz_store.cc:276] 0709 13:02:00.522514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.855373 (+1332859us) service_pool.cc:224] Handling call
0709 13:02:01.855673 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.856414 (+   741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.856620 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.859380  2258 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:01.859838  2258 pending_rounds.cc:85] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 6
I20260709 13:02:01.860124  2258 pending_rounds.cc:107] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:01.860405  2258 raft_consensus.cc:2889] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.861347  2259 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEARNER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:01.861555  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 106135us
I20260709 13:02:01.863003  2263 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
W20260709 13:02:01.867133  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.868597  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2486) took 1193 ms. Trace:
I20260709 13:02:01.867466  5667 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:01.867705  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.841284  5891 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:01.869745  1696 rpcz_store.cc:276] 0709 13:02:00.675229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.787773 (+1112544us) service_pool.cc:224] Handling call
0709 13:02:01.788052 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.868233 (+ 80181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:01.868266 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:01.868308 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:01.868341 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.868408 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.868523 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7806,"raft.queue_time_us":48382,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":13199,"thread_start_us":79772,"threads_started":1}
I20260709 13:02:01.839957  5877 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.883167  6042 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:01.884019  6046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.005s	sys 0.007s
W20260709 13:02:01.884505  6046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.005s	sys 0.007s
I20260709 13:02:01.884554  5877 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.885293  5877 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:01.885620  5877 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:01.872785  5957 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:01.873466  5960 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:01.873953  5872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:02:01.874024  5667 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.896054  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 1009) took 1014 ms. Trace:
I20260709 13:02:01.896621  2259 rpcz_store.cc:276] 0709 13:02:00.881144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.791234 (+910090us) service_pool.cc:224] Handling call
0709 13:02:01.861152 (+ 69918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.861757 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.895766 (+ 34009us) spinlock_profiling.cc:243] Waited 69.6 ms on lock 0x7b54007828d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:01.895965 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160025984}
W20260709 13:02:01.874776  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.875701  1689 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:01.903528  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2478) took 1230 ms. Trace:
I20260709 13:02:01.904011  1689 rpcz_store.cc:276] 0709 13:02:00.672837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.755872 (+1083035us) service_pool.cc:224] Handling call
0709 13:02:01.756138 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.903147 (+147009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.903451 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:01.875989  6002 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.879619  6094 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:01.881891  5891 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:01.887799  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 175643us
I20260709 13:02:01.889513  2230 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:01.892661  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 198168us
I20260709 13:02:01.886448  5877 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.867806  6112 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.907399  5960 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:01.907820  6142 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:01.913693  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 46740.5us
W20260709 13:02:01.981374  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.967424  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 387893us
I20260709 13:02:01.990571  1691 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:01.991290  1690 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:01.992020  1689 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:01.993444  1688 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:01.994130  1696 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:01.970315  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 226216us
W20260709 13:02:01.971782  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 698355us
W20260709 13:02:01.973634  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.978189  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:01.914696  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.008898  1616 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:02.014086  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.015652  5106 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.015355  5667 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:02.015504  5723 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:02.016906  5106 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.017843  5106 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.019461  5876 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.019606  5851 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.020411  5851 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:02.021121  5851 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:01.923537  5877 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.018323  5667 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.023056  5813 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.023211  5667 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.024035  5813 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.919646  5891 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.020525  5876 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:01.938153  5878 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.033296  1694 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:02.037766  5667 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.033952  5876 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.059507  5982 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.060645  1510 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:02.061021  6143 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.059572  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.061890  6143 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.064126  6101 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:02.064188  6065 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.064810  6101 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.065299  6101 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.059777  6147 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.067072  6016 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:02.067555  6147 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:01.925853  5960 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.071034  5959 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:02.071561  5999 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:01.936209  6112 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:02.075315  1587 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.151s (SENT)
I20260709 13:02:02.067083  6042 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:02:02.076260  1587 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.151s (SENT)
I20260709 13:02:01.923487  6142 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:02.076812  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:02.076035  5878 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.078002  6102 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.076931  6042 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:02.078673  6042 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:02.080130  6042 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:02.080838  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.081881  1690 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:02:02.070463  6147 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.083190  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.084065  1689 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:02.065311  6143 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.085973  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:02.086781  1687 raft_consensus.cc:606] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:02.087218  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1912) took 1430 ms. Trace:
I20260709 13:02:02.087231  1687 raft_consensus.cc:614] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:02.087651  1693 rpcz_store.cc:276] 0709 13:02:00.656903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.721952 (+1065049us) service_pool.cc:224] Handling call
0709 13:02:01.722250 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.722438 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:01.862932 (+140494us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.044114 (+181182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.055005 (+ 10891us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:02.086773 (+ 31768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.086869 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.087032 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":139584,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":33315,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":262,"thread_start_us":317652,"threads_started":3,"wal-append.queue_time_us":70644}
W20260709 13:02:02.089341  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800117b00 after lost signal to thread 431
W20260709 13:02:02.089977  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080008aa80 after lost signal to thread 434
I20260709 13:02:01.916267  5972 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:02.090447  5704 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:02.091424  5972 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.091789  6069 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:02.055487  5813 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.092350  6069 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.092491  5704 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:01.922320  6002 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.094894  1659 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.093631  5106 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.070778  5944 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.100207  5878 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:02.100919  5878 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:02.101702  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.103106  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 98159.9us
I20260709 13:02:02.104194  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:02.105389  5999 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.105914  5999 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:02.100351  5944 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.106364  5999 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.106653  6112 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:02.107380  5813 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:02.107445  6112 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.109257  5813 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:02.109947  6112 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.112099  5106 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:02.091434  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4080 after lost signal to thread 1479
I20260709 13:02:02.091919  5972 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.102905  6145 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:02.099521  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1913) took 1442 ms. Trace:
I20260709 13:02:02.114894  1694 rpcz_store.cc:276] 0709 13:02:00.657164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.723615 (+1066451us) service_pool.cc:224] Handling call
0709 13:02:01.723879 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:02.033888 (+310009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.099144 (+ 65256us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400002154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:02.099448 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710230784}
I20260709 13:02:02.120759  5944 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.121079   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:02.121966  5876 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:02.099352  6142 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.126323  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.129969  5957 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:02.114897  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8240 after lost signal to thread 1571
W20260709 13:02:02.131044  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb020 after lost signal to thread 1572
I20260709 13:02:02.131319  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.132225  2263 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:02:02.132635  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800378bc0 after lost signal to thread 1646
I20260709 13:02:02.132781  5957 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:02.122159  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61347.5us
W20260709 13:02:02.132938  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080036ac20 after lost signal to thread 1647
I20260709 13:02:02.082209  6042 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.133422  5957 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:02.143661  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 77038.8us
I20260709 13:02:02.077419  6065 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:02.078514  1587 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.153s (SENT)
I20260709 13:02:02.122570  5876 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:02.162688  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 84262us
I20260709 13:02:02.165529  5876 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:02.171442  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.175001  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.176803  5813 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:02.177862  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:02.181527  1617 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
W20260709 13:02:02.182310  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.182701  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.171442  5876 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:02.189112  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800267200 after lost signal to thread 1720
W20260709 13:02:02.189533  1717 debug-util.cc:398] Leaking SignalData structure 0x7b080038e880 after lost signal to thread 1721
W20260709 13:02:02.195782  1587 leader_election.cc:336] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 2.153s (SENT)
I20260709 13:02:02.196341  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:02.198908  5630 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.199405  5872 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:02.199705  5630 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.202077  5630 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.205466  1545 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:02.207944  6046 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:02.208058  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.208925  1694 raft_consensus.cc:2376] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13. Re-sending same reply.
I20260709 13:02:02.208726  6046 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.211953  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.212106  1540 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:02.212365  1544 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:02.145234  5982 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:02:02.213852  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:02.214401  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.213469  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:02.215930  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9460 after lost signal to thread 2290
W20260709 13:02:02.216259  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800330aa0 after lost signal to thread 2291
I20260709 13:02:02.217309  2263 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:02.220743  6102 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:02.093783  6069 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.221493  6102 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.223130  6069 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.224610  6102 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.227392  6046 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.232043  1659 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.233539  5877 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:02.237470  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.177819  5813 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:02.247432  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 77104.6us
I20260709 13:02:02.236410  5877 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.168887  6145 consensus_queue.cc:1243] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:02.151343  5723 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:02:02.102356  5878 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.255458  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.259512  5723 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.259974  5723 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:02.261068  5723 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.264345  2257 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:02.256122  5877 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.287345  5972 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.289779  5972 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.290987  6147 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:02.291503  6147 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:02.289933  5851 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.292804  6147 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:02.293617  1661 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.913s (SENT)
I20260709 13:02:02.295248  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.295956  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:02.298426  1694 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:02.300397  2263 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:02:02.300833  5851 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.272481  5960 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.273243  6150 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:02.274108  5945 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.274684  6057 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.274855  5944 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:02.278909  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.279850  5999 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.285219  5813 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.299098  5957 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.301327  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.262446  5723 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:02.274755  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.254375  6065 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.294443  6147 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.307111  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:02.312435  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.311600  1441 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 7, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:02.313724  6065 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.314363  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.314982  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.315415  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:02.315722  5999 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.316119  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.316447  1691 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:02.308962   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:02.317880  5945 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.318799  6057 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:02.366201  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51288.1us
I20260709 13:02:02.378134  1694 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
W20260709 13:02:02.370532  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.355158  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:02.319952  5944 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:02.278438  6101 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.387554  2264 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:02.375823  5945 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.378564  6057 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.389148  5945 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.389715  6057 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.390919  2259 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:02.391438  6057 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.391836  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.392509  1689 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:02.382520  5944 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.395956  5944 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.397677  5944 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.399039  5945 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.400345  6065 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.356688  6046 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:02.402761  6150 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.386175  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:02.403220  6046 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:02.403954  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.403491  6150 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:02.405746  1661 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.740s (SENT)
I20260709 13:02:02.406105  6101 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.376518  5876 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:02.411118  5876 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.411819  5876 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:02.414661  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 105256us
I20260709 13:02:02.415791  6019 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:02.417135  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.419030  6046 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.419693  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.420841  6046 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.306752  6142 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.424285  6142 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.425107  1695 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:02.426468  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.443228  5877 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.450503  1659 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:02.450857  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 578540us
I20260709 13:02:02.451838  6145 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.452278  6145 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:02.452679  6145 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.452541  6155 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:02.455119  6143 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.455535  6143 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:02.457284  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.457973  2259 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
W20260709 13:02:02.458719  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.459215  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.459666  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.460363  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.460765  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.463070  5957 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.425125  6150 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.454432  1441 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 8, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:02.468957  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 166129us
W20260709 13:02:02.472029  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.468076  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:02.474673  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.480937  5999 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:02.481613  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 95590.9us
I20260709 13:02:02.481814  5999 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:02.482223  5999 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.482561  5999 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.483397  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:02.484376  6002 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.484576  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:02.484936  6002 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.485340  5851 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:02.487155  5851 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.487564  5851 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.487337  6004 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:02.487910  5851 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.488216  6004 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.488595  6004 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.488925  6004 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.490808  5704 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:02.491386  6002 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.491246  6143 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.491288  5704 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:02.492311  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:02.492631  6143 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.492807  5704 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.494088  5704 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:02.494642  5891 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:02.494958  5813 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:02.496165  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 45959.9us
I20260709 13:02:02.497210  5959 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:02.497447  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.497623  5959 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:02.498122  1510 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.502746  5891 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.503175  5891 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.503501  5891 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.498188  6101 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:02.498875  5959 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.506724  5877 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.507067  6101 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.507583  5959 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.507475  1441 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:02.509920  6101 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.509222  1441 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 7, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.500052  6019 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.510941  6019 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:02.512048  6019 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.512547  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:02.513177  2259 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.513443  6019 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.517797  5876 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.520390  5848 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:02.521385  5848 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:02.521972  5848 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.480042  5972 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:02:02.531488  6147 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:02.533535  6147 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:02.536203  6167 log.cc:927] Time spent T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:02:02.539377  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62254.3us
I20260709 13:02:02.511698  1441 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 7, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.545696  2259 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
W20260709 13:02:02.551432  1661 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.989s (SENT)
I20260709 13:02:02.548257  1694 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
W20260709 13:02:02.560995  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.564306  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:02.568418  1659 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.571713  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:02.574318  5878 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:02.574503  6101 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.536031  6147 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.580816  5878 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:02.577808  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 98477.5us
I20260709 13:02:02.581817  5878 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.582540  6101 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.584683  6101 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.585145  5106 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.585615  5106 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.587571  5106 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.587788  2261 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:02.589180  6155 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.591095  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:02.591735  2259 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:02.593669  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 329959us
I20260709 13:02:02.595958  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.574405  6055 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:02.538154  5877 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:02:02.608958  6055 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:02.609571  6055 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:02.597321  5876 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.609725  1441 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 5, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:02.611009  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 307) took 34472 ms (client timeout 15000 ms). Trace:
I20260709 13:02:02.612138  1441 catalog_manager.cc:5697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 7, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:02.619165  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.614976  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1916) took 1581 ms. Trace:
W20260709 13:02:02.626313  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.634013  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92855.7us
W20260709 13:02:02.637634  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.637447  2259 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:02.641516  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.655359  6160 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:02.656548  5848 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.657007  1441 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 8, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:02.658994  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 107759us
I20260709 13:02:02.662590  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.662205  1441 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 3 to 9, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.663010  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.663276  1695 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 10.
I20260709 13:02:02.664880  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.601877  6002 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:02:02.639719  5877 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:02.651190  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:02.670341  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.613075  5891 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.674634  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:02.621272  1692 rpcz_store.cc:276] 0709 13:02:00.977181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:01.811864 (+834683us) service_pool.cc:224] Handling call
0709 13:02:01.812209 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.812461 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:02.256104 (+443643us) log.cc:844] Serialized 14 byte log entry
0709 13:02:02.519887 (+263783us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:02.519974 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:02.520054 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:02.534703 (+ 14649us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b18000f7780. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:02.539039 (+  4336us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:02.558814 (+ 19775us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318,"prepare.queue_time_us":49730,"prepare.run_cpu_time_us":16,"prepare.run_wall_time_us":17,"raft.queue_time_us":4922,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":187,"spinlock_wait_cycles":91854208,"thread_start_us":405127,"threads_started":2,"wal-append.queue_time_us":184752}
I20260709 13:02:02.665540  1441 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 7, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.680859  1441 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.643165  5851 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:02.651556  5813 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:02.682971  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:02.688871  1619 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.690691  5957 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:02.691286  5957 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:02.691780  5957 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.688050  6016 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:02:02.715939  1587 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.964s (SENT)
I20260709 13:02:02.716195  1620 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.716573  6069 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.719764  6069 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.721962  6069 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:02.611522  1440 rpcz_store.cc:269] 0709 13:01:28.138181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.150336 (+ 12155us) service_pool.cc:224] Handling call
0709 13:01:29.609055 (+1458719us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54002d0190. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b60b2 00007f7f2072fa89 00007f7f206c7da6 00007f7f20699088 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc
0709 13:02:02.610725 (+33001670us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:56.385710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:56.419938 (+ 34228us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:56.420014 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:01:56.420060 (+    46us) tablet.cc:662] Decoding operations
0709 13:01:56.422045 (+  1985us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:56.422169 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:56.422212 (+    43us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:01:56.427062 (+  4850us) tablet.cc:701] Row locks acquired
0709 13:01:56.427142 (+    80us) write_op.cc:260] PREPARE: finished
0709 13:01:56.427412 (+   270us) write_op.cc:270] Start()
0709 13:01:56.427615 (+   203us) write_op.cc:276] Timestamp: P: 1783602116427313 usec, L: 0
0709 13:01:56.427639 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:56.428674 (+  1035us) log.cc:844] Serialized 5179 byte log entry
0709 13:01:58.453536 (+2024862us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b
0709 13:01:59.124939 (+671403us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:01:59.472331 (+347392us) op_driver.cc:464] REPLICATION: finished
0709 13:01:59.481714 (+  9383us) write_op.cc:301] APPLY: starting
0709 13:01:59.481848 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:59.508100 (+ 26252us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:59.508145 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:59.970912 (+462767us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:00.000549 (+ 29637us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:02:00.000609 (+    60us) write_op.cc:312] APPLY: finished
0709 13:02:00.001497 (+   888us) log.cc:844] Serialized 121 byte log entry
0709 13:02:00.001709 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.001866 (+   157us) write_op.cc:454] Released schema lock
0709 13:02:00.001960 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:00.002437 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.002465 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":381072,"reported_tablets":47,"spinlock_wait_cycles":113379712,"child_traces":[["op",{"apply.queue_time_us":9068,"apply.run_cpu_time_us":23020,"apply.run_wall_time_us":520691,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":305143,"prepare.run_cpu_time_us":102100,"prepare.run_wall_time_us":2390788,"raft.queue_time_us":177591,"raft.run_cpu_time_us":7600,"raft.run_wall_time_us":11847,"replication_time_us":3044510,"spinlock_wait_cycles":44056192,"thread_start_us":2543345,"threads_started":4,"wal-append.queue_time_us":2226480,"wal-append.run_cpu_time_us":21194,"wal-append.run_wall_time_us":2345794}]]}
W20260709 13:02:02.723536  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 84323.4us
I20260709 13:02:02.724885  6055 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.725865  6150 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:02.726359  2260 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:02.676884  5960 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:02.727998  5891 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.690610  5851 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:02.729189  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:02.729607  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:02.730399  1615 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.731678  5944 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:02.733476  6058 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:02.733843  6057 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:02.734361  6057 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.735541  6057 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.737316  6057 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:02.710131  5848 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.738556  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.739187  1688 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:02.727757  5960 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.759073  1617 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:02.766605  1619 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:02.767028  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:02.768883  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.771268  2261 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:02.772495  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.773932  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.774477  1694 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:02.775733  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:02.776127  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:02.773089  1690 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:02.739630  5813 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:02.785063  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:02.782246  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:02.787853  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:02.791134  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:02.791357  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:02.791977  2259 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:02.782246  5851 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.837682  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46625.7us
I20260709 13:02:02.855772  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:02.697428  6145 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:02.878785  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.895985  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.740456  6058 consensus_queue.cc:1175] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 14 index: 12 } }
W20260709 13:02:02.897733  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 188270us
W20260709 13:02:02.903841  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.917724  1617 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: [9.4-11.5]
W20260709 13:02:02.912743  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.789505  5891 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.837186  5959 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:02.927994  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.928860  1690 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:02.858037  5723 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:02.894986  6065 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:02.895852  5848 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:02.938653  5106 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:02.939155  5106 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:02.926563  6168 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:02:02.943105  5848 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.948040  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:02.948813  1622 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:02.949831  5848 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.943662  5851 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:02.951493  1617 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:02.952288  5851 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:02.952842  6150 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:02.953382  6150 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:02.954340  6150 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:02.956271  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.958132  6046 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.001s
I20260709 13:02:02.962719  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:02.963929  6185 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:02.966145  2265 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:02.968726  2264 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:02.969269  6142 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:02.969662  6142 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:02.971725  1613 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:02.914273  6055 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:02.856474  1696 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:02.918838  1691 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:02.919430  1618 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:02.933465  5723 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:02.990945  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.935297  5959 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:03.003894  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.004640  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.001323  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:03.014483  1694 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:02.991242  5723 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:03.028020  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 171616us
W20260709 13:02:03.042882  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 187195us
I20260709 13:02:02.988487  5891 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.038115  5106 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:03.035362  6143 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.006s
I20260709 13:02:02.990221  5667 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:02:03.047775  5106 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.024976  6101 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.042423  1696 pending_rounds.cc:85] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 11
I20260709 13:02:02.963686  5813 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.051072  1696 pending_rounds.cc:107] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:02:03.056783  1696 raft_consensus.cc:2889] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.056725  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.058050  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.058794  1541 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:02:03.061379  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.066984  1620 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:03.083179  5960 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:03.083536  5891 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:03.083838  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:03.084510  6183 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:02:03.083563  6180 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:03.025162  6142 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.091817  6142 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:03.100260  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.099489  1615 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:03.101112  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:03.104127  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.104868  1545 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:03.114887  6189 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.115437  6189 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.115804  6189 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:03.095100  6170 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:02:03.103075  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 49666.2us
I20260709 13:02:03.128196  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.129174  1616 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.147696  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:03.152810  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.152863  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.159087  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.159441  1613 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:03.066708  6101 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.171684  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:03.178171  6155 consensus_meta.cc:287] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 13:02:03.184707  6155 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.185606  1689 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:03.180631  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.186797  1693 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:03.182818  6188 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:03.187929  6188 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:03.188514  6188 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:03.190949  5972 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:03.168675  6147 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:02:03.192617  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:03.191596  5972 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.173712  1688 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:03.193851  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:03.197096  6046 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:03.198450  6046 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.198854  6046 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:03.199441  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.200143  1687 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:03.201351  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.202021  1687 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:03.204658  5723 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:03.205533  5999 consensus_meta.cc:287] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.723s	user 0.008s	sys 0.001s
I20260709 13:02:03.205832  5630 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:03.205945  5999 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.207142  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.207350  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.207901  6058 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:03.208328  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.210085  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.222479  1541 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:03.222441  1687 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:02:03.206408  5630 raft_consensus.cc:1068] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Unable to promote non-voter e51b0b5dc04b4f5aaf6a3a870f291345: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:03.151048  6145 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:03.230244  1616 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:03.186215  6189 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.217201  1540 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:03.212093  5972 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:03.224601  2264 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:03.228363  1694 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:03.222012  1620 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:03.232146  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 449300us
W20260709 13:02:03.216149  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.215629  6004 consensus_meta.cc:287] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.726s	user 0.014s	sys 0.000s
I20260709 13:02:03.239228  1659 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:03.239532  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.240728  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.124024  5959 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.246265  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:03.249450  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.213872  6101 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:03.251847  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.252100  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.252211  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.232280  5944 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:03.256541  6193 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.256820  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.257925  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.261091  1694 raft_consensus.cc:2410] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:03.258734  1615 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.263357  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.264081  1616 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:03.262513  1687 raft_consensus.cc:2376] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12. Re-sending same reply.
I20260709 13:02:03.267431  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.268541  6193 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.269447  5106 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.270534  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.245894  5723 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.271718  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.220081  5960 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:03.271505  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:03.275627  1541 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:03.274894  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:03.278399  1688 raft_consensus.cc:2393] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:03.255707  6155 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:03.295789  1620 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:03.303279  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.247514  6004 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.305150  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.310447  1688 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:03.311746  1661 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 3.225s (SENT)
I20260709 13:02:03.269604  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:03.308831  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.279982  5630 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.314844  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.312275  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:03.305747  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 84125.1us
W20260709 13:02:03.313803  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 244038us
I20260709 13:02:03.276551  5944 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:03.307523  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.321002  1620 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.322630  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.273778  6101 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:03.319572  1693 raft_consensus.cc:2376] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12. Re-sending same reply.
I20260709 13:02:03.306317  5723 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:03.305276  6155 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:03.277987  5972 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:03.332259  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.336547  1687 raft_consensus.cc:2393] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:03.318652  5630 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.342223  1616 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:03.327232  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:03.344161  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.329720  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.348802  1585 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:03.383500  1613 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:03.379586  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.384832  1618 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:03.390278  1620 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:03.392627  1693 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:03.393790  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:03.394958  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 62292.3us
I20260709 13:02:03.353673  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.395414  1688 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:03.397367  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:03.391736  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.400104  1695 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:03.357899  1615 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:03.376942  1622 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:03.344875  5723 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:03.347105  5630 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.404114  1614 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:03.410270  2264 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:03.407349  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.406980  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.412637  1620 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.410358  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:03.342947  6145 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:03.377596  6189 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.414937  1616 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:03.421509  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115937us
I20260709 13:02:03.423777  1621 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:03.352336  6058 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:02:03.407160  6069 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:03.448275  6069 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:03.448917  6046 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.449380  6069 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.450515  5630 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.450850  5944 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.452944  5630 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:03.427186  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:03.460201  5957 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:02:03.460505  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.460696  5957 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.462116  2265 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:03.433383  6199 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.462984  6199 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.428436  6190 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:03.464638  6190 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:03.465067  6190 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:03.465828  6199 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.434875  1616 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
W20260709 13:02:03.470449  6196 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:03.435483  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:03.471699  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 53510.4us
W20260709 13:02:03.471819  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 78157.1us
I20260709 13:02:03.472831  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.473711  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:03.436298  5723 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.441615  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.443470  6207 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:02:03.444540  6155 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:03.445561  6057 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.004s
I20260709 13:02:03.445847   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:03.426604  5999 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.461982  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.436285  6004 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.490898  6142 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:03.416671  6143 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:03.484400  5106 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:03.494024  5106 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:03.494365  5106 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:03.494697  6112 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:03.491457  1613 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:03.496870  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.497177  6193 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.497550  1613 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:03.497855  6193 raft_consensus.cc:2764] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:03.495253  5106 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.487499  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.498560  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.500352  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:03.480558  6195 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.511976  6195 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.514263  6195 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.517130  6190 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.495265  6112 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.520478  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.519055  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.522871  1620 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:03.524096  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.525019  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:03.525449  1613 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:03.525635  2260 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:03.531256  1620 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:03.535363  5106 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:03.505743  6193 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:03.531656  1620 pending_rounds.cc:85] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:03.542568  2265 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:03.542887  1620 pending_rounds.cc:107] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:03.543144  1620 raft_consensus.cc:2889] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.542171  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:03.556579  1614 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:03.521700  5848 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:03.526072  5630 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:03.564021  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 215290us
I20260709 13:02:03.564594  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:03.565392  2260 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.567066  2259 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:03.568634  1613 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:02:03.526072  5667 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:03.571739  1585 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:03.570973  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48873us
I20260709 13:02:03.573894  1621 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:03.568352  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.542325  6193 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:03.578506  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 104330us
I20260709 13:02:03.578652  1614 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:03.574241  1621 pending_rounds.cc:85] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:02:03.584326  1621 pending_rounds.cc:107] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:03.582058  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:03.584673  1621 raft_consensus.cc:2889] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.531085  6145 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:02:03.587131  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:03.593538  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.593670  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:03.594115  1690 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:03.590129  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 116138us
W20260709 13:02:03.595640  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.566865  5957 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.573074  5848 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:03.592898  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:03.591820  1614 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:03.559019  6004 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:02:03.598956  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:03.600273  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.600986  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.606503  1696 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.608278  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:03.588562  6193 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.581578  5630 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:03.593107  6207 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:03.668648  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.688014  1620 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:02:03.610688  6143 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.577900  5959 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:03.698055  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:03.698760  1693 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.649537  6145 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:03.650561  5957 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.703035  1621 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:03.668006  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.688127  5960 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.593400  6188 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:03.715840  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 123043us
I20260709 13:02:03.718046  1696 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:03.701473  6145 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:03.725615  1621 pending_rounds.cc:85] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 9
I20260709 13:02:03.734994  1621 pending_rounds.cc:107] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:02:03.735391  1621 raft_consensus.cc:2889] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:03.693995  6207 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.728482  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 144912us
I20260709 13:02:03.736835  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.710135  5957 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.740216  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:03.740499  2257 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:02:03.743270  1622 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:02:03.743737  6211 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:02:03.744621  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:03.754927  1539 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:03.744971  6201 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 13:02:03.757079  2260 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:03.714118  6143 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.724579  6221 raft_consensus.cc:2764] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:03.737291  6207 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.829982  1622 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 13:02:03.831961  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 95256.8us
I20260709 13:02:03.832832  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:03.715160  5630 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.822764  6190 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:03.800012  6112 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:03.752206  6208 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.281s
I20260709 13:02:03.862533  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:03.867569  6213 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:02:03.868600  6209 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 13:02:03.870169  6055 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:03.870554  6224 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:03.870710  6055 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.871256  6220 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.801672  5848 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.880172  6112 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:03.856336  6142 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:02:03.871762  6220 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:03.881539  5960 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:03.898550  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 300423us
W20260709 13:02:03.895411  1661 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 3.964s (SENT) [suppressed 49 similar messages]
I20260709 13:02:03.845338  6145 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:03.905622  6101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.004s	sys 0.001s
W20260709 13:02:03.906098  6101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.001s
I20260709 13:02:03.907407  6229 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:03.907991  6229 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.910182  6229 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:03.910869  6204 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:02:03.911563  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:03.912185  2258 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:03.939195  6225 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.952359  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:03.954113  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.962070  6235 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:03.965847  1616 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:03.966312  1616 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:03.967120  1616 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.968211  1616 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:03.970949  6200 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:03.966028  6222 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:02:03.956091  6225 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.981694  1693 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:03.975767  1690 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:03.912628  6207 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.990449  6220 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.990522  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:03.958056  6147 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:03.995029  6230 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:02:03.996490  6147 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:03.995299  6237 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:03.997500  6147 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.998378  6237 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:03.971796  6231 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.998807  5957 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:03.999089  6231 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:03.999357  6237 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:03.999909  6220 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:04.000113  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:04.000775  6220 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:04.001175  6220 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.002490  6055 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:04.004009  1661 leader_election.cc:336] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.555s (SENT)
I20260709 13:02:04.006076  1616 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:02:03.958837  6145 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.002861  6208 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:04.012676  6208 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:04.013145  6208 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:04.014222  6202 log.cc:927] Time spent T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.428s	user 0.000s	sys 0.003s
W20260709 13:02:04.015097  1661 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.694s (SENT)
I20260709 13:02:03.994786  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:04.016011  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 153563us
I20260709 13:02:04.006593  1616 pending_rounds.cc:85] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:04.002211  6220 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.019012  6235 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.019318  6220 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:04.016880  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.020395  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.020690  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.022243  6155 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:04.022769  6155 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:04.022927  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.023537  1696 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:04.017182  1616 pending_rounds.cc:107] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:04.024753  1616 raft_consensus.cc:2889] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.017343  1539 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:04.007735  6143 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:04.024950  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:04.028577  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 448278us
W20260709 13:02:04.028250  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.006826  6188 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:04.030390  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.001214  6200 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:02:04.029963  1510 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.035995  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.043946  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.027150  6046 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.046689  6004 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:04.047148  6004 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:04.047377  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.048007  6004 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.048609  5667 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:04.049189  6004 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:04.050019  5667 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:04.050573  6142 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.050902  5959 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.051466  6223 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:02:04.052611  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.053109  5813 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.053752  5813 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:04.054771  6199 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:02:04.055346  1540 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:04.056267  5813 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.056420  6002 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:04.056895  6002 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:04.057010  6155 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.057798  6002 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.050541  5667 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:04.059655  5667 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.050552  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.053179  1539 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.062352  1510 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:04.056551  6248 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:04.064648  5982 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:04.065214  6243 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 13:02:04.065853  6195 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.066970  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 783) took 1320 ms. Trace:
I20260709 13:02:04.040346  5704 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.067378  1692 rpcz_store.cc:276] 0709 13:02:02.746532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.746721 (+   189us) service_pool.cc:224] Handling call
0709 13:02:02.774399 (+ 27678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.794859 (+ 20460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.794889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.869894 (+ 75005us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.150074 (+280180us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800476d40. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:02:03.326412 (+176338us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:03.332499 (+  6087us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.332735 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.332804 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.013459 (+680655us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:04.066744 (+ 53285us) raft_consensus.cc:1685] finished
0709 13:02:04.066768 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.066892 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51506,"prepare.queue_time_us":9118,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":7805,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":78650,"spinlock_wait_cycles":33860864,"thread_start_us":176117,"threads_started":1,"wal-append.queue_time_us":575311}
I20260709 13:02:04.068779  5704 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.069839  6019 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:04.070448  6019 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.070878  5704 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:04.072299  6246 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:04.072697  6019 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.073073  6246 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:04.073423  1547 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:04.074918  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80201.8us
I20260709 13:02:04.075337  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.075904  1688 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.075959  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.066416  6195 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:04.076283  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.077189  1543 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.077319  6195 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.079103  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:04.080762  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.051404  5959 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.069200  5876 raft_consensus.cc:1064] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:04.075001  1542 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:04.089344  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:04.076324  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.092831  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:04.095010  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.044269  6143 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.093680  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:04.100586  1688 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:04.092150  1544 raft_consensus.cc:2376] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14. Re-sending same reply.
I20260709 13:02:04.105159  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:04.082980  1661 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.863s (SENT)
I20260709 13:02:04.121553  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:04.033004  6193 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.122141  1540 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:04.120322  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:04.082960  6224 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:04.110857  6235 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.111836  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.112564  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.113188  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.114151  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.096203  6200 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 13:02:04.115774  6245 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:02:04.035223  6247 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:04.124706  5957 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:04.168314  5957 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.168751  5957 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.169438  6224 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.130826  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.150841  6155 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:04.170977  1542 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.124972  5630 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.175014  5630 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:04.149922  1543 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:04.143347  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 99502us
I20260709 13:02:04.176337  5630 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:04.177557  6244 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:04.109680  1539 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:04.119273  6188 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.181346  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.159485  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.183243  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.160720  1541 raft_consensus.cc:2410] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:04.183881  1615 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:04.184456  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.185312  1541 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.166113  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:04.185993  1543 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:04.142310  6195 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:04.130195  6197 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:04.187870  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 104937us
I20260709 13:02:04.113991  6208 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.175079  6193 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.194140  6188 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:04.194305  6197 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:04.195760  6223 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.195304  6188 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.196382  6195 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:04.196714  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.197942  1546 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.197507  6195 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.198401  1691 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:04.198933  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.197482  5957 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.200310  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.200479  5960 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:04.201141  5960 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:04.201478  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.203653  6190 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:04.144282  6143 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:04.074071  6246 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.192299  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.213435  1613 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:04.195346  6197 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.205598  1696 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:04.161397  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.215772  1547 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:04.206660  1538 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.218076  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.206826  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:04.208283  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.198933  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.183526  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.205300  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:04.223687  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.227162  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.227429  1695 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:04.225929  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.232837  1692 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:04.235033  1691 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.191824  6235 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.254846  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.257130  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.255854  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.196288  6223 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.210812  6251 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.231204  6155 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:04.255097  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.258167  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115710us
W20260709 13:02:04.259644  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.920s (SENT)
I20260709 13:02:04.282565  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.285377  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.262075  1538 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.295387  1542 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:02:04.297348  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.301059  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.301059  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.260967  6147 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:04.303995  6147 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.299654  6220 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:04.304457  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.305063  6220 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.305612  1546 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:02:04.307467  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.308653  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.309911  1694 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.310015  6208 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:04.310794  1541 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:02:04.304505  6147 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.316241  6223 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:04.286787  6200 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.283485  6155 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:04.303138  1587 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.587s (SENT)
I20260709 13:02:04.318468  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.319777  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.318747  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:04.322158  1542 raft_consensus.cc:1217] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.9->[9.10-9.10]   Dedup: 9.10->[]
I20260709 13:02:04.322679  1542 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 11. Ops: [9.10-9.10]
I20260709 13:02:04.298900  6193 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.330785  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:04.331521  6193 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.333792  6193 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.254518  5960 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.293726  6251 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.334546  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.329458  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:04.330102  6219 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.572s	user 0.000s	sys 0.002s
I20260709 13:02:04.330010  6143 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.324597  6200 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.335579  1544 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:04.336150  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.336325  6251 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:04.329113  2265 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:04.343469  1587 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.600s (SENT)
I20260709 13:02:04.343994  1538 raft_consensus.cc:2410] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:04.349586  1546 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:04.355754  1540 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.321961  6155 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:04.365191  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 105584us
I20260709 13:02:04.365792  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.366752  1619 raft_consensus.cc:2410] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:02:04.367851  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.368448  1542 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.371690  1620 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:04.371667  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.372761  1544 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:04.374106  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.374173  1587 leader_election.cc:336] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.733s (SENT)
I20260709 13:02:04.374480  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.375273  1538 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.349525  6193 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.377007  1545 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:04.378885  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.381197  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.382081  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.383451  5957 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.385421  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.388136  6200 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.386575  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.390220  5630 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.390537  1546 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.393030  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:04.394553  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.013s (SENT)
I20260709 13:02:04.394429  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.380122  6237 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.397994  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:04.409060  2265 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:04.410786  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:04.412254  6234 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.416s	user 0.001s	sys 0.002s
I20260709 13:02:04.412323  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.399559  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.412983  6237 consensus_queue.cc:1059] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:04.413831  6200 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:04.413904  6237 raft_consensus.cc:3055] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:04.414317  6200 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:04.414417  6237 raft_consensus.cc:740] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.414798  6200 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:04.415338  6237 consensus_queue.cc:260] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.416589  6237 raft_consensus.cc:3060] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:04.400012  6225 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.400802  6231 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:04.401278  1587 leader_election.cc:336] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.797s (SENT)
I20260709 13:02:04.419996  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:04.379985  6235 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.404526  5876 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.393977  5630 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.433656  1615 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:04.398934  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.423236  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.429510  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.432686  1618 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:04.434084  1542 raft_consensus.cc:2410] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:02:04.392375  6220 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:04.437919  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.438277  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.438781  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.438663  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:04.440351  1546 raft_consensus.cc:2368] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:02:04.439059  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.440239  1622 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:04.448109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.449935  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:04.450826  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49579.1us
I20260709 13:02:04.431735  6189 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:04.454475  1690 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:04.452067  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:04.438036  6193 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:04.460124  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.460852  1545 raft_consensus.cc:2410] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:04.444079  6069 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:04.465233  2263 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:04.443131  5957 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:02:04.471284  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.473035  1661 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.131s (SENT)
I20260709 13:02:04.473425  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:04.469125  6189 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.476718  6200 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.478734  6208 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:02:04.479882  6247 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:02:04.488543  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.471299  6220 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:04.482396  6189 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:04.500015  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.492071  6143 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.501278  5959 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.494252  6247 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:02:04.503707  1587 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.075s (SENT)
I20260709 13:02:04.499720  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.495781  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.506973  1545 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:04.497241  6220 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.503114  6247 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.520238  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.523941  1688 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:04.521184  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.496331  6208 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:04.522920  6220 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.528924  6155 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.529258  6147 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.530272  1694 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:04.532087  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:04.539925  6212 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.847s	user 0.003s	sys 0.000s
I20260709 13:02:04.518553  6200 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:04.547324  6247 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.548707  6247 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.549198  1620 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:02:04.551569  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.551594  6208 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.553388  6208 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.555241  6208 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.567983  1545 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:04.569403  2265 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:04.572317  1543 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:04.574153  2263 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.575201  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.575860  1587 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.863s (SENT)
I20260709 13:02:04.576344  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:04.579185  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:04.581523  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.582087  1587 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.137s (SENT)
I20260709 13:02:04.581933  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.585510  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.583555  1545 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13. Re-sending same reply.
W20260709 13:02:04.597106  6241 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.619s	user 0.001s	sys 0.001s
I20260709 13:02:04.586522  6200 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.602526  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.605075  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:04.605650  2263 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:04.620675  2259 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:02:04.607009  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.621963  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.610968  1587 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.746s (SENT)
I20260709 13:02:04.611356  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:04.622673  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:04.623160  1691 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:04.624441  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.625232  1691 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:04.625569  1543 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:04.618289  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:04.577787  6002 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.626538  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.629194  1696 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:04.631583  1688 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:04.637928  1543 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:04.638284  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.639536  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.639149  1545 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12. Re-sending same reply.
I20260709 13:02:04.640707  2265 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEARNER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:04.635291  6208 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.648967  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.650858  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.652266  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.653549  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.654750  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.655591  1543 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:02:04.656416  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.657039  1543 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12. Re-sending same reply.
I20260709 13:02:04.657923  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.659024  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.660257  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.661445  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.662330  1543 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
W20260709 13:02:04.662782  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 51873.2us
I20260709 13:02:04.663187  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.664573  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.665867  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.670176  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:04.684852  1587 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.957s (SENT)
I20260709 13:02:04.685525  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:04.687433  1587 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.985s (SENT)
I20260709 13:02:04.692395  6237 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:04.693917  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.694811  6239 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.702s	user 0.005s	sys 0.000s
I20260709 13:02:04.698928  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 790) took 1009 ms. Trace:
I20260709 13:02:04.699352  1687 rpcz_store.cc:276] 0709 13:02:03.689433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.690009 (+   576us) service_pool.cc:224] Handling call
0709 13:02:03.701131 (+ 11122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.710600 (+  9469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.710649 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.726608 (+ 15959us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.872536 (+145928us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:03.872581 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.872913 (+   332us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.111491 (+238578us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b48001d01d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:02:04.694055 (+582564us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:04.698697 (+  4642us) raft_consensus.cc:1685] finished
0709 13:02:04.698721 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.698865 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19200,"raft.queue_time_us":27267,"raft.run_cpu_time_us":2933,"raft.run_wall_time_us":380700,"spinlock_wait_cycles":16102528,"thread_start_us":71570,"threads_started":1,"wal-append.queue_time_us":239656}
I20260709 13:02:04.704559  5959 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:04.706365  5982 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:04.711510  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.712531  5848 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:04.713564  5848 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:04.713939  5848 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:04.714110  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.715075  5848 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.715634  5630 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.716428  5848 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.715075  1585 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:04.719482  2259 raft_consensus.cc:1240] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:04.721344  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.721510  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.722191  1546 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13. Re-sending same reply.
I20260709 13:02:04.722519  1613 raft_consensus.cc:2468] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:02:04.722856  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.725274  1543 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:04.727335  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:04.708109  5982 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:02:04.728230  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.729375  1543 raft_consensus.cc:2376] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12. Re-sending same reply.
I20260709 13:02:04.730086  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:04.727110  6004 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:04.728634  6200 consensus_queue.cc:1059] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:04.733598  6221 raft_consensus.cc:3055] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:04.733958  6221 raft_consensus.cc:740] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.734340  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.734498  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.735302  1619 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:04.734807  6221 consensus_queue.cc:260] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.735597  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.738687  2258 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:04.743016  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.747411  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.748407  1543 raft_consensus.cc:2376] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11. Re-sending same reply.
I20260709 13:02:04.728539  6237 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:04.751072  6237 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:04.752023  6237 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:04.753880  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.754491  1614 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.757057  6207 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:04.758576  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.759737  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.760499  1542 raft_consensus.cc:2410] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:04.761205  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.762128  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.762591  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.763463  1619 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:04.764624  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.770972  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.784819  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.785586  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.786208  1618 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:04.787177  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.788841  1614 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:04.789156  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.745247  5982 consensus_queue.cc:1243] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:02:04.793067  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.794063  1617 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:04.796833  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.797174  1618 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:04.797206  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.802119  1620 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:04.799890  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.746447  5972 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:04.802244  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.803402  1622 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:04.803098  1543 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:04.804252  2263 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:04.802569  1546 raft_consensus.cc:2376] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
I20260709 13:02:04.806430  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.807139  1546 raft_consensus.cc:2376] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
I20260709 13:02:04.808130  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.800623  1542 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.805230  1617 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:04.813684  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.788621  6221 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.814587  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.821061  1544 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.821231  1539 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:04.815292  1687 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:04.817070  1546 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:02:04.817329  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.820103  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.827512  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.818602  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:04.833835  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:04.774103  5960 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:02:04.823760  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.836460  1618 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:04.764472  6069 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:02:04.872061  1546 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:04.853480  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.883040  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.884248  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.884308  1542 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:04.886077  2265 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:04.887630  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:04.887918  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.887944  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48638.4us
I20260709 13:02:04.839694  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.887494  1617 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:04.892644  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.791841  5630 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:02:04.918572  6200 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:04.902655  5982 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:04.921464  6274 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.446s	user 0.000s	sys 0.005s
I20260709 13:02:04.899968  1620 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:04.921612  5982 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:04.900657  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47262.2us
I20260709 13:02:04.924515  5982 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:04.903182  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:04.925472  1539 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:04.926277  6155 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:04.926668  6280 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.182s	user 0.000s	sys 0.003s
W20260709 13:02:04.927302  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.928478  1544 raft_consensus.cc:2410] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:02:04.929682  1544 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:04.930234  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.832882  6143 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.931012  6143 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:04.933362  6143 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:04.906414  1542 raft_consensus.cc:1240] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:02:04.936959  1544 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
W20260709 13:02:04.937244  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.937453  1544 pending_rounds.cc:85] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 8
I20260709 13:02:04.937805  1544 pending_rounds.cc:107] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:02:04.938109  1544 raft_consensus.cc:2889] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.942343  1547 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:04.914002  1543 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:04.902742  6145 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:04.915422  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:04.916651  6238 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.921s	user 0.003s	sys 0.000s
I20260709 13:02:04.917061  6216 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:04.830819  6231 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:02:04.830516  6004 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:04.909091  1546 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:04.911567  6195 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:04.950218  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.951889  1540 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:02:04.917847  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:04.836659  6057 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:04.979435  6147 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:04.983280  1540 pending_rounds.cc:85] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 4
I20260709 13:02:04.983901  1540 pending_rounds.cc:107] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:02:04.984290  1540 raft_consensus.cc:2889] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.943585  6225 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.988485  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:04.989219  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 71466.6us
I20260709 13:02:04.989310  1613 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:04.991328  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:04.992136  1620 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:04.994925  1546 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:05.010869  1617 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:05.012950  1614 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:05.013067  1543 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:05.014740  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:05.016448  1695 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:05.018958  1541 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:05.022055  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:05.023450  1587 leader_election.cc:400] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:02:05.023810  1587 leader_election.cc:403] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:05.023661  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:05.026363  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.026710  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.028002  1692 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:05.030917  1618 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:05.033576  1614 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:05.036846  6016 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:05.037571  1721 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:35005 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:35005 timed out after 15.000s (SENT)
I20260709 13:02:05.038226  1540 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:05.042716  1619 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:04.973274  6004 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:04.993723  6225 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.050349  1620 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:05.050419  1613 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:05.060611  1545 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:04.994649  6235 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.112313  1622 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:02:05.112735  1622 pending_rounds.cc:85] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
I20260709 13:02:05.113067  1622 pending_rounds.cc:107] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:02:05.113381  1622 raft_consensus.cc:2889] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:05.120857  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 170765us
I20260709 13:02:05.121747  1511 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:05.072129  6281 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:05.127463  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:05.019265  6195 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:05.123023  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 291192us
I20260709 13:02:05.131023  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:05.108232  6216 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14.
I20260709 13:02:05.113970  6143 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:05.140468  1687 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:05.122285  6145 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.154438  1689 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:05.134311  6247 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.143862  6193 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:05.167840  6193 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:05.168795  6193 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.171818  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:05.173699  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:05.174201  2259 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:05.070027  6004 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:05.178936  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 188185us
I20260709 13:02:05.179854  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:05.181330  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:05.160991  2231 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:05.184377  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:05.186336  6283 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:02:05.197515  6251 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:05.178253  6247 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.201376  6247 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:05.202828  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.203063  6058 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:05.205757  1687 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:05.209067  5876 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:05.209582  5876 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:05.218842  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:05.185665  5982 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:05.228446  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.230506  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.187270  6216 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:05.158558  6145 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.152096  6143 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:05.190356  6294 raft_consensus.cc:2804] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:05.190203  6226 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:05.230736  6220 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.212275  5876 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.260535  5876 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.214799  6147 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:02:05.261842  6145 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:05.231844  6235 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:05.257627  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1841) took 1739 ms. Trace:
I20260709 13:02:05.231344  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:05.264827  6294 raft_consensus.cc:697] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:05.229606  5945 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:02:05.246860  6226 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:05.264181  6292 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 13:02:05.280146  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.265458  1621 rpcz_store.cc:276] 0709 13:02:03.504726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.711525 (+206799us) service_pool.cc:224] Handling call
0709 13:02:03.725405 (+ 13880us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:03.747791 (+ 22386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.747840 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.748405 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.887031 (+138626us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:03.897006 (+  9975us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.901313 (+  4307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.901413 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.916038 (+1014625us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:05.239926 (+323888us) raft_consensus.cc:1685] finished
0709 13:02:05.243754 (+  3828us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.243945 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25710,"prepare.queue_time_us":11255,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":8220,"raft.queue_time_us":9408,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"spinlock_wait_cycles":2320256,"thread_start_us":138186,"threads_started":1,"wal-append.queue_time_us":246368}
I20260709 13:02:05.214661  6296 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:02:05.287902  6294 consensus_queue.cc:237] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:05.291352  6288 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:02:05.295269  6291 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:02:05.278275  6147 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.317425  6147 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.319725  6147 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:05.322928  6004 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:05.323263  2264 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:05.328267  6155 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:05.304644  6143 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:05.333057  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:05.333781  2264 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:05.337230  6225 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:05.305810  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.305728  6195 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:05.277635  6220 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.279558  6226 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:05.272830  6216 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:05.339351  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:05.342123  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:05.345148  6145 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:05.345634  6145 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.345975  6145 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:05.351603  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:05.355110  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45006.9us
W20260709 13:02:05.356164  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 168044us
W20260709 13:02:05.358022  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 228476us
I20260709 13:02:05.357414  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:05.364220  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:05.357364  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:05.374936  2258 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:05.374351  1660 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:05.344018  6216 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.400434  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:05.358120  6247 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:05.430127  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:05.441169  1614 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:02:05.443573  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 79501.9us
I20260709 13:02:05.445505  1690 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:05.447027  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:05.448035  1693 raft_consensus.cc:2393] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 11: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:05.353350  6220 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.452991  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:05.405019  6155 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:05.457407  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:05.406237  6216 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:05.453269  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:05.468027  1618 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:05.466805  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:05.439677  6246 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:05.468653  1621 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:02:05.475374  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.477428  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:05.449326  5959 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:05.440620  6301 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:05.471205  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 349541us
I20260709 13:02:05.440985  6247 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.496361  1617 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:02:05.525161  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.467959  6155 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.404506  5667 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:02:05.469934  1661 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.815s (SENT)
I20260709 13:02:05.547113  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:05.493777  6193 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.625429  1511 leader_election.cc:400] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:05.533288  6292 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:05.539119  6247 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:05.546002  6155 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:05.544960  6016 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:05.549932  5667 consensus_queue.cc:1243] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:05.492364  6296 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:02:05.638883  6147 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.691952  2265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.009s	sys 0.008s
I20260709 13:02:05.640074  6301 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:05.697710  2265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.008s
I20260709 13:02:05.691557  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2190) took 1022 ms. Trace:
I20260709 13:02:05.661221  6143 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.713443  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 169195us
I20260709 13:02:05.646523  6193 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.669212  6016 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.729270  1511 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:05.741618  2257 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:02:05.712152  6312 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.700037  1542 rpcz_store.cc:276] 0709 13:02:04.669191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.934812 (+265621us) service_pool.cc:224] Handling call
0709 13:02:04.935137 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.935410 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.935437 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.935909 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.141195 (+205286us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:05.686142 (+544947us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.691192 (+  5050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.691280 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.691330 (+    50us) raft_consensus.cc:1685] finished
0709 13:02:05.691346 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.691489 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4708,"prepare.queue_time_us":62446,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4638,"thread_start_us":695832,"threads_started":2,"wal-append.queue_time_us":322751}
I20260709 13:02:05.755334  2259 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:05.737483  6016 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:05.711372  6147 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:05.778448  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.784700  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.727941  6143 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.798256  1546 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:05.810035  1538 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:02:05.815625  6307 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:02:05.819492  6305 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:02:05.821381  6310 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:05.802204  6313 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:05.836225  1544 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:05.838879  6328 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:05.828591  6301 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.849623  6235 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:05.856581  6147 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:05.857111  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.869837  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.803438  6246 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:05.859135  6308 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:02:05.835537  6200 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:02:05.859753  6220 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:05.781298  6287 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:05.767650  6221 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:02:05.861013  6145 consensus_meta.cc:287] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:02:05.804848  6112 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:05.865571  6216 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.866717  6143 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:05.764441  6312 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:05.873430  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.890285  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.902858  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.849681  6004 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 13:02:05.914682  1542 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:02:05.915232  1542 pending_rounds.cc:85] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 9
I20260709 13:02:05.915503  1542 pending_rounds.cc:107] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:02:05.915916  1542 raft_consensus.cc:2889] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:05.886097  6295 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:05.888464  6293 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:05.890537  6145 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:05.898608  6112 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.914032  6294 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:05.989856  6155 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:05.973135  6246 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.007279  6004 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.019187  6293 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.035457  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 314252us
W20260709 13:02:06.038167  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 242739us
I20260709 13:02:06.039228  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.064314  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:06.041671  6221 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:06.051070  6216 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.034152  6004 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:06.077679  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.051054  6200 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.059738  6326 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:06.036265  6016 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:06.125057  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.131239  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 253805us
I20260709 13:02:06.052088  6247 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.050395  6293 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.066675  6312 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:06.132227  6226 consensus_meta.cc:287] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.004s
I20260709 13:02:06.127646  6221 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:06.170368  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 700481us
W20260709 13:02:06.171285  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 107074us
I20260709 13:02:06.151064  6341 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.143162  6200 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.219089  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:06.167047  6330 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:02:06.145663  6336 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:06.205791  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.226199  6299 log.cc:927] Time spent T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.009s	user 0.000s	sys 0.011s
I20260709 13:02:06.152653  6145 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:06.233536  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 184584us
W20260709 13:02:06.246718  1587 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.614s (SENT)
I20260709 13:02:06.247406  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:06.197923  6155 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.182492  6112 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.217368  6343 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.262738  6004 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.264555  6293 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:06.265599  6340 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:06.271416  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:06.246312  6220 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.272221  1547 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:06.195956  6226 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:06.276508  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 60420.2us
W20260709 13:02:06.280324  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.284058  1689 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:02:06.277525  6292 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.007s
I20260709 13:02:06.270262  6293 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:06.289549  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 65060.9us
I20260709 13:02:06.228242  6341 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.232661  6216 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.287652  2261 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:06.288367  1695 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:06.292120  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.296778  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.296778  1695 pending_rounds.cc:85] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 10
I20260709 13:02:06.297477  1695 pending_rounds.cc:107] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:06.297770  1695 raft_consensus.cc:2889] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:06.293656  1689 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:06.279219  6016 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:06.306505  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.282169  6339 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.268991  6343 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.280085  6220 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.293375  6292 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:06.384927  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.406526  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.356454  6200 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:06.343223  6337 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:02:06.431814  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:06.356258  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 109611us
W20260709 13:02:06.440554  1587 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.034s (SENT)
I20260709 13:02:06.441030  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:06.445255  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.447468  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 155776us
W20260709 13:02:06.456355  6344 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:02:06.456902  6313 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:06.457340  6347 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:02:06.457640  6313 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:06.458734  6348 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:02:06.461683  6345 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:02:06.464036  6016 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:06.439134  6336 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:06.465680  6336 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:06.466228  6336 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.433805  6004 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:06.471004  6335 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:06.471954  6349 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:02:06.456207  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:06.295480  6293 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.325523  6216 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.438892  6338 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.432403  5982 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.448585  6145 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.354354  6339 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.479269  6336 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:06.503526  6318 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:02:06.553356  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 97249.4us
I20260709 13:02:06.478503  6200 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:06.483381  6313 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.503786  6247 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.527161  6335 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.527236  6004 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.558709  1694 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:06.558182  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:06.527089  6354 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:06.559695  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 119165us
W20260709 13:02:06.564898  1587 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.697s (SENT)
I20260709 13:02:06.565361  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.531319  6221 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:06.579892  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 135345us
I20260709 13:02:06.521291  6338 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.564260  5982 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.572901  6335 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:02:06.607457  5982 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:06.608532  5982 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:06.609501  6362 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:06.610363  6362 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.610849  6338 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.610900  6362 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.613358  6362 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.616869  6226 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.564649  6246 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.590879  1661 leader_election.cc:336] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.880s (SENT)
I20260709 13:02:06.585675  6216 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.569566  6355 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.601111  6353 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:02:06.601598  6221 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.602727  6293 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.568614  6336 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:02:06.567217  6200 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.568748  6247 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.604132  6354 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:06.567478  6004 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.531957  6145 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:06.627737  1661 leader_election.cc:336] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.016s (SENT)
I20260709 13:02:06.648661  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:06.633863  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.649917  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.617763  6341 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.644165  6361 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:06.662051  1661 leader_election.cc:336] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.025s (SENT)
I20260709 13:02:06.664860  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.620853  6220 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.667361  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 1032) took 1349 ms. Trace:
I20260709 13:02:06.630962  6336 consensus_queue.cc:1243] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:06.621496  6343 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.619689  6339 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:06.668915  1661 leader_election.cc:336] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.576s (SENT)
I20260709 13:02:06.667775  2261 rpcz_store.cc:276] 0709 13:02:05.313456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.313663 (+   207us) service_pool.cc:224] Handling call
0709 13:02:05.313947 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.297691 (+983744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.662111 (+364420us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54006af754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:06.662290 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235970432}
I20260709 13:02:06.663373  6251 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:06.661393  6293 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.632233  6221 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.664094  6361 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:06.629194  6246 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.691445  6293 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.702272  6293 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.706789  6343 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.707449  6343 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:06.682065  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 113913us
I20260709 13:02:06.669858  6312 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:06.698280  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.812s (SENT)
I20260709 13:02:06.664382  6247 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.712724  6343 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.713253  6247 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.640121  6355 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.702430  6246 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.699884  6366 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.716981  6366 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.717485  6355 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.719108  6221 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.719312  6366 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:06.681680  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.708012  6200 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:06.723495  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.725026  6193 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.728967  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2159) took 2323 ms. Trace:
I20260709 13:02:06.740010  6004 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.743767  6145 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:06.746734  1587 leader_election.cc:336] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.765s (SENT)
W20260709 13:02:06.712848  6316 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.918s	user 0.000s	sys 0.016s
I20260709 13:02:06.708442  6361 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.738881  1539 rpcz_store.cc:276] 0709 13:02:04.405804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.926158 (+520354us) service_pool.cc:224] Handling call
0709 13:02:04.926513 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.158021 (+231508us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:02:05.400263 (+242242us) log.cc:844] Serialized 14 byte log entry
0709 13:02:05.729798 (+329535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:05.729867 (+    69us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:05.729915 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.728661 (+998746us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000483d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:06.728720 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.728867 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37286,"prepare.queue_time_us":97356,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":47061,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5118,"spinlock_wait_cycles":517265664,"thread_start_us":428607,"threads_started":2,"wal-append.queue_time_us":419565}
I20260709 13:02:06.761166  6293 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:06.779878  6361 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.779817  6293 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.783890  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.789911  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:06.790515  2259 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.792709  2261 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:06.711458  6335 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.796687  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.805727  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:06.813498  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 115289us
I20260709 13:02:06.761337  6309 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.814678  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:06.815914  1616 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:06.822520  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:06.823410  1621 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:06.826593  1695 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:06.827849  1692 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:06.828094  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:06.828711  1695 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:06.829380  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.781517  6193 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.797770  6069 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.833918  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:06.836058  1696 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:06.831830  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.793742  6225 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:06.797926  6294 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:06.839563  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:06.799121  6200 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.798118  5972 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:06.843158  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:06.848701  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:06.849877  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.850512  1695 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:06.843648  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:06.854938  1616 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:06.844660  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.847152  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.814685  6221 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.812263  6355 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.859906  1688 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:06.862030  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:06.862974  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.817922  6309 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.867971  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.853552  6292 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:06.868453  6356 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:06.869648  6354 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:06.867276  2259 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:06.878994  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.908890  6220 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:06.909081  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:06.909432  6220 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:06.909770  1539 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:06.909914  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.910491  6220 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.911859  6220 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:06.879823  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.880615  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:06.913944  1542 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:06.890552  1690 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:06.880825  1696 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:06.916214  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.845412  6235 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.842684  6193 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.856213  6367 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.889328  6221 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:06.902742  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:06.890877  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.893224  1689 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:06.834385  6335 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.893869  6355 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.854141  6225 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.896319  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.945444  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.955323  1692 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:06.854390  6294 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.848876  6069 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.887635  5972 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:06.942976  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.866313  6200 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.901142  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.946161  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:06.958091  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.959950  1539 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:06.960121  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.960582  6354 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:06.916339  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:06.959064  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 666) took 1153 ms. Trace:
W20260709 13:02:06.925734  1587 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.937s (SENT)
I20260709 13:02:06.937505  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.937768  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.989573  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.995783  1689 raft_consensus.cc:2410] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:06.996160  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:06.999348  2265 raft_consensus.cc:2410] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:02:06.990744  1546 rpcz_store.cc:276] 0709 13:02:05.805647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.806872 (+  1225us) service_pool.cc:224] Handling call
0709 13:02:05.807257 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:05.807504 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:06.719951 (+912447us) log.cc:844] Serialized 14 byte log entry
0709 13:02:06.958743 (+238792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.958793 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:06.958836 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.958897 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.959003 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":912097,"prepare.queue_time_us":912741,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":1363,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":238308,"threads_started":1}
I20260709 13:02:06.923214  6309 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:06.941334  6292 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.929415  6193 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:07.015013  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 89304.3us
W20260709 13:02:07.032950  1587 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.167s (SENT)
I20260709 13:02:07.033457  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:06.926427  6366 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:06.918787  6313 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:02:07.018790  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.019061  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.036725  2259 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:06.996485  6343 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:02:07.019532  6335 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:07.013646  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 304401us
I20260709 13:02:06.927399  6293 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.933662  6221 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.024133  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.025640  2261 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:02:06.942466  6356 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.062027  6356 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:06.966236  6237 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.067031  6237 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.067881  6294 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:06.921115  6220 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.920960  6235 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.025345  6223 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:06.995973  6339 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:06.998164  6341 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:07.001786  6231 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:02:07.037719  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:06.930456  6367 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:07.019447  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 176380us
I20260709 13:02:07.031291  6312 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:07.074442  6312 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:07.074775  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:07.075592  6294 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:07.075407  6312 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.076078  6294 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.076479  6294 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.007493  6354 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.030462  6292 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.088008  6294 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.088850  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.089751  1616 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:07.091876  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.092796  1618 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:07.039250  6358 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.039433  6366 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.094424  6294 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.048559  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.055794  6069 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:06.996343  6016 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:07.097596  6016 consensus_queue.cc:1243] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:07.097782  6366 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.025810  6226 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.098997  6226 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.059599  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.101840  6226 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.102182  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:07.035058  6216 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:07.103292  6364 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:07.103926  6364 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.103557  6216 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.104414  6364 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:07.099371  1587 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.610s (SENT)
I20260709 13:02:07.107743  6335 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.109351  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.110908  6335 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:07.111445  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.112418  1618 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.098299  6016 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:07.113560  6016 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:07.114639  6016 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.116775  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.116515  6366 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:07.117604  1616 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 9.
I20260709 13:02:07.117655  6366 consensus_queue.cc:1243] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:02:07.115507  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.120743  6335 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:07.122545  6335 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:07.123136  6335 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:07.120786  2230 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.125170  6069 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.125664  6069 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.126082  6069 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.131170  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.133208  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.135423  6295 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:07.137012  6295 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.137398  6295 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.143020  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:07.038156  6309 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:07.134374  6220 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:07.148219  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.148650  6367 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.070960  6223 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:07.191011  6223 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.191430  6335 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.194113  6335 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.147972  6292 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.072847  6339 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:07.149811  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.070s (SENT)
W20260709 13:02:07.195266  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45494.1us
I20260709 13:02:07.151084  1622 raft_consensus.cc:1275] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:07.153870  1618 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:07.196343  6339 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.156236  6069 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:06.925323  6002 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 2 to 8, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:07.164062  6237 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.165117  6225 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.166055  6355 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.166860  6371 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.167924  6200 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.173705  2258 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 2 to 8, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:07.177597  6338 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:07.183264  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.214536  1616 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:07.188899  5630 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:07.189093  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 46190.3us
I20260709 13:02:07.152899  6235 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.203090  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.219731  5630 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:07.256464  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53481.5us
I20260709 13:02:07.214104  6338 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:07.258912  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.258272  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.259559  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.267994  1539 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:07.260015  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.260164  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.269801  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.269821  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.272689  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.273990  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.275121  1540 raft_consensus.cc:2410] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:02:07.275312  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.276439  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.279590  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.260778  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.281960  1545 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:07.267490  1546 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:07.287140  1540 raft_consensus.cc:2410] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 3.
I20260709 13:02:07.288357  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.290267  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.283545  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.291839  1542 raft_consensus.cc:2410] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:07.252663  6226 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:07.291842  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.266714  5630 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.295329  1546 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:07.225466  6366 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:02:07.297052  1540 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:07.298034  1545 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:02:07.269390  6235 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.289011  1544 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
W20260709 13:02:07.301982  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.307868  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 306881us
I20260709 13:02:07.312096  1616 pending_rounds.cc:85] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:07.312403  1616 pending_rounds.cc:107] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:07.312687  1616 raft_consensus.cc:2889] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.281461  6195 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:07.313623  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.314311  1545 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:07.297202  6197 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:07.288957  6374 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:07.322014  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.323817  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:07.330233  1622 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:07.331403  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:07.333132  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 416866us
I20260709 13:02:07.334921  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.336040  1615 raft_consensus.cc:2410] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 12 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:02:07.341225  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.343958  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.347026  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.305231  6235 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.373744  6235 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.374395  6341 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:07.376134  6355 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:07.377071  6237 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.281615  6371 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:02:07.383337  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.317704  5972 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.386814  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.387600  1692 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:07.320626  6197 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.389554  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.389933  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.391383  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.393124  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.394593  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:07.398900  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57742.5us
W20260709 13:02:07.401166  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.339008  6374 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:07.407563  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:07.407758  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.408901  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.406145  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.410516  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.383668  6339 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.413460  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.384701  6069 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:07.414748  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:07.397965  6379 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:07.395256  6197 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:07.423326  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.418298  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.318856  6338 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.420094  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.421290  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.421514  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.422524  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.426198  1544 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:07.425442  1540 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:07.427780  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.428364  1542 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:07.403255  6220 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.407069  6200 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:07.425298  1619 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:07.409807  6235 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:07.423954  1538 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:07.400290  6343 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:07.438501  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.449754  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.450026  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.450336  1538 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:07.439230  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:07.453063  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.456830  1622 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:07.458081  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.459165  1539 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:07.423777  6339 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:07.472978  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.475924  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:07.477088  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:07.444367  6200 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:07.480423  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.424247  6355 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:07.473914  1538 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:07.487258  6220 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:07.484576  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:07.455960  6358 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:07.487239  1619 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:07.496182  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.500785  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.469753  6231 raft_consensus.cc:2764] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:02:07.511471  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.480875  6338 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.487047  6341 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.488157  6235 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:07.520570  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.457540  6374 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.447788  6295 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.454526  6356 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.454600  6343 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.505201  6358 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:07.525494  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54715.2us
I20260709 13:02:07.509968  6247 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.530313  6069 consensus_queue.cc:1048] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:07.532557  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.511454  6220 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:07.518077  6341 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.538995  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.546463  1696 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:07.540537  1539 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:07.548144  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:07.539469  6378 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:02:07.548844  1539 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:07.549614  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.550138  6343 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:07.520284  6235 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.550253  1539 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:07.553313  6235 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:07.556821  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.557080  1585 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.557678  1546 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:07.557942  6221 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:07.551740  6341 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.559168  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.559554  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.560837  6221 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.561285  6221 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.561617  6221 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.561913  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.563118  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.563869  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.564218  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.565307  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.564451  1539 raft_consensus.cc:2376] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10. Re-sending same reply.
I20260709 13:02:07.567076  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.567601  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.567916  6336 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.571208  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:07.571848  6354 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.571596  6336 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.573807  6336 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:07.575093  6385 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:07.577349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.568171  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.568485  6195 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.568656  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.568879  6339 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.570192  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.570032  6220 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.536355  6358 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:07.578508  1585 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.579512  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.560765  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.584722  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.592249  1546 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:07.566360  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.536809  6247 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.595994  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.606515  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.607343  1540 raft_consensus.cc:3060] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.599876  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.608883  1544 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:07.610034  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.612347  1544 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:07.614145  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.616820  1619 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:07.621817  1544 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:02:07.587255  6380 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:02:07.580849  6379 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:02:07.627912  6341 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.629483  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.644304  1546 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:07.631057  6231 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:07.631377  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.632345  1620 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:07.633167  6235 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.634191  6292 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:07.635759  6388 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:02:07.639567  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.640455  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.664621  1544 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:07.641433  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.665570  1619 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:07.666538  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.667236  1619 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:07.642213  6375 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:02:07.647927  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.654096  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.672493  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.673074  1540 raft_consensus.cc:2468] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:07.673228  1613 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:07.603225  6247 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.674060  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.674598  1540 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.675196  6226 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:07.675657  6226 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:07.600692  6354 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:07.685222  6216 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.593362  6145 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:02:07.680187  6395 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.687736  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:07.540668  6200 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.697674  6355 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:07.693089  1614 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:07.698652  6223 consensus_meta.cc:287] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.001s
I20260709 13:02:07.699121  6223 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.706765  6223 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.707719  6223 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.603463  6343 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
W20260709 13:02:07.691895  6391 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:07.714838  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.733660  1546 raft_consensus.cc:2393] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:07.637812  6155 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:02:07.599164  6112 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 13:02:07.680564  6381 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:02:07.589138  6195 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.708201  6235 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:07.748749  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 156651us
W20260709 13:02:07.777943  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.753206  1619 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
W20260709 13:02:07.721132  6392 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:02:07.774562  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 118337us
I20260709 13:02:07.783025  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:07.783165  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:07.782536  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 285649us
I20260709 13:02:07.783840  1546 raft_consensus.cc:2410] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:02:07.784444  1619 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:02:07.782833  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.686992  6383 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:02:07.791353  1540 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
W20260709 13:02:07.798281  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.785485  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:07.770542  6155 consensus_queue.cc:1243] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer 9fbc4df0bb934bba941cfa20c0afead2 log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:02:07.773480  6379 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:02:07.776772  6364 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.005s
I20260709 13:02:07.816066  1546 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:07.819139  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:07.820024  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 237341us
I20260709 13:02:07.732887  6221 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.823043  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:07.831833  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.837338  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:07.842404  6221 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.843086  6147 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.845023  6346 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:07.846849  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:07.848083  6221 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.849763  6069 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.850239  6069 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:07.850726  6069 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.848791  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.856150  6358 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.859668  6341 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.859755  6356 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.860534  6237 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:07.861532  6069 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.862737  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:07.863363  6393 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:02:07.863415  1689 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:07.819329  6364 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:07.865473  6069 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.866195  6364 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.866497  6358 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.866822  1538 raft_consensus.cc:1240] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:07.867270  6237 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:07.869061  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:07.871804  6341 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.872035  6197 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.873626  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:07.874249  6197 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.868068  6223 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:07.874994  6358 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:07.876488  1622 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:07.879427  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 231624us
I20260709 13:02:07.880374  1619 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:07.831178  6313 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:07.833213  6382 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.833714  6251 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:07.876677  6379 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:02:07.895011  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46330.9us
I20260709 13:02:07.895839  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:07.880602  6375 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:02:07.921722  6231 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:07.922499  6231 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:07.924265  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 676) took 1047 ms. Trace:
I20260709 13:02:07.924664  1547 rpcz_store.cc:276] 0709 13:02:06.876886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.877194 (+   308us) service_pool.cc:224] Handling call
0709 13:02:06.877634 (+   440us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:02:06.878143 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.878182 (+    39us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:02:06.879147 (+   965us) log.cc:844] Serialized 104 byte log entry
0709 13:02:07.219002 (+339855us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:07.266634 (+ 47632us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.277330 (+ 10696us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.278000 (+   670us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.278551 (+   551us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.280582 (+  2031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.280684 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.923985 (+643301us) raft_consensus.cc:1685] finished
0709 13:02:07.924010 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.924192 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8896,"prepare.queue_time_us":114158,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":1882,"raft.queue_time_us":20369,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":34161,"thread_start_us":339401,"threads_started":1,"wal-append.queue_time_us":466341}
I20260709 13:02:07.927414  6301 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.928519  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.929602  6223 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.907495  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:07.930999  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.882249  6295 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:07.905373  1619 pending_rounds.cc:85] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
W20260709 13:02:07.912942  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.936313  1619 pending_rounds.cc:107] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260709 13:02:07.936708  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.936776  1619 raft_consensus.cc:2889] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.900555  6225 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:07.940493  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:07.919608  2231 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.942180  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:07.912905  6382 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.945636  6112 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:07.952191  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2529) took 1124 ms. Trace:
I20260709 13:02:07.942287  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.953675  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:07.955031  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.973582  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.952620  1693 rpcz_store.cc:276] 0709 13:02:06.827448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.827566 (+   118us) service_pool.cc:224] Handling call
0709 13:02:06.838193 (+ 10627us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:06.838542 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.838570 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:06.846851 (+  8281us) log.cc:844] Serialized 52 byte log entry
0709 13:02:07.235113 (+388262us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.287061 (+ 51948us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.287276 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.287360 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.951980 (+664620us) raft_consensus.cc:1685] finished
0709 13:02:07.952001 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.952129 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20370,"prepare.queue_time_us":51780,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3658,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":14820,"thread_start_us":366155,"threads_started":1,"wal-append.queue_time_us":547719}
I20260709 13:02:07.930660  6231 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:07.981142  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.910666  6237 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:07.945683  6343 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:07.951018  6251 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:07.971634  2230 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:07.946800  6069 raft_consensus.cc:2804] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:07.943059  6383 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:07.980620  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:07.986553  2259 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:07.950799  6382 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:07.988602  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.996731  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.997709  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.998550  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.995066  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:07.999498  1617 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:07.989285  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:07.990381  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:07.990525  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.001371  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.002473  2264 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 10: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:08.002844  1689 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:08.005463  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.005632  2259 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.007267  2257 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:07.969036  6225 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:07.981421  6294 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:08.010970  2258 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:07.979276  6147 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:08.015303  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:07.996217  6251 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:08.026986  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.027133  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.027647  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:08.042068  2263 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:08.043568  6294 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:08.052196  6335 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.003s
I20260709 13:02:08.057750  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:08.057551  6294 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.059374  1545 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:08.059738  6247 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.063119  6225 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.007201  6383 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.086758  6295 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.087342  6295 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.088317  6383 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.090032  1616 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:08.089453  6295 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.067593  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.068259  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.069020  6226 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.091552  1613 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.092197  6247 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:08.093331  6226 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.071985  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.026428  6417 raft_consensus.cc:2804] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:08.040066  6251 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.082502  6112 consensus_queue.cc:1059] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:08.106199  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.102763  1613 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
W20260709 13:02:08.112229  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44052.8us
I20260709 13:02:08.074764  6223 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:08.094349  6417 raft_consensus.cc:697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:08.123067  1613 pending_rounds.cc:85] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 8
W20260709 13:02:08.105681  5630 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.003s
I20260709 13:02:08.124099  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.130175  1613 pending_rounds.cc:107] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:02:08.134160  1613 raft_consensus.cc:2889] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.123211  6383 raft_consensus.cc:3055] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:08.123160  6413 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:08.122283  6295 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:08.101426  6246 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:02:08.147143  6338 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
W20260709 13:02:08.144286  6401 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:02:08.139343  6112 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.129328  6155 consensus_queue.cc:1059] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:02:08.144464  6413 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.142472  6383 raft_consensus.cc:740] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:08.161202  6384 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.637s	user 0.005s	sys 0.000s
I20260709 13:02:08.138521  5630 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.173074  6069 raft_consensus.cc:697] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:08.136282  6223 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.177811  6413 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.178802  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:08.205834  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 61167.3us
I20260709 13:02:08.206322  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.180258  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:08.181141  6112 raft_consensus.cc:3055] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:08.146488  6295 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:08.127665  6147 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.208230  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:08.236428  1687 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:08.236856  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:08.237617  1687 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 4. (index mismatch)
I20260709 13:02:08.209772  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.203878  6417 consensus_queue.cc:237] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.210750  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.211020  6383 consensus_queue.cc:260] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.218905  6295 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.224485  5630 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:08.224815  6195 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:08.215512  6112 raft_consensus.cc:740] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:08.264827  6112 consensus_queue.cc:260] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.266238  6112 raft_consensus.cc:3060] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.232604  6301 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:08.266678  6390 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.534s	user 0.000s	sys 0.004s
I20260709 13:02:08.267107  6383 raft_consensus.cc:3060] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:08.234812  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:08.259063  6246 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:02:08.270978  6069 consensus_queue.cc:237] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.272521  1689 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.235395  6426 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:08.273643  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2604) took 1009 ms. Trace:
I20260709 13:02:08.273782  6426 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:08.274247  6426 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:08.275281  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 883) took 1193 ms. Trace:
I20260709 13:02:08.274062  1541 rpcz_store.cc:276] 0709 13:02:07.263777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.284970 (+ 21193us) service_pool.cc:224] Handling call
0709 13:02:07.285249 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.294848 (+  9599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.294883 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.296135 (+  1252us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.457197 (+161062us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.458013 (+   816us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.522878 (+ 64865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.522954 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:07.636193 (+113239us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b180047f1a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:08.266112 (+629919us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:08.273432 (+  7320us) raft_consensus.cc:1685] finished
0709 13:02:08.273454 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.273587 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390,"prepare.queue_time_us":10538,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4773,"raft.queue_time_us":39391,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":16163,"spinlock_wait_cycles":66903680,"thread_start_us":215784,"threads_started":2,"wal-append.queue_time_us":345961}
I20260709 13:02:08.276772  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.275694  1621 rpcz_store.cc:276] 0709 13:02:07.082277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.093828 (+ 11551us) service_pool.cc:224] Handling call
0709 13:02:07.094197 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.094458 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:07.639087 (+544629us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18002de0e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf
0709 13:02:07.639218 (+   131us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.900739 (+261521us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.961707 (+ 60968us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18002de0e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:08.274826 (+313119us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b18002de0e0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:02:08.274978 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.275022 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:08.275070 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.275128 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.275228 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23447,"prepare.queue_time_us":245375,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":25535,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":29144448,"thread_start_us":545591,"threads_started":2,"wal-append.queue_time_us":355276}
I20260709 13:02:08.243139  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.278818  6403 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:08.279306  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 371924us
I20260709 13:02:08.275313  6426 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.280228  6403 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:08.280618  6403 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:08.280709  6426 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:08.280998  6403 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.281109  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.283243  6016 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.284199  6220 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:08.288091  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 227536us
I20260709 13:02:08.289486  1585 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.290035  2266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 733) took 1348 ms. Trace:
I20260709 13:02:08.290979  6247 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.291517  6247 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.292299  6354 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.293524  6247 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:08.222595  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.238584  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:08.244447  2231 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.296197  1615 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:08.297224  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.282310  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.298696  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.299358  1615 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.299922  2230 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:08.301414  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.262183  6382 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.302371  6225 raft_consensus.cc:2804] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:08.302947  6225 raft_consensus.cc:697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:08.303118  1693 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:08.254962  1617 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
W20260709 13:02:08.304133  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 59802.7us
I20260709 13:02:08.304498  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:08.306465  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:08.206447  6405 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:02:08.210464  6223 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.233222  1540 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.278976  1544 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:08.243636  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.309142  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.290565  2266 rpcz_store.cc:276] 0709 13:02:06.941411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.941604 (+   193us) service_pool.cc:224] Handling call
0709 13:02:07.051917 (+110313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.052159 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:07.052448 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.390991 (+338543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.391042 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:07.393626 (+  2584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.393698 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.289846 (+896148us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54005b18d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:08.289964 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7735,"prepare.queue_time_us":2186,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":703,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":12292,"spinlock_wait_cycles":246643072,"thread_start_us":337860,"threads_started":1,"wal-append.queue_time_us":398204}
I20260709 13:02:08.327798  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.332374  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.334475  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:08.334535  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:08.335559  1621 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:08.341049  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.341632  1621 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.353097  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.367461  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:08.370390  1615 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:08.372596  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.330580  6343 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.328022  6356 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:08.377254  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:08.380414  1617 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:08.381757  1617 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:02:08.377697  6354 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:08.337831  6355 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.382536  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:08.378506  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 135011us
W20260709 13:02:08.391754  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.392077  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:08.339989  6235 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.371779  6341 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.346747  6339 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:08.400103  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.403234  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.403260  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:08.376050  6220 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:08.410277  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.406594  6312 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:08.375792  6226 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:08.391458  6246 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:08.392870  6354 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.379894  6343 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.419129  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:08.421823  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.424638  2260 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:08.425959  5630 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.430341  1622 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:08.393306  6195 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.433509  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.444728  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 670) took 2274 ms. Trace:
I20260709 13:02:08.399492  6339 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.398919  6341 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:08.411134  6220 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:08.418380  6382 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.470585  1543 rpcz_store.cc:276] 0709 13:02:06.143076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.148626 (+  5550us) service_pool.cc:224] Handling call
0709 13:02:06.169023 (+ 20397us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:07.605885 (+1436862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.605930 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:07.625566 (+ 19636us) log.cc:844] Serialized 52 byte log entry
0709 13:02:07.820272 (+194706us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:07.836447 (+ 16175us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.836680 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.043789 (+207109us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000523d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:08.043879 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.407197 (+363318us) raft_consensus.cc:1685] finished
0709 13:02:08.417240 (+ 10043us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.417392 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3400,"prepare.queue_time_us":15984,"raft.queue_time_us":24854,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":201,"spinlock_wait_cycles":3298105856,"thread_start_us":194275,"threads_started":1,"wal-append.queue_time_us":319201}
I20260709 13:02:08.446772  6354 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:08.397789  6225 consensus_queue.cc:237] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.442513  6235 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.483338  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.432694  6246 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.451115  6343 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.448019  6226 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:08.474711  6339 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.521232  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:08.468495  6147 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.476089  6341 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.475822  6220 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:08.521198  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:08.469410  6428 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:02:08.528380  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:08.531023  1547 raft_consensus.cc:2393] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:02:08.534127  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 227756us
I20260709 13:02:08.543771  1621 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:08.513542  6246 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:08.473424  5630 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.545740  1617 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: [10.7-10.8]
I20260709 13:02:08.554643  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.556578  2266 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:08.554944  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 121514us
I20260709 13:02:08.557729  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.559224  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:08.475714  6195 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.566816  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:08.567603  1543 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.566747  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.570396  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:08.513842  6235 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.543987  6309 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:08.562316  6335 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.565400  6338 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.562556  6004 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:08.592509  6429 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:02:08.593627  6431 log.cc:927] Time spent T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:08.595532  6216 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:08.596688  6367 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:08.598165  6155 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:08.603161  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:08.819518  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 216468us
I20260709 13:02:08.604645  6355 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:08.713706  6445 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:08.613198  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2615) took 1287 ms. Trace:
I20260709 13:02:08.620864  5630 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:08.624672  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1870) took 1048 ms. Trace:
I20260709 13:02:08.639881  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2216) took 1113 ms. Trace:
W20260709 13:02:08.668795  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:08.832185  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.634083  6235 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:08.676571  6354 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.688102  1691 raft_consensus.cc:2468] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:08.689429  6413 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.858204  6413 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:08.690820  6226 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:08.693190  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 290688us
I20260709 13:02:08.859303  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.860141  6354 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:08.682269  6356 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.860556  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:08.646169  6406 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.774s	user 0.000s	sys 0.003s
I20260709 13:02:08.697511  1622 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 4. (term mismatch)
I20260709 13:02:08.862078  1622 pending_rounds.cc:85] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 3
I20260709 13:02:08.862349  1622 pending_rounds.cc:107] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:02:08.862219  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:08.611186  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1864) took 1080 ms. Trace:
I20260709 13:02:08.694568  6309 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:08.862846  1614 rpcz_store.cc:276] 0709 13:02:07.530467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.531085 (+   618us) service_pool.cc:224] Handling call
0709 13:02:07.531447 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.698762 (+167315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.610921 (+912159us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002c88d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:08.611116 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370941184}
I20260709 13:02:08.863350  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2551) took 1363 ms. Trace:
I20260709 13:02:08.863523  1687 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:08.864895  1622 raft_consensus.cc:2889] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.831766  1540 rpcz_store.cc:276] 0709 13:02:07.526120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.811837 (+285717us) service_pool.cc:224] Handling call
0709 13:02:07.812156 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.325816 (+513660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.639417 (+313601us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540003a554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:08.639776 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967985024}
I20260709 13:02:08.829308  1545 rpcz_store.cc:276] 0709 13:02:07.325979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.326110 (+   131us) service_pool.cc:224] Handling call
0709 13:02:08.612917 (+1286807us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400106654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:08.613010 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643922816}
I20260709 13:02:08.813222  6364 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.853611  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:08.822504  6383 consensus_meta.cc:287] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 13:02:08.860816  6413 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:08.817179  1543 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:08.823705  6155 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:08.865619  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1874) took 1288 ms. Trace:
I20260709 13:02:08.710557  6335 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.863745  1692 rpcz_store.cc:276] 0709 13:02:07.499623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.499736 (+   113us) service_pool.cc:224] Handling call
0709 13:02:07.500055 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:07.500266 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.500291 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:07.507132 (+  6841us) log.cc:844] Serialized 26 byte log entry
0709 13:02:07.808565 (+301433us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:07.822708 (+ 14143us) log.cc:844] Serialized 14 byte log entry
0709 13:02:07.822946 (+   238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.823018 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.644863 (+821845us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:08.863092 (+218229us) raft_consensus.cc:1685] finished
0709 13:02:08.863177 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.863294 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46633,"prepare.queue_time_us":13869,"raft.queue_time_us":7009,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":40255,"spinlock_wait_cycles":43286144,"thread_start_us":301001,"threads_started":1,"wal-append.queue_time_us":364685}
I20260709 13:02:08.866909  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:08.823001  6355 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.830227  1618 rpcz_store.cc:276] 0709 13:02:07.576424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.220216 (+643792us) service_pool.cc:224] Handling call
0709 13:02:08.220689 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.308149 (+ 87460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.308204 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.330087 (+ 21883us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.451156 (+121069us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:08.451199 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.451267 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.624456 (+173189us) raft_consensus.cc:1685] finished
0709 13:02:08.624477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.624610 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88450,"raft.queue_time_us":87107,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5016,"thread_start_us":73068,"threads_started":1,"wal-append.queue_time_us":195193}
I20260709 13:02:08.872174  1622 rpcz_store.cc:276] 0709 13:02:07.577510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.556078 (+978568us) service_pool.cc:224] Handling call
0709 13:02:08.584998 (+ 28920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.865397 (+280399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.865566 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.869990  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.715588  6338 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:08.721316  6004 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.828794  6436 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:08.886188  1614 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:08.887064  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2108) took 1261 ms. Trace:
I20260709 13:02:08.887478  1614 rpcz_store.cc:276] 0709 13:02:07.626085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.885465 (+1259380us) service_pool.cc:224] Handling call
0709 13:02:08.885865 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.886818 (+   953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.887009 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.883772  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.892158  1545 raft_consensus.cc:1217] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 4.2->[8.3-12.5]   Dedup: 8.3->[10.4-12.5]
I20260709 13:02:08.892827  1545 pending_rounds.cc:85] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 3
I20260709 13:02:08.893129  1545 pending_rounds.cc:107] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:02:08.893468  1545 raft_consensus.cc:2889] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.890797  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:08.894109  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:08.895020  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 890) took 1264 ms. Trace:
W20260709 13:02:08.895387  6449 log.cc:927] Time spent T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:08.895455  1614 rpcz_store.cc:276] 0709 13:02:07.626149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.888892 (+1262743us) service_pool.cc:224] Handling call
0709 13:02:08.889164 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.889351 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.889376 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.890668 (+  1292us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:08.890738 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.890819 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.890991 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.881708  6435 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.371s	user 0.000s	sys 0.002s
I20260709 13:02:08.880112  6355 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:08.903694  1547 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
W20260709 13:02:08.885581  6016 consensus_meta.cc:287] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:02:08.871740  6444 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:08.915005  1690 raft_consensus.cc:2468] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:08.885792  6411 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:08.888273  6436 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.925729  1539 raft_consensus.cc:2410] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:08.919121  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:08.843679  6445 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.869230  6343 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.877009  6364 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.023528  6364 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:08.904579  5982 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:09.024942  6433 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:02:09.027959  6004 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:08.901614  6313 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:02:08.919842  6235 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:09.030238  6235 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.032462  6235 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.033229  6457 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.035596  6335 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.037878  6343 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:08.970355  6295 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.000s
I20260709 13:02:08.870882  6309 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:08.929039  5630 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:08.985633  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66607.1us
W20260709 13:02:09.000281  6403 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.000s
I20260709 13:02:08.998139  6455 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:09.006378  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2629) took 1471 ms. Trace:
I20260709 13:02:09.060285  1539 rpcz_store.cc:276] 0709 13:02:07.535188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.579139 (+ 43951us) service_pool.cc:224] Handling call
0709 13:02:09.005973 (+1426834us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540013ecd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:09.006301 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067798400}
I20260709 13:02:09.009224  1546 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:09.010286  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2211) took 1486 ms. Trace:
I20260709 13:02:09.061514  1546 pending_rounds.cc:85] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 6
I20260709 13:02:09.062014  1546 pending_rounds.cc:107] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:09.062593  1546 raft_consensus.cc:2889] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.929251  6436 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.015018  6247 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.054477  6453 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:09.020156  6220 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:09.021481  6443 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:02:09.041843  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1868) took 1498 ms. Trace:
W20260709 13:02:08.983343  6251 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.864s	user 0.012s	sys 0.000s
I20260709 13:02:08.921132  6411 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:09.056269  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:09.057215  6295 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.091548  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:09.075954  6309 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:09.066306  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.016776  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1872) took 1439 ms. Trace:
W20260709 13:02:09.059239  6341 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:02:09.085145  1620 rpcz_store.cc:276] 0709 13:02:07.543831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.957843 (+414012us) service_pool.cc:224] Handling call
0709 13:02:07.958266 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.302561 (+344295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.302594 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.303104 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.460884 (+157780us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:08.714867 (+253983us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.715109 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.715180 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.041554 (+326374us) raft_consensus.cc:1685] finished
0709 13:02:09.041583 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.041753 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346986,"raft.queue_time_us":467695,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":22785,"thread_start_us":336940,"threads_started":2,"wal-append.queue_time_us":206730}
I20260709 13:02:08.927444  6155 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.061604  1538 rpcz_store.cc:276] 0709 13:02:07.523889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.524025 (+   136us) service_pool.cc:224] Handling call
0709 13:02:07.543332 (+ 19307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.867244 (+323912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.010029 (+1142785us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400208d54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.010214 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743528704}
I20260709 13:02:09.094727  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:09.075393  6338 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.120265  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 891) took 1493 ms. Trace:
I20260709 13:02:09.120770  1620 rpcz_store.cc:276] 0709 13:02:07.626394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.119427 (+1493033us) service_pool.cc:224] Handling call
0709 13:02:09.119743 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.119914 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.119936 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.119973 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.120000 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.120062 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.120195 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.122519  1620 raft_consensus.cc:1240] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:02:09.123303  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2110) took 1496 ms. Trace:
I20260709 13:02:09.123735  1620 rpcz_store.cc:276] 0709 13:02:07.626766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.121985 (+1495219us) service_pool.cc:224] Handling call
0709 13:02:09.122321 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.122976 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.123234 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.090906  6411 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.059772  6403 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.127450  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:09.126097  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.094218  5982 consensus_queue.cc:1059] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:02:09.127004  6155 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.090575  6195 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.084700  6247 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.163094  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1989) took 1197 ms. Trace:
I20260709 13:02:09.141808  1620 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:09.165947  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2111) took 1538 ms. Trace:
I20260709 13:02:09.166363  1620 rpcz_store.cc:276] 0709 13:02:07.627072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.124642 (+1497570us) service_pool.cc:224] Handling call
0709 13:02:09.124974 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.165689 (+ 40715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.165892 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.167611  1620 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:09.126430  1617 rpcz_store.cc:276] 0709 13:02:07.576974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.382570 (+805596us) service_pool.cc:224] Handling call
0709 13:02:08.545353 (+162783us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:08.556397 (+ 11044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.016523 (+460126us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54002b75d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:09.016708 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356860800}
I20260709 13:02:09.119346  6364 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:09.164047  1688 rpcz_store.cc:276] 0709 13:02:07.966352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.233187 (+266835us) service_pool.cc:224] Handling call
0709 13:02:08.233641 (+   454us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.261170 (+ 27529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.261205 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.261702 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.814465 (+552763us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:08.814510 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.814583 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.162920 (+348337us) raft_consensus.cc:1685] finished
0709 13:02:09.162939 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.163041 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27096,"raft.queue_time_us":33202,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"thread_start_us":484346,"threads_started":1,"wal-append.queue_time_us":558517}
I20260709 13:02:09.088958  6251 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.099504  6335 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.163028  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2238) took 1211 ms. Trace:
I20260709 13:02:09.092130  5630 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.192525  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2112) took 1544 ms. Trace:
I20260709 13:02:09.193126  1620 rpcz_store.cc:276] 0709 13:02:07.627347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.167179 (+1539832us) service_pool.cc:224] Handling call
0709 13:02:09.167455 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.171272 (+  3817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.171456 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.194710  1620 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:09.198024  1587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.009s
W20260709 13:02:09.198540  1587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.009s
W20260709 13:02:09.199267  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 640110us
I20260709 13:02:09.201301  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:09.116683  6341 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.159368  6338 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.211088  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:09.211867  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.212255  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 897) took 1199 ms. Trace:
I20260709 13:02:09.215919  1620 rpcz_store.cc:276] 0709 13:02:08.012958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.194218 (+1181260us) service_pool.cc:224] Handling call
0709 13:02:09.194523 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.195093 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.212160 (+ 17067us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.213133  1511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.011s
I20260709 13:02:09.158792  6004 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:02:09.217561  1511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.005s	sys 0.011s
I20260709 13:02:09.174978  5982 raft_consensus.cc:3055] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.174289  1544 rpcz_store.cc:276] 0709 13:02:07.951676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.326268 (+374592us) service_pool.cc:224] Handling call
0709 13:02:08.326565 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.329181 (+  2616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.329207 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.334478 (+  5271us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.476761 (+142283us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:08.718181 (+241420us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.851793 (+133612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.851893 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.162770 (+310877us) raft_consensus.cc:1685] finished
0709 13:02:09.162797 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.162961 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26851,"prepare.queue_time_us":377424,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":171372,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":9413,"thread_start_us":416838,"threads_started":3,"wal-append.queue_time_us":186175}
I20260709 13:02:09.247128  1511 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:09.207955  6313 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:09.243053  5982 raft_consensus.cc:740] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:09.173610  6355 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.267311  1544 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.270438  1620 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.216964  6367 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:09.172019  6444 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:02:09.263576  6443 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:09.275941  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 148581us
I20260709 13:02:09.268494  6403 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.290244  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:09.285987  6220 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.281445  6445 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:09.289135  6454 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:02:09.300735  6295 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.271934  6313 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:09.309060  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68804.7us
W20260709 13:02:09.310947  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.296746  5982 consensus_queue.cc:260] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.316891  5982 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:09.329567  6339 consensus_meta.cc:287] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.796s	user 0.009s	sys 0.002s
W20260709 13:02:09.334605  6459 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:02:09.335891  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2240) took 1383 ms. Trace:
I20260709 13:02:09.336267  1541 rpcz_store.cc:276] 0709 13:02:07.952182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.710941 (+758759us) service_pool.cc:224] Handling call
0709 13:02:08.711299 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.856757 (+145458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.856784 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.857276 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.982512 (+125236us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:08.982558 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.982658 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.335688 (+353030us) raft_consensus.cc:1685] finished
0709 13:02:09.335707 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.335833 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26485,"raft.queue_time_us":163679,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4573,"thread_start_us":269873,"threads_started":2,"wal-append.queue_time_us":210694}
I20260709 13:02:09.338341  6251 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:09.339692  6247 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.341439  6355 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.342572  6341 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.347988  6313 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:09.349545  6246 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.783s	user 0.014s	sys 0.000s
I20260709 13:02:09.349968  6246 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.352085  6246 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.352614  6246 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:09.353071  6246 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.356606  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.357817  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:09.358038  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.009s	sys 0.011s
W20260709 13:02:09.358388  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.009s	sys 0.011s
W20260709 13:02:09.359975  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 1.02314e+06us
I20260709 13:02:09.361940  1688 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:09.364145  1544 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:09.330170  6339 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.368208  1621 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:09.376832  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.377343  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.378192  2264 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:09.379920  2262 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:09.381222  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.383492  2265 raft_consensus.cc:1240] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:09.378018  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.385376  6339 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.392156  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2109) took 1765 ms. Trace:
I20260709 13:02:09.392618  1618 rpcz_store.cc:276] 0709 13:02:07.626380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.890044 (+1263664us) service_pool.cc:224] Handling call
0709 13:02:08.911735 (+ 21691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.912210 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.912254 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.970788 (+ 58534us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.160791 (+190003us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.160848 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.160943 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.391962 (+231019us) raft_consensus.cc:1685] finished
0709 13:02:09.391980 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.392099 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4927,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":6097,"thread_start_us":160373,"threads_started":1,"wal-append.queue_time_us":275169}
I20260709 13:02:09.395550  1618 raft_consensus.cc:1240] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:08.872291   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:09.396972  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2639) took 1001 ms. Trace:
I20260709 13:02:09.397322  1544 rpcz_store.cc:276] 0709 13:02:08.395570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.261804 (+866234us) service_pool.cc:224] Handling call
0709 13:02:09.267181 (+  5377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.364661 (+ 97480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.396918 (+ 32257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.396219  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2114) took 1162 ms. Trace:
I20260709 13:02:09.403334  1618 rpcz_store.cc:276] 0709 13:02:08.233970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.394300 (+1160330us) service_pool.cc:224] Handling call
0709 13:02:09.395313 (+  1013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.395976 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.396155 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.410282  1444 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 9, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.412312  1444 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 10 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:09.396684  6411 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.413697  1444 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 10, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:09.421991  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 894) took 1704 ms. Trace:
I20260709 13:02:09.415787  6411 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:09.420657  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2634) took 1031 ms. Trace:
I20260709 13:02:09.422520  1617 rpcz_store.cc:276] 0709 13:02:07.718126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.168273 (+1450147us) service_pool.cc:224] Handling call
0709 13:02:09.175797 (+  7524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.176132 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.176175 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.176606 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.297796 (+121190us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:09.297854 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.297947 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.421735 (+123788us) raft_consensus.cc:1685] finished
0709 13:02:09.421761 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.421923 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22848,"raft.queue_time_us":96,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8092,"thread_start_us":61448,"threads_started":1,"wal-append.queue_time_us":196718}
I20260709 13:02:09.425107  1540 rpcz_store.cc:276] 0709 13:02:08.389491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.873713 (+484222us) service_pool.cc:224] Handling call
0709 13:02:08.874008 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.975841 (+101833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.975895 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.983749 (+  7854us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.114521 (+130772us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:09.114563 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.420227 (+305664us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400210054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.420276 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.420322 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:09.420335 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.420588 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29467,"raft.queue_time_us":72222,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":8779,"spinlock_wait_cycles":52853632,"thread_start_us":114346,"threads_started":1,"wal-append.queue_time_us":257023}
W20260709 13:02:09.430403  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.354139  6436 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.435513  1444 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 10, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.444983  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:09.448585  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:09.448670  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 50954.3us
I20260709 13:02:09.445286  6473 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.450924  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:09.451767  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.452247  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:09.453675  1444 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 9, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.451426  6246 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.448917  6339 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:09.453904  6341 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.460397  6436 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:09.453727  6235 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:09.450295  6221 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.465291  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2638) took 1070 ms. Trace:
I20260709 13:02:09.452508  6473 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:09.449189  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 293) took 42112 ms (client timeout 15000 ms). Trace:
I20260709 13:02:09.474978  1692 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.488294  1693 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:09.473616  1444 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 10, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:09.483016  1538 rpcz_store.cc:276] 0709 13:02:08.394948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.116306 (+721358us) service_pool.cc:224] Handling call
0709 13:02:09.146752 (+ 30446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.157089 (+ 10337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.157120 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.170746 (+ 13626us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.398879 (+228133us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.398918 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.398980 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.464830 (+ 65850us) raft_consensus.cc:1685] finished
0709 13:02:09.464875 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.465150 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9733,"raft.queue_time_us":17885,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":3317,"thread_start_us":167937,"threads_started":1,"wal-append.queue_time_us":232326}
I20260709 13:02:09.485033  1585 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:09.485249  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 847) took 1407 ms. Trace:
I20260709 13:02:09.490444  1690 rpcz_store.cc:276] 0709 13:02:08.071694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.209516 (+137822us) service_pool.cc:224] Handling call
0709 13:02:09.479286 (+1269770us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54000b31d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:09.479516 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463241600}
I20260709 13:02:09.495353  1696 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:09.496166  6221 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.485380  1695 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:02:09.496943  1695 pending_rounds.cc:85] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 10
I20260709 13:02:09.497176  1695 pending_rounds.cc:107] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:02:09.497390  1695 raft_consensus.cc:2889] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.498741  1444 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:09.505263  1444 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.512449  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2242) took 1559 ms. Trace:
I20260709 13:02:09.507148  1444 catalog_manager.cc:5697] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 8, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.514717  1444 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.517145  1444 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 7, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.486714  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:09.512953  1543 rpcz_store.cc:276] 0709 13:02:07.952640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.874214 (+921574us) service_pool.cc:224] Handling call
0709 13:02:08.874543 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.907282 (+ 32739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.907315 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:08.907356 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:02:08.907391 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.512212 (+604821us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54000483d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.512257 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.512390 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74776448}
I20260709 13:02:09.519647  1444 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 11, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.541014  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1987) took 1578 ms. Trace:
I20260709 13:02:09.542155  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:09.541455  1689 rpcz_store.cc:276] 0709 13:02:07.962532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.010603 (+ 48071us) service_pool.cc:224] Handling call
0709 13:02:08.010899 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.272950 (+262051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.540764 (+1267814us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002ee5d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.540954 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601271680}
W20260709 13:02:09.544970  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.545053  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.546190  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.545651  6292 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:09.547546  6292 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.549504  6292 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.549571  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1869) took 1973 ms. Trace:
I20260709 13:02:09.550063  1613 rpcz_store.cc:276] 0709 13:02:07.576126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.122071 (+545945us) service_pool.cc:224] Handling call
0709 13:02:08.122478 (+   407us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:08.294150 (+171672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.294176 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:08.294837 (+   661us) log.cc:844] Serialized 78 byte log entry
0709 13:02:08.414648 (+119811us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:08.836269 (+421621us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.548734 (+712465us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.549091 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.549248 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.549327 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.549371 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:09.549384 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.549513 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":900231,"prepare.queue_time_us":1132220,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":169803,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":15632,"thread_start_us":479061,"threads_started":2,"wal-append.queue_time_us":214713}
I20260709 13:02:09.557487  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.559036  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:09.559724  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:09.560083  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:09.560609  1695 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.561363  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.484560  6246 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:09.561936  1692 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:09.562522  1444 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.563694  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.566901  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:09.567034  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:09.567606  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50342 (request call id 1867) took 2020 ms (client timeout 1611 ms). Trace:
W20260709 13:02:09.570924  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.572044  6200 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:09.574572  1695 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:09.576865  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 1054) took 1588 ms. Trace:
I20260709 13:02:09.583848  1614 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: [10.6-12.8]
W20260709 13:02:09.568008  1616 rpcz_store.cc:269] 0709 13:02:07.541807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.568442 (+ 26635us) service_pool.cc:224] Handling call
0709 13:02:09.561823 (+1993381us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400062554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:09.561940 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175134464}
I20260709 13:02:09.586831  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2119) took 1351 ms. Trace:
I20260709 13:02:09.488284  6436 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:09.587152  1614 rpcz_store.cc:276] 0709 13:02:08.234949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.583165 (+1348216us) service_pool.cc:224] Handling call
0709 13:02:09.583538 (+   373us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:09.586540 (+  3002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.586779 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.592907  1695 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:09.593048  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:09.593626  1613 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.593528  1614 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:02:09.585565  2260 rpcz_store.cc:276] 0709 13:02:07.988084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.988193 (+   109us) service_pool.cc:224] Handling call
0709 13:02:08.006523 (+ 18330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.449947 (+443424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.576607 (+1126660us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54006bf154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.576810 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960772992}
W20260709 13:02:09.601869  1587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.785s (SENT) [suppressed 26 similar messages]
I20260709 13:02:09.602236  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.607503  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2121) took 1356 ms. Trace:
I20260709 13:02:09.608047  1614 rpcz_store.cc:276] 0709 13:02:08.250992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.593061 (+1342069us) service_pool.cc:224] Handling call
0709 13:02:09.593327 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.594564 (+  1237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.607441 (+ 12877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.544100  6221 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:09.609808  1614 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:09.610461  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2122) took 1350 ms. Trace:
I20260709 13:02:09.610492  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1876) took 1324 ms. Trace:
I20260709 13:02:09.611150  1616 rpcz_store.cc:276] 0709 13:02:08.286211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.609511 (+1323300us) service_pool.cc:224] Handling call
0709 13:02:09.609879 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.610098 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.610134 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.610191 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:09.610237 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.610301 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.610422 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.610896  1614 rpcz_store.cc:276] 0709 13:02:08.259979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.609368 (+1349389us) service_pool.cc:224] Handling call
0709 13:02:09.609636 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.610234 (+   598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.610410 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.614079  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 901) took 1326 ms. Trace:
I20260709 13:02:09.614570  1614 rpcz_store.cc:276] 0709 13:02:08.287852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.613383 (+1325531us) service_pool.cc:224] Handling call
0709 13:02:09.613623 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.613797 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.613822 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.613859 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:09.613896 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.613945 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.614034 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.564635  6427 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:09.613453  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 898) took 1326 ms. Trace:
I20260709 13:02:09.634420  1616 rpcz_store.cc:276] 0709 13:02:08.287076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.612448 (+1325372us) service_pool.cc:224] Handling call
0709 13:02:09.612823 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.613044 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.613082 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.613141 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:09.613181 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.613253 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.613388 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.641211  6466 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.333s	user 0.000s	sys 0.006s
I20260709 13:02:09.623510  6221 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.645485  6221 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.643081  6427 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.652954  6427 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:09.622293  6313 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:09.654942  6313 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:09.655315  6313 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:09.655468  6473 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.656185  6313 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.657063  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 1994) took 1550 ms. Trace:
I20260709 13:02:09.657603  1687 rpcz_store.cc:276] 0709 13:02:08.107032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.245122 (+138090us) service_pool.cc:224] Handling call
0709 13:02:08.245441 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.868636 (+623195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.656737 (+788101us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b540023b4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.656981 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421150080}
I20260709 13:02:09.627022  6413 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:09.659252  6294 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:09.661736  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2113) took 1428 ms. Trace:
I20260709 13:02:09.664283  1620 rpcz_store.cc:276] 0709 13:02:08.233790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.216890 (+983100us) service_pool.cc:224] Handling call
0709 13:02:09.217165 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.271239 (+ 54074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.661513 (+390274us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5400232154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:09.661676 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122026240}
I20260709 13:02:09.665632  1616 raft_consensus.cc:1275] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:09.648569  1444 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.670231  1620 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:09.672044  1620 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:09.681066  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 902) took 1381 ms. Trace:
I20260709 13:02:09.681674  1614 rpcz_store.cc:276] 0709 13:02:08.305213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.670970 (+1365757us) service_pool.cc:224] Handling call
0709 13:02:09.671317 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.672568 (+  1251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.672618 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.672674 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:09.672718 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.672796 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.680976 (+  8180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1735}
I20260709 13:02:09.684646  1444 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.689019  1613 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:09.617053  6436 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.657619  6313 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:09.713539  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 110240us
I20260709 13:02:09.662184  6478 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:02:09.587321  6246 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.715961  1444 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 5 to 9, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:09.719810  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.721817  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.723685  1689 raft_consensus.cc:2410] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:02:09.662983  5972 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:09.729566   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:02:09.728992  1444 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 4 to 10, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.734982  1444 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 6 to 7, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:09.736604  1694 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:09.737401  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 63635.4us
I20260709 13:02:09.742373  1694 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:09.744575   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:09.696839  6444 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:02:09.695962  6439 consensus_queue.cc:1059] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:09.696228  6359 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:02:09.750133  1444 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:09.764514  6155 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:09.770974  6155 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.750842  6427 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:09.777223  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.780956  6436 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.781796  6427 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.784193  6427 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.774245  6251 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:09.788232  6251 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.796623  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.798724  6356 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:02:09.797343  6367 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:09.799062  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.767340  6069 consensus_queue.cc:1048] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:09.799985  6367 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.806691  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2243) took 1696 ms. Trace:
I20260709 13:02:09.807739  6246 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.809067  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2239) took 1857 ms. Trace:
I20260709 13:02:09.790352  6251 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:09.810886  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.829430  2258 raft_consensus.cc:2393] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:02:09.812353  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 565306us
I20260709 13:02:09.809612  1542 rpcz_store.cc:276] 0709 13:02:07.951929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.582687 (+630758us) service_pool.cc:224] Handling call
0709 13:02:08.583390 (+   703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.117531 (+534141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.117563 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.119794 (+  2231us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.236981 (+117187us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.237248 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.808640 (+571392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.808746 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.808805 (+    59us) raft_consensus.cc:1685] finished
0709 13:02:09.808830 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.808988 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":571087,"prepare.queue_time_us":295,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":49,"raft.queue_time_us":116076,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8398,"thread_start_us":535007,"threads_started":2,"wal-append.queue_time_us":195213}
I20260709 13:02:09.807132  1545 rpcz_store.cc:276] 0709 13:02:08.110822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.872414 (+761592us) service_pool.cc:224] Handling call
0709 13:02:08.891916 (+ 19502us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:08.922560 (+ 30644us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:08.998410 (+ 75850us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.173661 (+175251us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:09.177620 (+  3959us) log.cc:844] Serialized 52 byte log entry
0709 13:02:09.177874 (+   254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:09.178189 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.359298 (+181109us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18004c5b20. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:09.640668 (+281370us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:09.655900 (+ 15232us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b48000030d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:02:09.804240 (+148340us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b18004c5b20. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:02:09.806178 (+  1938us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.806361 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.806437 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.806475 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:09.806485 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.806610 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664820,"prepare.queue_time_us":259216,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":671895,"raft.run_cpu_time_us":4521,"raft.run_wall_time_us":757773,"spinlock_wait_cycles":59541760,"thread_start_us":135161,"threads_started":1,"wal-append.queue_time_us":237621}
I20260709 13:02:09.831005  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:09.779001  6155 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:09.842849  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 171892us
W20260709 13:02:09.843241  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 553059us
I20260709 13:02:09.847375  1689 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:09.850865  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:09.853817  6469 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:09.487396  1441 rpcz_store.cc:269] 0709 13:01:27.336186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.336919 (+   733us) service_pool.cc:224] Handling call
0709 13:02:09.447042 (+42110123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:03.213815 (+     0us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1e30f16c
0709 13:02:03.495584 (+281769us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:03.496299 (+   715us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:03.496352 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:02:03.496369 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:03.497508 (+  1139us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:03.497619 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:03.497645 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:03.516275 (+ 18630us) tablet.cc:701] Row locks acquired
0709 13:02:03.516338 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:02:03.516534 (+   196us) write_op.cc:270] Start()
0709 13:02:03.516806 (+   272us) write_op.cc:276] Timestamp: P: 1783602123516475 usec, L: 0
0709 13:02:03.516846 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:02:03.517595 (+   749us) log.cc:844] Serialized 4407 byte log entry
0709 13:02:04.060668 (+543073us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:04.310968 (+250300us) op_driver.cc:464] REPLICATION: finished
0709 13:02:04.433905 (+122937us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f177d00ac 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1e310ef0
0709 13:02:04.671390 (+237485us) write_op.cc:301] APPLY: starting
0709 13:02:04.671525 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:04.755381 (+ 83856us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:04.755423 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:04.835688 (+ 80265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:04.990093 (+154405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:02:05.030238 (+ 40145us) write_op.cc:312] APPLY: finished
0709 13:02:05.164856 (+134618us) log.cc:844] Serialized 105 byte log entry
0709 13:02:05.165034 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.165177 (+   143us) write_op.cc:454] Released schema lock
0709 13:02:05.165246 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:05.165678 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:05.165707 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":199588,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":358935,"apply.run_cpu_time_us":17181,"apply.run_wall_time_us":495418,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50085,"num_ops":11,"prepare.queue_time_us":476392,"prepare.run_cpu_time_us":13764,"prepare.run_wall_time_us":417324,"raft.queue_time_us":191033,"raft.run_cpu_time_us":30750,"raft.run_wall_time_us":321890,"replication_time_us":777311,"spinlock_wait_cycles":28239872,"thread_start_us":1061622,"threads_started":4,"wal-append.queue_time_us":473783,"wal-append.run_cpu_time_us":30499,"wal-append.run_wall_time_us":2179358}]]}
I20260709 13:02:09.827111  6246 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:09.862551  6456 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:09.862742  6364 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:09.863354  6456 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:09.863160  6246 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:09.863778  6364 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:09.864333  6456 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:09.864790  6364 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:09.865468  6364 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:09.865562  6246 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:09.868510  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:09.862501  1511 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:09.840385  6463 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:09.888542  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:09.887198  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:09.891111  1540 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:09.866397  6455 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:02:09.892557  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:09.893462  1538 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:09.879232  6004 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:09.894985  1618 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:02:09.877923  5630 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:09.882562  6016 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:09.897266  1618 pending_rounds.cc:85] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 12
I20260709 13:02:09.923596  1618 pending_rounds.cc:107] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:02:09.923874  1618 raft_consensus.cc:2889] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:09.903225  6455 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:09.897195  6004 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:09.911188  1544 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:09.915977  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:09.934464  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 196326us
I20260709 13:02:09.919092  1541 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:09.922545  6428 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:09.945714  1538 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:09.924793  6463 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:09.937203  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:09.898273  5630 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:09.900961  6367 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:09.924607  6235 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.001997  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 148960us
I20260709 13:02:09.959661  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:09.923393  6016 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:10.003948  1541 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:09.937108  6428 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:10.008653  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:10.009640  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 72814.8us
I20260709 13:02:09.935556  6489 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:02:10.000785  6193 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.017624  1613 raft_consensus.cc:1275] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:02:10.007454  5972 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:10.020263  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:10.020651  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.022913  1544 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:10.024547  1615 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:10.025403  5630 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.027024  5630 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.008932  6235 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.031523  6016 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.033128  6016 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.018023  6004 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.024658  6193 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.038420  6193 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:10.018520  6463 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.051549  6463 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.053660  6463 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:10.054847  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2126) took 1386 ms. Trace:
I20260709 13:02:10.055061  5972 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:10.055280  1622 rpcz_store.cc:276] 0709 13:02:08.668793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.632275 (+963482us) service_pool.cc:224] Handling call
0709 13:02:09.632586 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.646759 (+ 14173us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:09.646993 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.735914 (+ 88921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.735959 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.736002 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.054636 (+318634us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54002b6bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:10.054679 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.054790 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8900,"prepare.queue_time_us":494,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":9385,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":11573,"spinlock_wait_cycles":31960448,"thread_start_us":77213,"threads_started":1,"wal-append.queue_time_us":101375}
I20260709 13:02:10.056051  5972 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.060631  6478 raft_consensus.cc:3055] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:10.061059  6478 raft_consensus.cc:740] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:10.057197  6428 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.061878  6478 consensus_queue.cc:260] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.072487  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:10.069284  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.101354  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.102123  1622 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:10.064631  6112 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:10.102767  6112 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:10.102978  1660 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.103909  6231 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.103650  6112 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.104172  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.104625  6112 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.105120  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.075141  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.071094  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.108361  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:10.073006  1690 raft_consensus.cc:1240] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:10.109086  1620 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:10.066157  6474 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:10.069520  6235 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:10.074277  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:10.109745  6231 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.109910  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.109812  6474 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:10.111501  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.062408  6428 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.111863  6474 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.113245  6474 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.113565  1620 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:10.074054  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.115351  1616 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:10.115821  1692 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:10.068080  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:10.092828  6481 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.319s	user 0.000s	sys 0.002s
I20260709 13:02:10.102299  6463 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.111568  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.116904  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.117532  1690 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:10.117381  6463 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.119036  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.123214  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2232) took 2591 ms. Trace:
I20260709 13:02:10.123590  1546 rpcz_store.cc:276] 0709 13:02:07.532042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.819148 (+287106us) service_pool.cc:224] Handling call
0709 13:02:09.008838 (+1189690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.076220 (+ 67382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.123019 (+1046799us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540013ecd0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:10.123159 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2684200832}
I20260709 13:02:10.126595  6338 consensus_queue.cc:1059] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:10.127764  6338 raft_consensus.cc:3055] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:10.128189  6338 raft_consensus.cc:740] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:10.128566  6455 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.129143  6455 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.129189  6338 consensus_queue.cc:260] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.132184  6476 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:10.132663  6476 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:10.133463  6476 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.067411  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.135813  6478 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:10.140687  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.141613  1622 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:10.142248  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.134418  6476 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:10.149190  1616 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:10.162431  1541 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
W20260709 13:02:10.162252  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 50836us
I20260709 13:02:10.163753  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:10.166950  1616 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:10.122430  6004 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:10.187997  2231 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:10.189180  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 329604us
I20260709 13:02:10.185643  1622 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:10.206511  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.213404  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.209806  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:10.216718  1510 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.217159  1687 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:02:10.221871  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57417.3us
I20260709 13:02:10.227686  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:10.158571  6383 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.268154  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51507.4us
W20260709 13:02:10.268308  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.269419  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49900.2us
W20260709 13:02:10.279155  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.268821  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 57155.5us
I20260709 13:02:10.273728  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:10.279517  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:10.187338  6338 raft_consensus.cc:3060] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.187762  6367 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:10.293032  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.282582  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:10.319790  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:10.164759  6313 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.200282  6200 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:10.216560  6439 raft_consensus.cc:2804] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:10.377029  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 514592us
I20260709 13:02:10.267889  6246 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:10.268543  6364 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:10.188187  6235 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.160s
W20260709 13:02:10.451726  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.311590  6367 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:10.187429  6410 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.183s
I20260709 13:02:10.281529  6499 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:10.368855  6189 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:10.384598  6226 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:10.273159  6251 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:02:10.214883  6221 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.261s
I20260709 13:02:10.384012  6193 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:10.318981  6436 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.155s
I20260709 13:02:10.307711  5630 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 13:02:10.319469  6490 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:02:10.312119  6383 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.404115  6500 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.384012  6428 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.466900  6367 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:10.457649  6235 consensus_queue.cc:1243] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:10.471047  6016 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.469313  6455 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:10.498274  6364 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.474664  6439 raft_consensus.cc:697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:10.477492  6354 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.486181  6463 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:10.486649  6226 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.505072  6251 consensus_queue.cc:1243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:10.501726  6189 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:10.590466  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:10.531314  6193 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:10.604753  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.626201  1544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.015s	sys 0.026s
W20260709 13:02:10.616252  6231 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.001s
W20260709 13:02:10.592437  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.665511  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 391907us
I20260709 13:02:10.606254  6016 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:10.667094  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 76931.6us
W20260709 13:02:10.663928  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.636581  6226 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:10.700752  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.586580  6428 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.605297  6359 consensus_queue.cc:1048] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:02:10.715811  6193 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:10.716041  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.719848  6189 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.777069  6193 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.777567  6193 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:10.678537  6491 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:10.745940   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.760514  1587 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:10.764132  6004 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
W20260709 13:02:10.713683  1544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.015s	sys 0.031s
I20260709 13:02:10.775045  6428 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:10.785295  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:10.869793  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 84596.3us
W20260709 13:02:10.730113  6498 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:02:10.703545  6155 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.613385  6364 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:10.795260  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.767978  6231 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:10.552664  6500 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:10.789578  6494 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.388s	user 0.000s	sys 0.002s
W20260709 13:02:10.825485  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.895897  1613 raft_consensus.cc:1217] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[4.4-13.9]   Dedup: 8.6->[9.7-13.9]
I20260709 13:02:10.728067  6235 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.918148  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 870) took 1068 ms. Trace:
I20260709 13:02:10.821240  6359 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:02:10.919490  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.920156  1616 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:10.726444  6216 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.871685  6521 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.587582  6456 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:10.876020  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 485809us
I20260709 13:02:10.867660  6417 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.880842  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 888) took 3248 ms. Trace:
I20260709 13:02:10.954413  1621 rpcz_store.cc:276] 0709 13:02:07.625558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.672007 (+1046449us) service_pool.cc:224] Handling call
0709 13:02:08.672410 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.368561 (+696151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.873372 (+1504811us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54002cae54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:10.873614 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599923072}
I20260709 13:02:10.890033  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:10.891033  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2117) took 2656 ms. Trace:
I20260709 13:02:10.955717  1618 rpcz_store.cc:276] 0709 13:02:08.234423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.404360 (+1169937us) service_pool.cc:224] Handling call
0709 13:02:09.404717 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.924317 (+519600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.890728 (+966411us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54000f8cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:10.890957 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126767872}
I20260709 13:02:10.896308  1695 raft_consensus.cc:1217] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 6.4->[8.5-13.7]   Dedup: 8.5->[10.6-13.7]
I20260709 13:02:10.896435  1613 pending_rounds.cc:85] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:10.957080  1613 pending_rounds.cc:107] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:10.957336  1613 raft_consensus.cc:2889] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:10.900353  6496 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 13:02:10.905308  6237 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:10.907395  6507 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:02:10.909380  6335 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.961630  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:10.886694  6428 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:10.913932  6221 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:10.914129  6500 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:10.914501  6383 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:10.889580  6193 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:10.918589  1689 rpcz_store.cc:276] 0709 13:02:09.849934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.850105 (+   171us) service_pool.cc:224] Handling call
0709 13:02:09.850562 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.851055 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.851102 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.851853 (+   751us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.021025 (+169172us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:10.021082 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.021184 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.917890 (+896706us) raft_consensus.cc:1685] finished
0709 13:02:10.917910 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:10.918080 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":548,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":168797,"threads_started":1,"wal-append.queue_time_us":363531}
W20260709 13:02:10.951072  5972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.033s	sys 0.031s
I20260709 13:02:10.913364  6469 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:10.958693  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:10.956789  1695 pending_rounds.cc:85] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 5
I20260709 13:02:10.889425  6491 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:10.797566  6439 consensus_queue.cc:237] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:10.980502  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.994867  1538 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:10.995409  1694 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:10.996431  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.984529  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:10.987321  1690 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 13. Ops: []
W20260709 13:02:10.959355  6411 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.016s	sys 0.035s
I20260709 13:02:10.991008  1695 pending_rounds.cc:107] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:11.009063  1695 raft_consensus.cc:2889] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.990566  1689 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:02:11.009338  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.009917  1540 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.001559  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.010448  1542 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:11.000592  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.013450  1541 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:10.888028  6155 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.004591  1691 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:02:11.006114  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.017396  1691 pending_rounds.cc:85] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 7
I20260709 13:02:10.972509  6427 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.017696  1691 pending_rounds.cc:107] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:02:11.017975  1691 raft_consensus.cc:2889] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:10.993078  5972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.034s	sys 0.031s
I20260709 13:02:10.993260  6469 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:11.031912  6469 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.033152  6469 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:11.036429  6354 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.942502  6235 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.040740  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.042558  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 872) took 1189 ms. Trace:
I20260709 13:02:11.044127  1688 rpcz_store.cc:276] 0709 13:02:09.852895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.853040 (+   145us) service_pool.cc:224] Handling call
0709 13:02:09.853379 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.860469 (+  7090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.860507 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.861011 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.225911 (+364900us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:10.225952 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.226031 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:10.899667 (+673636us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:11.016840 (+117173us) raft_consensus.cc:1685] finished
0709 13:02:11.016862 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.042477 (+ 25615us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6665,"raft.queue_time_us":8367,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":7993088,"thread_start_us":364529,"threads_started":1,"wal-append.queue_time_us":617182}
I20260709 13:02:11.051697  1542 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:11.052753  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.053651  1542 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.056870  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.064733  1540 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:10.956532  6216 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.961970  6456 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:11.008952  6411 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.016s	sys 0.036s
I20260709 13:02:11.066675  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.067515  1546 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 16: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:10.989682  6522 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:10.997524  5630 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:11.005223  6251 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:11.069278  1694 raft_consensus.cc:2410] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:11.070577  1538 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:11.058038  6193 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:11.012076  6524 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.997997  6500 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:11.075970  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:10.993281  6237 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:10.984421  6428 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:10.983137  6335 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.038776  6145 consensus_queue.cc:1059] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:02:10.961818  6521 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.015159  6383 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:02:11.107028  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.056973  6427 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.083446  1622 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:11.040235  6221 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.068753  6514 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:02:10.970310  6417 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.036998  6354 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.098726  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.101432  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:11.102677  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.014s	sys 0.010s
W20260709 13:02:11.146884  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.014s	sys 0.010s
I20260709 13:02:11.112389  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.101861  6016 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.114094  6411 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.114595  6145 raft_consensus.cc:3055] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:11.114941  6456 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.091320  6455 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.104779  6500 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.117372  6155 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.088244  6251 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.103698  6519 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:11.119200  6527 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.120052  6364 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.100852  6524 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:11.121203  6112 consensus_meta.cc:287] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.016s	user 0.014s	sys 0.004s
W20260709 13:02:11.249562  6518 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:11.250201  6524 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.076987  6226 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:11.123401  6367 consensus_meta.cc:287] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:02:11.252112  6367 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.253809  6226 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.085630  6522 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:11.254907  6522 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.005100  6491 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.261106  6491 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.262691  6367 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.263875  6428 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:11.083374  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:11.134204  1586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.001s	sys 0.024s
W20260709 13:02:11.271235  1586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.002s	sys 0.024s
I20260709 13:02:11.272158  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.273051  1540 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:11.274152  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.274937  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.276167  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.277470  6354 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.278689  6354 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.278736  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.279266  6354 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.279923  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.281420  6216 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.281893  6226 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:11.141861  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.283318  6529 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:11.283738  6427 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.112561  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:11.147601  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 777181us
I20260709 13:02:11.285693  5972 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:11.104115  6193 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:11.091333  5630 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:11.287410  6474 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.174s	user 0.014s	sys 0.000s
I20260709 13:02:11.287271  6193 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.288729  5630 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:11.197570  6338 consensus_meta.cc:287] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.787s	user 0.013s	sys 0.000s
I20260709 13:02:11.289553  1539 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.290242  1542 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:11.291213  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.198387  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:11.193693  6510 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.316s	user 0.002s	sys 0.000s
I20260709 13:02:11.106902  6237 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.242429  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.122229  6521 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.203708  6456 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:11.292130  1546 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
W20260709 13:02:11.293118  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.293162  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:11.337479  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.337586  1621 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
I20260709 13:02:11.193446  6145 raft_consensus.cc:740] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:11.311225  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.342902  1541 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.275101  1540 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:11.312340  1539 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:11.195055  6411 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:11.328454  6514 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:02:11.335503  1545 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.000s	sys 0.021s
I20260709 13:02:11.338647  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.376551  1621 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:11.376950  1545 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.000s	sys 0.021s
I20260709 13:02:11.283771  6529 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:11.379185  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.379905  1621 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:11.380525  1689 raft_consensus.cc:1240] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:11.380741  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.381423  1621 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:11.382395  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.383773  1621 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:11.349243  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 365147us
I20260709 13:02:11.350896  2258 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:11.351061  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.220633  6251 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:11.353096  1541 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:11.276201  6417 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.139024  6221 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.365222  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1866) took 3823 ms. Trace:
I20260709 13:02:11.204612  6455 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.377665  1545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 685) took 1492 ms. Trace:
I20260709 13:02:11.292055  1542 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:11.301486  6367 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:11.384635  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:11.385475  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.422116  2260 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:11.386693  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:11.388586  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.423650  1621 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:11.389562  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.375209  6358 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:11.392102  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.341198  6524 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.400923  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.411355  1547 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:11.427476  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.413378  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.416888  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.422703  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:11.376901  6525 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:11.429883  1542 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:11.414609  1545 rpcz_store.cc:276] 0709 13:02:09.885038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.885248 (+   210us) service_pool.cc:224] Handling call
0709 13:02:09.896023 (+ 10775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.896214 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:10.100440 (+204226us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.377340 (+1276900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.377388 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.377429 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.377502 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.377613 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27247,"prepare.queue_time_us":114267,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":222501,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":23006,"spinlock_wait_cycles":122374528,"thread_start_us":1439221,"threads_started":3,"wal-append.queue_time_us":777200}
I20260709 13:02:11.390555  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.430734  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.431123  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:11.431296  1542 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:11.432363  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:11.433645  1542 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:11.428573  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:11.401731  6508 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:11.242694  6519 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.434782  6524 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.429256  1546 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:11.436543  1547 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.433866  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.351802  6522 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.409071  1619 rpcz_store.cc:276] 0709 13:02:07.541536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.903772 (+362236us) service_pool.cc:224] Handling call
0709 13:02:07.904780 (+  1008us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:08.282823 (+378043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.282854 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:08.283426 (+   572us) log.cc:844] Serialized 52 byte log entry
0709 13:02:08.409545 (+126119us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:08.452983 (+ 43438us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.011575 (+558592us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b1800471ac0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:09.546860 (+535285us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b1800471ac0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1e7ae58f 00007f7f177ed571 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd
0709 13:02:10.011954 (+465094us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b1800471ac0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287
0709 13:02:10.988030 (+976076us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.360792 (+372762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.363132 (+  2340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.363206 (+    74us) raft_consensus.cc:1685] finished
0709 13:02:11.363224 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.365131 (+  1907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1355220,"prepare.queue_time_us":1061206,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":96,"raft.queue_time_us":424611,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":14498,"spinlock_wait_cycles":80256896,"thread_start_us":600808,"threads_started":3,"wal-append.queue_time_us":249369,"wal-append.run_cpu_time_us":3281,"wal-append.run_wall_time_us":1482038}
I20260709 13:02:11.392040  6521 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.349741  6456 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.292716  6527 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.399331  5982 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.474535  1541 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:11.474635  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 73790.4us
I20260709 13:02:11.476099  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:11.444785  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.416814  6422 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:11.468679  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:11.442133  6526 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:02:11.429153  5630 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.480890  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.484660  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:11.485723  1546 raft_consensus.cc:2410] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:11.479811  1615 raft_consensus.cc:2410] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:02:11.451840  6200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.013s	sys 0.017s
W20260709 13:02:11.477555  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 395975us
I20260709 13:02:11.489152  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:11.504403  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.512434  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.515215  1542 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:11.503377  1621 raft_consensus.cc:1240] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:11.507023  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 436819us
I20260709 13:02:11.435889  6231 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:02:11.517550  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 687) took 1631 ms. Trace:
W20260709 13:02:11.483518  6478 consensus_meta.cc:287] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 1.325s	user 0.012s	sys 0.001s
I20260709 13:02:11.525588  1543 rpcz_store.cc:276] 0709 13:02:09.885929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.887339 (+  1410us) service_pool.cc:224] Handling call
0709 13:02:09.887746 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:10.150346 (+262600us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:10.205753 (+ 55407us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.808367 (+602614us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:10.868605 (+ 60238us) log.cc:844] Serialized 26 byte log entry
0709 13:02:10.868793 (+   188us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:10.869249 (+   456us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.874917 (+  5668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:10.874999 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:11.517337 (+642338us) raft_consensus.cc:1685] finished
0709 13:02:11.517361 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.517489 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1184,"prepare.queue_time_us":68650,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":214365,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":3183,"spinlock_wait_cycles":20526464,"thread_start_us":863113,"threads_started":3,"wal-append.queue_time_us":425513}
I20260709 13:02:11.437463  6367 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.543288  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.473531  6335 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.479805  6235 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.547093  1545 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:02:11.549203  1615 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:02:11.517804  6200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.014s	sys 0.018s
I20260709 13:02:11.440310  6525 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.510648  6506 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.439919  6145 consensus_queue.cc:260] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.557654  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2137) took 1481 ms. Trace:
I20260709 13:02:11.557134  6216 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:11.563272  1620 rpcz_store.cc:276] 0709 13:02:10.076703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.114519 (+ 37816us) service_pool.cc:224] Handling call
0709 13:02:10.114824 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.149140 (+ 34316us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:11.298340 (+1149200us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.557082 (+258742us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.557166 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.557244 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.557379 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.557560 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":868352,"prepare.queue_time_us":938793,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"thread_start_us":487363,"threads_started":2}
I20260709 13:02:11.562377  1615 raft_consensus.cc:1275] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:11.543938  6491 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:11.515316  1541 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:11.473685  6521 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.525472  6338 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.553469  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.567930  1543 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:11.572588  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:11.503043  5982 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.548318  6237 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:11.616559  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 63163.1us
I20260709 13:02:11.503491  6422 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.603284  2266 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:11.549455  6313 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.617657  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.636515  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:11.627600  6540 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:11.481392  6529 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.569659  6500 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.526439  5630 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.638711  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2118) took 3404 ms. Trace:
I20260709 13:02:11.603924  6534 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:11.553489  6200 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:02:11.669334  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.639643  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 913) took 1617 ms. Trace:
I20260709 13:02:11.704489  1614 rpcz_store.cc:276] 0709 13:02:10.022323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.022463 (+   140us) service_pool.cc:224] Handling call
0709 13:02:10.022733 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:10.022915 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:11.417877 (+1394962us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.639271 (+221394us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.639326 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:11.639368 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.639432 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.639546 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":972758,"prepare.queue_time_us":1062531,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":7660,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9510,"thread_start_us":626599,"threads_started":2}
I20260709 13:02:11.677752  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.606559  6491 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:11.709376  6491 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.634919  6145 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:11.718493  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.720456  1614 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:11.723343  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:11.677389  1617 rpcz_store.cc:276] 0709 13:02:08.234700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.425813 (+1191113us) service_pool.cc:224] Handling call
0709 13:02:09.443762 (+ 17949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.443953 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:09.570520 (+126567us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.736029 (+165509us) log.cc:844] Serialized 14 byte log entry
0709 13:02:10.724516 (+988487us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b180042c6a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:10.963581 (+239065us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b180042c6a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf 00007f7f1a8f4038
0709 13:02:10.963851 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.638333 (+674482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.638390 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:11.638429 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.638512 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:11.638648 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1388026,"prepare.queue_time_us":1413941,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":108,"raft.queue_time_us":234607,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":16287,"spinlock_wait_cycles":53635712,"thread_start_us":816245,"threads_started":3,"wal-append.queue_time_us":164881,"wal-append.run_cpu_time_us":1689,"wal-append.run_wall_time_us":1036152}
I20260709 13:02:11.570210  6155 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:02:11.634006  6413 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.735109  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.728006  1614 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:11.639791  6383 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:11.761284  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 83615.6us
I20260709 13:02:11.762391  1661 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:11.763655  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.769902  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:11.751763  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 329157us
I20260709 13:02:11.756824  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.776973  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.596454  6216 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.784401  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.680317  6354 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.672138  6004 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.615968  6338 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:11.745450  6476 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 1.578s	user 0.007s	sys 0.007s
I20260709 13:02:11.702687  6235 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.800616  1617 raft_consensus.cc:1240] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:11.801124  6545 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:11.802145  6456 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.794600  6411 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.803686  5982 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.702222  6534 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:11.837360  1617 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:11.808574  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.728343  6226 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.648991  6436 consensus_queue.cc:1059] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.121s
I20260709 13:02:11.649945  6313 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:11.818452  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48770.9us
I20260709 13:02:11.868543  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.814177  6221 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.804976  6231 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:11.850656  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.755478  6417 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:02:11.814581  6494 log.cc:927] Time spent T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:11.770658  6506 consensus_queue.cc:1048] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:02:11.786971  6500 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.876448  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:11.879887  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.876585  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.833388  6474 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:11.833818  6542 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.842651  6545 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:11.865833  6519 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:11.819470  6004 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.842072  6534 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.827576  6235 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.879485  6231 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:11.873579  5982 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.914283  1587 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.954469  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:11.914543  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 152294us
I20260709 13:02:11.956270  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:11.928285  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:11.910632  6568 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.945091  1617 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:11.960991  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:11.871846  6226 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:11.939953  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.001s	sys 0.009s
W20260709 13:02:11.968320  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.002s	sys 0.009s
I20260709 13:02:11.884773  6490 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:02:11.910382  6527 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.870378  6200 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:11.921347  6335 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:11.911525  6474 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:11.963706  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 180517us
I20260709 13:02:11.998632  1690 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:12.000542  1691 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:11.974727  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:11.931507  6354 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:12.004097  6354 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:12.004701  6354 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:11.961607  6231 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:11.945677  6367 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.946110  6417 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.983573  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:11.930438  6542 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:11.984207  6500 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:11.940284  6535 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.374s
I20260709 13:02:11.980394  6237 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:11.971858  6411 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:11.984866  6525 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:11.984745  6521 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:11.992019  6413 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.007973  6474 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:12.019549  5982 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.037434  6552 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:12.037940  6546 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:11.990969  6335 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:11.988194  6544 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:11.993014  6550 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.016379  6527 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:12.100227  6527 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:12.101605  6527 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.101969  6546 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:12.033926  6551 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:02:12.011103  6422 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.025076  6464 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:12.104146  6464 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:12.063535  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2145) took 1168 ms. Trace:
I20260709 13:02:12.107853  6374 raft_consensus.cc:3055] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:12.109061  6374 raft_consensus.cc:740] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:12.107084  1613 rpcz_store.cc:276] 0709 13:02:10.895161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.895274 (+   113us) service_pool.cc:224] Handling call
0709 13:02:10.895664 (+   390us) raft_consensus.cc:1471] Updating replica for 6 ops
0709 13:02:11.329624 (+433960us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:11.329669 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:11.330491 (+   822us) log.cc:844] Serialized 78 byte log entry
0709 13:02:11.556971 (+226480us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:11.557011 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.557156 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.063160 (+506004us) raft_consensus.cc:1685] finished
0709 13:02:12.063195 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.063451 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20224,"raft.queue_time_us":71795,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":506260,"threads_started":2,"wal-append.queue_time_us":420451}
I20260709 13:02:12.115660  6374 consensus_queue.cc:260] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:12.117223  6539 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 13:02:12.121223  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2576) took 1226 ms. Trace:
W20260709 13:02:12.122257  6555 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:02:12.121951  1696 rpcz_store.cc:276] 0709 13:02:10.894963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.896528 (+  1565us) service_pool.cc:224] Handling call
0709 13:02:10.955119 (+ 58591us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:10.955478 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:10.955509 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:10.956042 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 13:02:11.384806 (+428764us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:11.384845 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.384905 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.120760 (+735855us) raft_consensus.cc:1685] finished
0709 13:02:12.120791 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.121062 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1091,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":9600,"thread_start_us":386886,"threads_started":1,"wal-append.queue_time_us":563815}
I20260709 13:02:12.123811  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35468 (request call id 2251) took 1072 ms. Trace:
I20260709 13:02:12.090956  6552 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.023036  6500 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.126251  6500 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:12.065848  6565 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:02:12.122013  6542 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.056519  6413 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.105731  6464 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.132808  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2248) took 1122 ms. Trace:
W20260709 13:02:12.067719  6564 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:02:12.133353  1546 rpcz_store.cc:276] 0709 13:02:11.010309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.503964 (+493655us) service_pool.cc:224] Handling call
0709 13:02:11.545375 (+ 41411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:11.545725 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.545754 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:11.552043 (+  6289us) log.cc:844] Serialized 26 byte log entry
0709 13:02:11.829300 (+277257us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.829337 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.829399 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.132575 (+303176us) raft_consensus.cc:1685] finished
0709 13:02:12.132596 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.132746 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4085,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":2234,"thread_start_us":222603,"threads_started":1,"wal-append.queue_time_us":354311}
I20260709 13:02:12.133831  6464 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:12.069038  6559 log.cc:927] Time spent T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:12.068935  5630 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.124833  1541 rpcz_store.cc:276] 0709 13:02:11.051022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.390302 (+339280us) service_pool.cc:224] Handling call
0709 13:02:12.123344 (+733042us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b5400257954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.123670 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99762048}
I20260709 13:02:12.135507  6522 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.136339  6225 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:12.136641  6512 log.cc:927] Time spent T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 1.175s	user 0.004s	sys 0.004s
I20260709 13:02:12.136772  6225 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:12.038726  6523 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.141201  6529 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.137809  6225 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.143258  6225 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:12.137666  6374 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.055172  6545 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.149402  6216 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:12.077345  6549 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 13:02:12.079509  6226 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.079990  6004 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:12.082365  6536 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 13:02:11.981480  6568 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.020988  6417 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.091351  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2577) took 1196 ms. Trace:
I20260709 13:02:12.196700  1687 rpcz_store.cc:276] 0709 13:02:10.895271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.895740 (+   469us) service_pool.cc:224] Handling call
0709 13:02:10.896052 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.127432 (+231380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.127480 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.127550 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.127598 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.091027 (+963429us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400044cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.091097 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.091274 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531619072}
I20260709 13:02:12.198484  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.200176  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.200971  1687 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:12.201992  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.098726  6335 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:12.039661  6411 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:12.125420  6552 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:12.066780  6561 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:12.068169  6573 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.134303  6413 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.163661  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.165097  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.165762  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.165969  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.176714  6428 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.195366  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 241019us
W20260709 13:02:12.214028  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 239442us
I20260709 13:02:12.245414  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:12.179877  6469 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 1.146s	user 0.014s	sys 0.003s
I20260709 13:02:12.178984  6546 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.246695  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.248485  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.248631  1696 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:12.254729  1538 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:12.208158  6411 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:12.249362  1690 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:12.262259  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:12.209652  6313 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.265386  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:12.264421  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.273187  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:12.259215  6251 consensus_meta.cc:287] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.855s	user 0.012s	sys 0.000s
I20260709 13:02:12.271518  2266 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:12.278064  6235 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.279026  6216 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:12.269045  6558 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:12.287606  6231 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.323058  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.289414  6568 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.331475  1546 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:12.247361  6004 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.297647  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.298112  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:12.299539  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.334934  1619 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
W20260709 13:02:12.303589  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.336768  6231 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.338925  6568 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:02:12.344578  6556 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.503s	user 0.000s	sys 0.001s
I20260709 13:02:12.349712  6231 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.350291  6231 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.351712  6427 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:12.352128  6427 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:12.352412  6231 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.353297  6427 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.356704  6455 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.249866  5982 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.358683  5982 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.274946  6200 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:12.363049  6200 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:12.310947  1613 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:12.351953  6586 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:12.364230  6200 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.263165  6573 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.367399  6573 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:12.368032  6563 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:02:12.364847  6586 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.372859  1695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2578) took 1477 ms. Trace:
I20260709 13:02:12.315249  6522 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:12.375948  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:12.373370  1695 rpcz_store.cc:276] 0709 13:02:10.895525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.895643 (+   118us) service_pool.cc:224] Handling call
0709 13:02:10.896090 (+   447us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:11.450472 (+554382us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:11.503798 (+ 53326us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.817084 (+313286us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:11.817783 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 13:02:11.817958 (+   175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:11.818188 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:02:11.818323 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:11.818555 (+   232us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.372583 (+554028us) raft_consensus.cc:1685] finished
0709 13:02:12.372614 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.372784 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20624,"prepare.queue_time_us":34095,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":70783,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":45369,"spinlock_wait_cycles":25856,"thread_start_us":628444,"threads_started":2,"wal-append.queue_time_us":640674}
W20260709 13:02:12.377511  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 70190.3us
I20260709 13:02:12.382908  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.382930  1695 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:12.385592  6502 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:12.386415  6502 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:12.387501  6502 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.389122  6502 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.391378  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.395143  6417 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.371861  6004 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.405133  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.250402  6428 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.410245  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.362301  5982 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:12.415571  6532 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.683s	user 0.004s	sys 0.000s
I20260709 13:02:12.419677  6338 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.424718  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.318054  6251 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.435820  1692 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:12.436879  6251 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:12.437474  1692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 2012) took 1455 ms (client timeout 1900 ms). Trace:
W20260709 13:02:12.437865  1692 rpcz_store.cc:269] 0709 13:02:10.982282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.984302 (+  2020us) service_pool.cc:224] Handling call
0709 13:02:12.437284 (+1452982us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002ee5d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.437420 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3308061952}
I20260709 13:02:12.439129  6428 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.439731  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2580) took 1448 ms. Trace:
I20260709 13:02:12.440138  1694 rpcz_store.cc:276] 0709 13:02:10.991816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.996138 (+  4322us) service_pool.cc:224] Handling call
0709 13:02:12.439560 (+1443422us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54000b3bd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.439677 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165411072}
I20260709 13:02:12.441202  1689 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:12.425042  6524 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.370309  6586 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:12.442787  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58340us
I20260709 13:02:12.444356  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:12.448907  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.451596  1689 raft_consensus.cc:2410] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:12.454133  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.455566  1689 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 10.
I20260709 13:02:12.440943  6427 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:12.453483  6004 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.322566  6411 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.477161  6374 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:12.484076  6491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.070s	sys 0.092s
W20260709 13:02:12.490515  6491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.071s	sys 0.092s
I20260709 13:02:12.481963  6374 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:12.475795  6354 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.520147  6474 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.523284  6474 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.511456  6374 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:12.551304  6411 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:12.562520  6500 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.564751  6500 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.566093  6354 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:12.550168  6552 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.576920  6552 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:12.579887  6534 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.001s
I20260709 13:02:12.580477  6534 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:12.583878  6534 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:12.621479  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.623613  1546 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:12.625813  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.626950  1546 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:12.627276  1541 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:12.628288  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:12.632157  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2657) took 1622 ms (client timeout 2071 ms). Trace:
W20260709 13:02:12.633008  1538 rpcz_store.cc:269] 0709 13:02:11.009619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.107937 (+ 98318us) service_pool.cc:224] Handling call
0709 13:02:12.631645 (+1523708us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540038a254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.631918 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231279488}
I20260709 13:02:12.644254  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2652) took 1635 ms. Trace:
I20260709 13:02:12.645162  1542 rpcz_store.cc:276] 0709 13:02:11.008357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.441042 (+432685us) service_pool.cc:224] Handling call
0709 13:02:12.643615 (+1202573us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b5400208354. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.643967 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82300672}
W20260709 13:02:12.649036  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.649289  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.651005  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:12.651485  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2650) took 1643 ms (client timeout 1849 ms). Trace:
I20260709 13:02:12.651718  1541 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:02:12.651960  1539 rpcz_store.cc:269] 0709 13:02:11.007802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.066384 (+ 58582us) service_pool.cc:224] Handling call
0709 13:02:12.651030 (+1584646us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540003b954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:12.651270 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475606912}
I20260709 13:02:12.653270  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.653671  1618 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:12.693624  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.653544  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.654811  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2642) took 1658 ms. Trace:
W20260709 13:02:12.651737  1587 connection.cc:256] RPC call timeout handler was delayed by -1.218379208999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:02:12.660626  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 706) took 1365 ms. Trace:
I20260709 13:02:12.661368  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:12.664144  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.669621  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 205011us
I20260709 13:02:12.670181  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1891) took 1368 ms. Trace:
W20260709 13:02:12.670653  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.032s
I20260709 13:02:12.671626  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.671727  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:12.672617  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.673046  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.677157  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.679018  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.679544  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.679550  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:12.682325  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.683264  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.689695  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 882) took 1403 ms. Trace:
I20260709 13:02:12.692742  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:12.652709  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.697048  1688 rpcz_store.cc:276] 0709 13:02:11.286350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.286575 (+   225us) service_pool.cc:224] Handling call
0709 13:02:11.286875 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.403045 (+116170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.403091 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.403151 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.403197 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.689058 (+1285861us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001f5ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.689155 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.689423 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266648320}
I20260709 13:02:12.715404  1539 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:12.680058  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:12.727918  2263 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:12.731004  1622 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:12.731343  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.732424  2257 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:12.732885  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:12.733242  2265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 1081) took 1635 ms. Trace:
I20260709 13:02:12.734073  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.735354  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.694654  1544 rpcz_store.cc:276] 0709 13:02:10.996015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.999060 (+  3045us) service_pool.cc:224] Handling call
0709 13:02:10.999292 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.243821 (+244529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.243867 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.243925 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:11.243963 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.654180 (+1410217us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b540003af54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.654265 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.654582 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561864960}
W20260709 13:02:12.716394  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.011s	sys 0.032s
I20260709 13:02:12.734105  1622 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:12.739984  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.740648  1542 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:12.741384  1693 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:12.742564  1616 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:12.746011  1538 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:12.747408  6339 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:12.749078  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.750155  1619 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:12.748549  6339 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.740518  1546 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:12.695787  1621 rpcz_store.cc:276] 0709 13:02:11.301908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.449738 (+147830us) service_pool.cc:224] Handling call
0709 13:02:11.450054 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.516915 (+ 66861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.669506 (+1152591us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54002a76d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.669934 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89464192}
I20260709 13:02:12.733683  2265 rpcz_store.cc:276] 0709 13:02:11.097456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.097600 (+   144us) service_pool.cc:224] Handling call
0709 13:02:11.097923 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.294601 (+196678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.294657 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.294708 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:02:11.294758 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.732575 (+1437817us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54006aead4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.732659 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.733018 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451850496}
I20260709 13:02:12.694854  1543 rpcz_store.cc:276] 0709 13:02:11.294930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.610162 (+315232us) service_pool.cc:224] Handling call
0709 13:02:11.652868 (+ 42706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:11.769546 (+116678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:11.769588 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:11.769641 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:11.769693 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.659962 (+890269us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000532d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:12.660033 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.660376 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267786624}
I20260709 13:02:12.793064  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.794878  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.795312  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.796236  2258 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:12.806394  1695 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:12.800484  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:12.810077  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 117864us
W20260709 13:02:12.811570  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.813970  6383 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:12.808022  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.819504  1539 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:12.852463  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.826453  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 708) took 1530 ms. Trace:
I20260709 13:02:12.819044  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:12.869812  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.826926  6463 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.870301  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.814589  6383 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:12.823653  6221 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:12.827723  6464 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.882879  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:12.918437  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.920475  6474 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:02:12.926767  6549 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.000s	sys 0.031s
W20260709 13:02:12.927397  6549 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.031s
I20260709 13:02:12.929078  6552 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:12.912572  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.950897  1614 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:12.945098  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 82988.8us
W20260709 13:02:12.957386  1661 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.009s	sys 0.061s
W20260709 13:02:12.957878  1661 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.009s	sys 0.061s
I20260709 13:02:12.957741  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:12.958482  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 790634us
I20260709 13:02:12.868752  1547 rpcz_store.cc:276] 0709 13:02:11.295559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.075088 (+779529us) service_pool.cc:224] Handling call
0709 13:02:12.075422 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.075836 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:12.244139 (+168303us) log.cc:844] Serialized 14 byte log entry
0709 13:02:12.635598 (+391459us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.636937 (+  1339us) log.cc:844] Serialized 26 byte log entry
0709 13:02:12.637293 (+   356us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:12.637393 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:12.637571 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:12.826001 (+188430us) raft_consensus.cc:1685] finished
0709 13:02:12.826028 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:12.826232 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":181998,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":116560,"raft.run_cpu_time_us":486,"raft.run_wall_time_us":36520,"thread_start_us":547238,"threads_started":2,"wal-append.queue_time_us":280934}
W20260709 13:02:12.882449  6359 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.016s
I20260709 13:02:12.968050  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:12.827844  6016 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:12.911267  6383 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:12.963955  6359 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.011s	sys 0.017s
I20260709 13:02:12.957767  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:12.930107  6552 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.987062  2266 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:13.015733  1622 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:13.022337  6251 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.023087  6251 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:12.964238  6463 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.027380  6463 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:13.003046  6527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.025s
W20260709 13:02:13.054251  6527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.005s	sys 0.025s
I20260709 13:02:13.060079  6226 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:13.060343  6410 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:13.070010  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.070890  6583 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:13.070915  1613 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:13.074760  6359 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:13.075326  6359 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:13.075747  6457 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.076490  6457 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.076792  6359 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.078991  6520 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.079771  6520 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:13.027927  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 86160.4us
I20260709 13:02:13.028689  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.029701  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.031440  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.008317  6464 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.039381  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:13.040041  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.040374  6356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.005s	sys 0.019s
W20260709 13:02:13.040735  6478 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.016s
I20260709 13:02:13.044705  6339 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.045598  1617 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:13.049520  6502 consensus_meta.cc:287] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.660s	user 0.013s	sys 0.004s
W20260709 13:02:13.082509  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.086972  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 70271.8us
W20260709 13:02:13.131060  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.133563  6457 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:13.134708  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.136543  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:13.137369  6145 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.138435  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.138159  6145 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.139969  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.140456  6145 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.140789  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.141041  1622 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.141803  1544 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:13.136682  6464 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:13.142745  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:13.144003  6200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.020s	sys 0.037s
I20260709 13:02:13.144413  1544 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.139922  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:13.144485  6200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.037s
W20260709 13:02:13.115324  6478 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.010s	sys 0.016s
I20260709 13:02:12.965399  6221 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.120086  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.151019  6112 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:13.151399  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.151861  6112 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:13.153434  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 298089us
I20260709 13:02:13.157069  6502 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:13.157545  6502 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.157473  6016 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.160712  6016 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.168036  6251 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:13.173653  6216 consensus_meta.cc:287] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.849s	user 0.014s	sys 0.004s
I20260709 13:02:13.174207  6216 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:13.175122  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.175642  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:13.175868  1617 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:13.176798  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.176973  1616 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:13.177889  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.178413  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.179473  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.179919  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.180526  1621 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.181200  1618 raft_consensus.cc:2393] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:13.184417  6439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.040s
W20260709 13:02:13.184911  6439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.017s	sys 0.040s
I20260709 13:02:13.185827  6439 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:13.186270  6439 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:13.186728  6500 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.187502  6500 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.189916  6500 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:13.200094  6335 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.991s	user 0.013s	sys 0.007s
W20260709 13:02:13.200379  6427 consensus_meta.cc:287] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.721s	user 0.003s	sys 0.015s
I20260709 13:02:13.200660  6335 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.158068  6502 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.157111  6585 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.176798  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.215590  1539 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:13.202183  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 127904us
I20260709 13:02:13.220775  6359 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.222036  6585 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.201023  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:13.201726  1587 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.177s (SENT)
I20260709 13:02:13.239151  1622 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:13.202409  6463 raft_consensus.cc:2764] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:13.244475  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.251670  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:13.262823  6427 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.263882  6427 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.264812  6383 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.265543  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:13.269675  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
W20260709 13:02:13.270605  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 351114us
I20260709 13:02:13.259492  6251 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.244176  6145 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.273980  6457 consensus_queue.cc:1059] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:13.275875  6251 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.281625  6457 raft_consensus.cc:3055] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:13.282073  6457 raft_consensus.cc:740] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:13.283368  6251 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.283887  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.283430  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.266507  6427 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.291862  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.295652  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.295766  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.290012  1694 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:13.276017  6520 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.306998  6411 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:13.307638  6411 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.308032  6411 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.310397  6489 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:13.310961  6489 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.311379  6489 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.311800  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.314079  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.314951  1690 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:13.302109  6383 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.303309  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.304255  1689 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:13.341887  1688 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:13.345949  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.349668  6502 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.351776  1617 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:02:13.352365  2231 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:13.302553  6527 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:13.362771  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69049.2us
W20260709 13:02:13.363076  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 161397us
I20260709 13:02:13.366811  6492 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.366981  6465 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.367820  6456 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:13.367484  6439 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.393975  6439 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.369725  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.394881  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:13.395593  1688 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.395738  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:13.370427  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.294214  6585 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:13.386039  1587 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.785s (SENT)
I20260709 13:02:13.400260  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.379241  1539 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:13.384348  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.384588  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.385445  6221 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:13.385998  6552 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.386989  6335 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.387712  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:13.388583  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:13.389148  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 48580.3us
I20260709 13:02:13.384348  6520 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:13.391234  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:13.391325  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.391572  5982 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.392868  6359 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:13.375641  1621 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:13.402096  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:13.403108  1541 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:13.399181  1545 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:13.406173  1694 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:13.409035  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:13.413743  6552 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.386193  6492 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.420063  1511 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:13.418630  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.419704  1690 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:13.423002  1539 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:13.424021  1544 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:13.425750  6505 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.426605  6505 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.429483  6505 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.430796  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.433794  6457 consensus_queue.cc:260] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.434810  6413 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:13.436213  1689 raft_consensus.cc:2393] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:13.440291  6112 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.397256  6145 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.443662  6585 raft_consensus.cc:2764] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:13.438344  6221 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:13.441812  6413 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.460892  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 72488.1us
I20260709 13:02:13.459707  1692 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:13.453540  6552 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:13.467048  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 82630.9us
W20260709 13:02:13.467362  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 81356.6us
I20260709 13:02:13.476485  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:13.464673  6413 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.485121  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:13.467839  6520 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:13.474418  6552 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:13.491752  6374 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.955s	user 0.019s	sys 0.000s
I20260709 13:02:13.491868  6155 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:13.491825  6457 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.494252  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:13.498932  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.502252  1689 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:13.502342  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.503383  6112 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:13.503842  6112 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:13.503938  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.504452  6112 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.505843  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.496363  6155 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.503376  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:13.507206  6155 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:13.508723  1661 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:13.500845  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.511799  6251 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:13.512197  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:13.512449  6251 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.513022  6251 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.513286  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:13.514250  6200 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:13.514690  6200 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:13.515054  6200 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.510365  6427 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:13.515666  6427 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.515823  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:13.516080  6427 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.503736  6542 raft_consensus.cc:2764] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:02:13.481176  6527 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:13.524020  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 183094us
I20260709 13:02:13.525410  1688 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:13.489919  6520 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.497522  6552 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:13.546782  6463 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:13.548337  6492 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.483502  6500 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:02:13.525758  6585 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:13.551911  1619 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.031s
W20260709 13:02:13.559242  1619 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.018s	sys 0.031s
I20260709 13:02:13.506651  6374 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.563712  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:13.565281  6374 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.534159  6542 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.553107  6520 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:13.566946  6335 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.567644  6335 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.570145  6335 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:13.576442  1613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.024s	sys 0.028s
W20260709 13:02:13.577131  1613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.024s	sys 0.028s
W20260709 13:02:13.576930  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89550.6us
I20260709 13:02:13.579850  2266 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:13.606389  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70085.8us
I20260709 13:02:13.559234  6502 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.603202  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:13.626827  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.650197  2258 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:13.651523  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:13.656227  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 150533us
I20260709 13:02:13.653107  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:13.665283  6608 log.cc:927] Time spent T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.387s	user 0.000s	sys 0.004s
I20260709 13:02:13.637542  6534 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:13.668568  6534 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:13.668998  6534 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:13.668020  6356 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.606030  6112 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.676594  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.674767  2265 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:13.581348  6527 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:13.684654  6580 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.021s	sys 0.029s
W20260709 13:02:13.688324  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.689677  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.691876  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.628587  6411 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.690977  1511 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:13.693713  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.649509  6145 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.711541  1616 raft_consensus.cc:2410] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:02:13.690676  6580 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.022s	sys 0.029s
W20260709 13:02:13.710949  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 574520us
I20260709 13:02:13.719940  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.654779  6200 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.724805  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.727800  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:13.718245  6502 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:13.735666  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.718236  6221 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:13.735613  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:13.731380  6505 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:13.756268  1616 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:13.761436  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:13.756745  1620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.021s	sys 0.041s
W20260709 13:02:13.763038  1620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.021s	sys 0.042s
W20260709 13:02:13.764715  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.766104  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.766949  1622 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:13.711529  6356 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.774147  2266 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:13.772799  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.741467  6221 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:13.759096  6216 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:13.757601  6527 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.774147  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2664) took 1147 ms. Trace:
I20260709 13:02:13.779925  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:13.777271  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.743139  6502 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:13.789175  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 101365us
I20260709 13:02:13.775346  6520 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.794126  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.794744  6200 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:13.795428  6594 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.019s	sys 0.028s
I20260709 13:02:13.780260  6221 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:13.770151  6155 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.795516  6585 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.785673  6457 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:13.798457  6594 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.019s	sys 0.028s
I20260709 13:02:13.783149  1542 rpcz_store.cc:276] 0709 13:02:12.629016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.741631 (+112615us) service_pool.cc:224] Handling call
0709 13:02:12.742207 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.791676 (+ 49469us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:13.150712 (+359036us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.773691 (+622979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:13.773766 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:13.773834 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.773924 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.774077 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15775,"prepare.queue_time_us":67516,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":30353,"thread_start_us":788465,"threads_started":2}
I20260709 13:02:13.792373  6527 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:02:13.853555  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:13.863726  2266 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:13.820225  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2266) took 1474 ms. Trace:
I20260709 13:02:13.824010  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:13.850229  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 340439us
I20260709 13:02:13.795905  6520 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.822230  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:13.863538  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 292943us
W20260709 13:02:13.774791  6478 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.011s	sys 0.034s
I20260709 13:02:13.796017  6216 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:13.844203  6112 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.873327  6505 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:13.874897  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:13.871312  6618 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:02:13.840191  6411 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.864940  1540 rpcz_store.cc:276] 0709 13:02:12.250981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.691728 (+440747us) service_pool.cc:224] Handling call
0709 13:02:12.692359 (+   631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.693220 (+   861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.693256 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:12.693912 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.101240 (+407328us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:13.144282 (+ 43042us) log.cc:844] Serialized 14 byte log entry
0709 13:02:13.195179 (+ 50897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.195288 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.664468 (+469180us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:13.718167 (+ 53699us) raft_consensus.cc:1685] finished
0709 13:02:13.724754 (+  6587us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:13.724931 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50549,"prepare.queue_time_us":42890,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":184823,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":315,"spinlock_wait_cycles":5191936,"thread_start_us":404501,"threads_started":1,"wal-append.queue_time_us":572705}
I20260709 13:02:13.824891  6463 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.857658  6620 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:13.886335  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.889436  1544 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:13.824877  6585 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.888221  6463 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.906312  6463 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:13.896687  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76820.1us
I20260709 13:02:13.908353  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.909133  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.900964  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:13.910259  1546 raft_consensus.cc:2376] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13. Re-sending same reply.
I20260709 13:02:13.901413  6155 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.896497  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:13.902719  6457 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.913599  6457 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:13.808104  6489 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.914260  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.914346  6155 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:13.916153  6611 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260709 13:02:13.896497  6216 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.853385  6502 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.916960  1660 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:13.922576  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:13.949626  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:13.922855  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:13.952353  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:13.953162  1539 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:13.897957  6427 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:13.957052  2266 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:13.876528  6356 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:13.952399  1615 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:14.005982  2257 raft_consensus.cc:2393] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:14.006006  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:13.922371  6463 raft_consensus.cc:2764] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:13.884598  6520 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:14.010404  1545 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:14.020989  6520 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:13.930608  6251 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:14.029839  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 113004us
I20260709 13:02:14.031039  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.038146  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.036685  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:14.040935  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.034904  1540 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:13.952334  6552 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.052773  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:14.053058  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.053913  1615 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:14.057085  6627 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:14.011173  6620 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.066762  1546 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:14.065516  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.072682  1539 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.085712  1661 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:14.088500  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.052526  6585 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.090752  1510 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:14.093961  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.095527  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:14.093824  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 335889us
I20260709 13:02:14.098546  6251 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.098368  6625 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:14.099999  1659 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:14.104144  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.065908  6627 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.107278  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.090036  6200 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:14.109959  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.115490  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.110020  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2665) took 1480 ms. Trace:
I20260709 13:02:14.101178  6625 raft_consensus.cc:2804] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:14.105687  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 936) took 1806 ms. Trace:
I20260709 13:02:14.060420  6534 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.105644  6112 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:14.105026  6463 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.131876  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:14.139434  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.140225  1617 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.142686  6626 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:14.156425  6413 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.004s
I20260709 13:02:14.157266  1545 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.156980  6413 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.110638  6585 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:14.136263  1543 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:14.158946  6585 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:14.160200  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.159907  6585 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.160537  1543 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:14.160815  1542 raft_consensus.cc:2468] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:14.161917  1543 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:02:14.116514  1538 rpcz_store.cc:276] 0709 13:02:12.629524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.746892 (+117368us) service_pool.cc:224] Handling call
0709 13:02:12.747483 (+   591us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:12.927333 (+179850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.927378 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:12.928258 (+   880us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.243187 (+314929us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:13.243249 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.243347 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:13.915382 (+672035us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:14.104601 (+189219us) raft_consensus.cc:1685] finished
0709 13:02:14.104627 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.109952 (+  5325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178912,"raft.queue_time_us":180885,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"spinlock_wait_cycles":227671936,"thread_start_us":312893,"threads_started":1,"wal-append.queue_time_us":696745}
I20260709 13:02:14.162997  1687 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:02:14.163285  1538 raft_consensus.cc:1275] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:14.163625  6520 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.165416  6427 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.134459  6251 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:14.166725  6463 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.167312  6463 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.173849  6552 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.173924  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.174252  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:14.174850  2265 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:14.176138  6534 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:14.176749  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 142015us
I20260709 13:02:14.176975  6534 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.177595  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.177673  6534 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.180660  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.182144  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2670) took 1040 ms. Trace:
I20260709 13:02:14.185705  2257 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:14.192386  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:14.110826  6627 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:14.196054  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.196815  2266 raft_consensus.cc:2368] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:14.190830  1547 rpcz_store.cc:276] 0709 13:02:13.141290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.275051 (+133761us) service_pool.cc:224] Handling call
0709 13:02:13.301394 (+ 26343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.392357 (+ 90963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.392400 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.393020 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.804535 (+411515us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:13.804591 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.804671 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.181960 (+377289us) raft_consensus.cc:1685] finished
0709 13:02:14.181980 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.182092 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1226,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":411027,"threads_started":1,"wal-append.queue_time_us":618309}
I20260709 13:02:14.193078  2257 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.194851  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.194936  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:14.199604  2262 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:14.204838  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.205720  1615 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.109710  6200 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.114116  6457 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260709 13:02:14.198417  6251 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:14.234581  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.190577  6625 raft_consensus.cc:697] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:14.241398  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:14.243896  2265 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:14.246457  1539 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:14.201671  6628 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:14.222666  6112 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:14.234916  5982 consensus_meta.cc:287] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.813s	user 0.015s	sys 0.000s
I20260709 13:02:14.223845  6489 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.232887  6626 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:14.266747  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 89235.2us
I20260709 13:02:14.270723  6112 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.274356  6457 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.275171  6457 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.277073  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:14.277673  1690 raft_consensus.cc:3060] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.278591  2257 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:14.280063  6580 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:14.280586  6630 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:14.281257  6632 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:14.253487  6628 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.136430  1620 rpcz_store.cc:276] 0709 13:02:12.299038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.315277 (+ 16239us) service_pool.cc:224] Handling call
0709 13:02:12.315743 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:12.316269 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.316310 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:12.335725 (+ 19415us) log.cc:844] Serialized 52 byte log entry
0709 13:02:12.904690 (+568965us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:13.763524 (+858834us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.087762 (+324238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.092745 (+  4983us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.092810 (+    65us) raft_consensus.cc:1685] finished
0709 13:02:14.092827 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.105618 (+ 12791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65575,"prepare.queue_time_us":819544,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":36956,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":179,"thread_start_us":1531492,"threads_started":3,"wal-append.queue_time_us":649318}
I20260709 13:02:14.303987  6628 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:14.281847  6632 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.306674  6632 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.306898  1690 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:14.311251  6625 consensus_queue.cc:237] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.259606  6500 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:14.259135  5982 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:14.326959  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 59229.6us
W20260709 13:02:14.328349  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 106743us
I20260709 13:02:14.329056  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.257642  6505 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:14.335177  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.335903  1620 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:14.342870  1541 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:14.320909  6413 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.344939  6505 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.354797  6505 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.356673  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:14.357542  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.344729  1617 raft_consensus.cc:2468] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:14.358584  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:14.362984  6629 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:02:14.323586  6500 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:14.412109  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 84381.6us
W20260709 13:02:14.418711  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 281746us
I20260709 13:02:14.419862  2257 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.350329  6628 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.349304  6200 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:14.420077  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 323161us
I20260709 13:02:14.427798  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.377404  6505 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.445322  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:14.416034  6500 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:14.446872  5982 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:02:14.463129  1615 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:14.468001  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.486181  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:14.488451  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.444881  6505 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:14.459575  6383 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.460531  6620 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.493266  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.498288  1543 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
W20260709 13:02:14.494115  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48927.3us
I20260709 13:02:14.495425  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 945) took 1324 ms. Trace:
W20260709 13:02:14.491901  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 256939us
W20260709 13:02:14.503311  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 75644.9us
I20260709 13:02:14.485571  6534 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.506635  1547 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:14.488317  6552 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:14.490161  6542 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.493525  6505 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.509239  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.512341  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.502043  1614 rpcz_store.cc:276] 0709 13:02:13.171372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.233919 (+ 62547us) service_pool.cc:224] Handling call
0709 13:02:13.258422 (+ 24503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.359036 (+100614us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:13.805325 (+446289us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.494671 (+689346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.494725 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:14.495218 (+   493us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.495283 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.495378 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5571,"prepare.queue_time_us":401064,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":3054,"raft.queue_time_us":74317,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":1076610,"threads_started":3,"wal-append.queue_time_us":531114}
I20260709 13:02:14.488008  6580 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:02:14.514724  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.421800  6251 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.520256  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.521019  1538 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:14.520895  6580 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.518306  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.523510  1543 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.525589  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.526422  1539 raft_consensus.cc:2376] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13. Re-sending same reply.
I20260709 13:02:14.530364  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.509384  6552 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:14.538075  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 209082us
I20260709 13:02:14.539975  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.540372  1661 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:14.541685  6637 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:14.541579  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.542717  1619 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:14.551369  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.554050  1542 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.556743  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.557927  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.561123  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:14.564960  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51264.5us
I20260709 13:02:14.569479  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.570398  1615 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:14.573302  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:14.574319  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.543687  6383 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:14.574915  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.577390  1616 raft_consensus.cc:3060] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.540002  6628 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.517848  6542 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.579216  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.579988  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.581043  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.564687  6585 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:14.595624  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 338536us
I20260709 13:02:14.600106  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:14.617012  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.618067  1615 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:14.624835  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:14.620609  1547 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:14.596325  6625 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:14.586462  6427 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:14.634218  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.638980  1619 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:14.634370  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:14.631836  6356 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.642726  6413 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.648075  1621 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:14.593955  6637 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:14.646605  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 107383us
I20260709 13:02:14.632102  6427 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:14.652755  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 73628.7us
I20260709 13:02:14.631640  6251 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:14.655102  2257 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:14.653544  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:14.653837  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.661334  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.593616  6585 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:14.664774  1688 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.667407  6637 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.671000  6627 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.672813  1543 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:14.673331  6627 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.613099  6552 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.677006  6552 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:14.677551  6463 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:02:14.677980  6463 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:14.680657  6221 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.001s
I20260709 13:02:14.683586  6542 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.664531  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:14.643610  6383 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:14.696513  6383 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.697849  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:14.698896  6439 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:14.699115  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.700063  1689 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:14.700646  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:14.701061  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.702122  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.648203  6356 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.702822  6356 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:14.703331  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.704151  1687 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:14.689488  6502 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:14.704902  6502 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.705353  1687 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:14.707065  6502 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.653190  6625 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.684207  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 910) took 1167 ms. Trace:
I20260709 13:02:14.709599  6625 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.708711  1693 rpcz_store.cc:276] 0709 13:02:13.516324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.518366 (+  2042us) service_pool.cc:224] Handling call
0709 13:02:13.518906 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:13.849964 (+331058us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:02:14.252074 (+402110us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.557111 (+305037us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.573602 (+ 16491us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.573789 (+   187us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:14.573834 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.573925 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.683987 (+110062us) raft_consensus.cc:1685] finished
0709 13:02:14.684009 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.684149 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24390,"prepare.queue_time_us":511733,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":404086,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":4541,"thread_start_us":874224,"threads_started":3,"wal-append.queue_time_us":348114}
I20260709 13:02:14.713554  1696 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:14.714104  6649 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:02:14.714716  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.715142  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.653066  6226 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:14.719010  1619 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.652973  6427 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:14.692368  5982 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:14.733810  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1919) took 1021 ms. Trace:
I20260709 13:02:14.693725  1691 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:14.666070  6251 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.699190  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.715905  1545 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:14.717208  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:14.717917  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 67119.4us
I20260709 13:02:14.741034  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:14.718040  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56787.5us
I20260709 13:02:14.741328  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:14.741873  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.743165  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.691354  1616 raft_consensus.cc:2468] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:14.685755  6641 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.732493  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 944) took 1561 ms. Trace:
I20260709 13:02:14.743391  1660 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:14.727033  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 72107us
I20260709 13:02:14.747219  2230 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:14.765376  1660 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.738095  1622 rpcz_store.cc:276] 0709 13:02:13.712568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.767754 (+ 55186us) service_pool.cc:224] Handling call
0709 13:02:13.768185 (+   431us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:14.051557 (+283372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.051604 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:14.095882 (+ 44278us) log.cc:844] Serialized 78 byte log entry
0709 13:02:14.446482 (+350600us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:14.496839 (+ 50357us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.500262 (+  3423us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.500522 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.500623 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.700755 (+200132us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180047ad60. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177bb2a6 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1
0709 13:02:14.701701 (+   946us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b180047ad60. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:14.733579 (+ 31878us) raft_consensus.cc:1685] finished
0709 13:02:14.733599 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.733750 (+   151us) inbound_call.cc:177] Queueing success response
0709 13:02:14.734416 (+   666us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b180047ad60. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1e7ae58f 00007f7f177ed571 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd
Metrics: {"mutex_wait_us":237085,"prepare.queue_time_us":75710,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2622,"raft.queue_time_us":30496,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":12114,"spinlock_wait_cycles":35850496,"thread_start_us":512926,"threads_started":2,"wal-append.queue_time_us":377050}
I20260709 13:02:14.689702  6585 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.768821  1689 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:02:14.760382  6647 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:14.718909  6226 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.769641  6112 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:14.737828  6411 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.787103  1615 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:14.744392  6520 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:14.745460  1618 rpcz_store.cc:276] 0709 13:02:13.171079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.182903 (+ 11824us) service_pool.cc:224] Handling call
0709 13:02:13.183188 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:13.183719 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:13.183750 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:13.184462 (+   712us) log.cc:844] Serialized 52 byte log entry
0709 13:02:13.655063 (+470601us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:14.068467 (+413404us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.068855 (+   388us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.089751 (+ 20896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.089833 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.729706 (+639873us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800468940. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:14.732257 (+  2551us) raft_consensus.cc:1685] finished
0709 13:02:14.732278 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.732428 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150736,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":431716,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":48929,"spinlock_wait_cycles":39045888,"thread_start_us":828077,"threads_started":2,"wal-append.queue_time_us":623852}
I20260709 13:02:14.760900  6641 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.767673  6620 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:14.770761  6625 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:14.716979  6221 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.770633  6627 raft_consensus.cc:2764] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:02:14.817763  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 82278.6us
I20260709 13:02:14.773581  6542 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:14.827317  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 86317.7us
I20260709 13:02:14.829007  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.790753  6226 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:14.819800  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49787us
I20260709 13:02:14.787638  1587 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.833360  6580 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.820990  6520 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.802263  6620 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:14.853644  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 110538us
I20260709 13:02:14.831578  1585 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.856814  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:14.871435  1540 raft_consensus.cc:2376] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14. Re-sending same reply.
I20260709 13:02:14.791064  6500 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.812929  6625 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:14.791646  6411 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:14.770200  6145 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:02:14.802040  6641 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:14.868711  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 87626.5us
I20260709 13:02:14.851352  6492 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:02:14.858075  6439 raft_consensus.cc:2804] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:14.869451  6645 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:14.870509  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:14.854492  1613 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:14.843777  6221 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.839485  6505 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:14.884497  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55733.6us
I20260709 13:02:14.876287  6620 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.871348  6552 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:14.887288  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.866086  6648 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:14.892010  6505 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:14.879402  6625 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:14.879202  6411 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.900489  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.900884  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.901211  1690 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:14.901877  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:14.904119  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 138862us
I20260709 13:02:14.904958  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.904861  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.906283  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.907187  1690 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
W20260709 13:02:14.908802  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 77412.1us
I20260709 13:02:14.910295  1585 leader_election.cc:400] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:14.910568  1585 leader_election.cc:403] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:14.910851  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.913689  6427 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.915679  6356 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.917416  1695 raft_consensus.cc:2393] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 17: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:14.917958  6356 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.922952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.922669  6620 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.923054  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.923867  1687 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:14.924158  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:14.925962  1587 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.910579  1696 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:14.908303  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:14.888245  6520 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:14.932031  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.939254  6251 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.889101  6216 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:14.882229  6580 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.940768  6667 consensus_queue.cc:1059] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:14.946128  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:14.925706  6620 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:14.945873  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49005.9us
I20260709 13:02:14.951160  6628 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:14.952366  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44064.2us
I20260709 13:02:14.926455  6505 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:14.958446  6552 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:14.951751  6646 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:14.931042  6645 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:14.890316  6648 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:14.971061  6427 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:14.971714  6648 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:14.971751  6644 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.972793  6520 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:14.973785  6520 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.977766  6427 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:14.979403  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.981992  6251 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:14.982782  6251 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:14.983422  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57571.2us
I20260709 13:02:14.984174  6251 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:14.984304  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:14.984935  6251 consensus_queue.cc:1243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:14.985666  6669 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:14.986094  6669 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:14.986925  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.987293  6669 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.988492  6669 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:14.991432  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:14.992223  6112 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:14.992681  6112 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:14.993521  6112 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:14.986193  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:14.998960  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.000304  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:15.003513  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.006880  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.010958  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.012288  1547 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:15.013788  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:14.966528  6505 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.017304  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.019621  1547 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.019555  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.020717  1616 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.026309  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.026989  1615 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.027530  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.028548  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.029095  1540 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.029842  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:14.994858  6411 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.033803  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.034358  1543 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:15.035624  1542 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.036582  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.038343  1545 raft_consensus.cc:1240] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:15.005708  6633 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:15.032944  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 2.146s (SENT) [suppressed 11 similar messages]
I20260709 13:02:15.037644  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.044314  1541 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:15.048702  1622 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:15.050567  6637 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:15.051291  6637 consensus_queue.cc:1243] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:15.054081  1622 pending_rounds.cc:85] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:15.054384  1622 pending_rounds.cc:107] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:02:15.054694  1622 raft_consensus.cc:2889] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.022940  6505 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.064982  6411 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.066170  6226 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.013936  6646 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.064615  6585 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.019134  6580 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.072810  1547 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:15.073400  1616 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:15.074190  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.032058  6542 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:15.080962  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 4 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.033248  6439 raft_consensus.cc:697] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.085354  1615 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
W20260709 13:02:15.086628  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 87226.9us
I20260709 13:02:15.088155  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:15.097857  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.100281  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.102452  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:15.061964  6641 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.083938  6216 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.071225  6427 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:02:15.103021  6502 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:15.103204  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.084801  6542 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.124157  1660 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:15.124884  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 91970.6us
I20260709 13:02:15.099692  6411 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.093868  6580 raft_consensus.cc:2764] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:15.133555  6655 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.133939  6674 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.134120  6457 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.138027  5982 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:15.172653  5982 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.172473  6674 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.131220  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:15.148461  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.125501  6520 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.103542  6620 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:15.130194  1538 raft_consensus.cc:3060] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.167749  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.129875  6502 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.143744  1660 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:15.173905  1688 raft_consensus.cc:1240] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.174049  1547 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:15.174355  2262 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:15.173053  5982 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.183307  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.145237  6542 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.185863  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.141963  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.134160  6681 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.170702  6383 raft_consensus.cc:2804] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:15.170243  6675 raft_consensus.cc:3055] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:15.194424  6625 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.194972  6675 raft_consensus.cc:740] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.196696  6641 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.167824  6500 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.197907  6226 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.198743  6383 raft_consensus.cc:697] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.199846  6383 consensus_queue.cc:237] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.200496  6625 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.201287  6585 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.185173  6520 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.202562  6655 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:15.204061  6520 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.204706  6627 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:15.205044  1540 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:15.205233  6627 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.205961  6683 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:15.206306  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.206487  6683 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.207464  6585 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.184394  6145 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:15.208827  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:15.209132  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.208974  6145 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.190121  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.209570  6585 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.209961  6585 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.208604  6683 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.192895  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.175220  6439 consensus_queue.cc:237] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.211392  1511 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:15.180290  6216 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.214994  6500 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:15.214888  6620 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.215688  6500 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:15.216928  6643 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.675s	user 0.006s	sys 0.000s
I20260709 13:02:15.217741  6620 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.218968  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42608 (request call id 1103) took 1117 ms. Trace:
I20260709 13:02:15.219374  2260 rpcz_store.cc:276] 0709 13:02:14.101919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.102732 (+   813us) service_pool.cc:224] Handling call
0709 13:02:14.124471 (+ 21739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.178880 (+ 54409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.178928 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.190961 (+ 12033us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.523513 (+332552us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:14.523555 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.523617 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.216094 (+692477us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:15.218666 (+  2572us) raft_consensus.cc:1685] finished
0709 13:02:15.218691 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.218904 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4251,"raft.queue_time_us":46280,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":36023168,"thread_start_us":289023,"threads_started":1,"wal-append.queue_time_us":340396}
I20260709 13:02:15.222258  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.224011  6620 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:15.224296  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.225070  6625 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:15.225461  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:15.194240  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66231.5us
I20260709 13:02:15.225494  6625 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.226349  6625 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.226526  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.228893  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:15.231438  6681 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.190819  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.234404  2261 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 17: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:15.168555  6411 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.210265  6585 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.238600  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.239774  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.241958  1538 raft_consensus.cc:2468] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:15.243188  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.233687  6681 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.244753  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.248116  1547 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:15.181763  6502 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.251816  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.257087  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.286475  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.286753  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.288424  1694 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 11: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:15.288426  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.292177  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.291267  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.198174  6505 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.293919  1696 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:15.293525  1687 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
W20260709 13:02:15.295385  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66584.8us
I20260709 13:02:15.233824  6463 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:15.296159  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 193761us
I20260709 13:02:15.301199  1512 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.303020  1689 raft_consensus.cc:1240] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:02:15.254590  6646 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:15.304641  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.305737  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:15.290194  6669 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:15.311021  6411 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.312531  6626 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.314980  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:15.316078  6626 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:15.316679  6626 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:15.317145  6674 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.317219  6626 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.324841  6505 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.206308  6627 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.326432  6627 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.330950  6644 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.297098  6620 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.331591  6644 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.332132  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:15.333843  6644 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.334084  6648 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.334792  6632 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:15.338848  6463 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:15.339242  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.344157  1618 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.344400  1541 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:15.345625  1691 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.342052  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.338893  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.347643  1615 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.292626  6580 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:15.354115  1540 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:02:15.210144  6145 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.355334  1547 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:15.360091  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.362360  1621 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:15.291488  6413 consensus_queue.cc:1059] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:02:15.368762  1620 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:02:15.366736  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65602.1us
I20260709 13:02:15.334463  6644 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.363723  6226 consensus_queue.cc:1059] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:02:15.383047  6688 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:15.383941  6411 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:15.384830  6411 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.387449  6411 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.388701  6542 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.369201  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.391038  1538 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:15.305267  6216 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:15.306190  6520 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:15.393000  6520 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.393046  6200 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:15.394248  6520 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.395284  6648 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:15.396694  6648 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:15.397053  6648 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:15.375311  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.309372  6669 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:15.378826  6683 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:15.378742  5982 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.379913  6633 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.381963  6463 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.421554  5982 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.421545  6463 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.424914  6463 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.424916  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.426066  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.306802  6646 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.426761  6646 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.427975  1544 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:15.429270  1544 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.430696  1544 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:15.368446  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.431644  1613 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.431830  1622 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:15.432736  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.404584  1615 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:15.407734  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:15.401005  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 109815us
I20260709 13:02:15.435020  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.435758  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.407704  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:15.411003  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.412211  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.436834  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.425772  6626 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.384140  6226 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:15.432822  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.436064  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.426895  1545 raft_consensus.cc:2393] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 18: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:15.418426  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.459990  1539 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:15.416973  6542 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.407470  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.216926  6500 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:15.438781  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.439437  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.440524  1619 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:15.446447  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.434531  1613 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:15.447405  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.449414  1660 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.450330  1661 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:15.359077  6676 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:02:15.466399  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.408455  6645 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.466922  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.465351  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.408371  6669 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.482795  1622 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:15.466399  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.478133  1687 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:15.483870  1617 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:15.505650  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.470690  6644 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:15.484961  6645 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:15.462932  6685 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:15.510721  6645 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.462427  6683 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.511977  6645 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.513150  6683 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.514415  6646 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.516588  6646 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.470906  6641 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:15.517827  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:15.457818  6226 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.405287  6580 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.519348  6226 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.520601  6226 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.520926  6580 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.463286  6632 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.397895  6648 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.523548  6648 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.524612  6633 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.526942  6696 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.462774  6359 raft_consensus.cc:3055] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.527992  6359 raft_consensus.cc:740] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.528530  6696 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:15.529019  6696 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:15.528928  6359 consensus_queue.cc:260] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.437574  6625 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.468461  5982 consensus_queue.cc:1059] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:02:15.478438  6251 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:02:15.490056  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.440099  6655 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.502537  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.548115  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.559827  1614 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.394248  6200 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:15.547526  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.565549  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:15.504586  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.527354  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.566502  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.557387  1694 raft_consensus.cc:2393] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:15.483978  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.555586  1618 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:15.531309  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.569283  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.547535  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:15.570235  1617 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:15.549355  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.556088  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.557231  1622 raft_consensus.cc:1240] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:15.552326  1619 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:15.531617  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.572126  1539 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:15.558185  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92919.8us
I20260709 13:02:15.535864  1692 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:15.541810  1542 consensus_meta.cc:287] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.000s
I20260709 13:02:15.573235  1542 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:15.491016  1621 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:15.562841  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:15.532060  6682 log.cc:927] Time spent T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:15.578860  1693 raft_consensus.cc:2393] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:15.582638  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.587627  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.586161  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.587423  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.576499  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:15.530598  6359 raft_consensus.cc:3060] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.590852  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.580410  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.536216  6664 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.554159  6427 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:15.591578  2266 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:15.537312  6690 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:15.561928  6542 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:15.593989  1696 raft_consensus.cc:2393] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:15.540218  6683 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.611150  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:15.601415  1690 raft_consensus.cc:2393] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:15.537295  6625 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.593220  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.605597  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.575204  6580 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.606348  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.535379  6413 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:02:15.535302  6676 consensus_queue.cc:1048] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:02:15.579867  6688 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.622340  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.627522  1688 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:15.617110  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 169806us
I20260709 13:02:15.630128  1539 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:15.587401  6356 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:15.531569  6672 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:02:15.637553  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:15.637732  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.530187  6696 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.4, Last appended by leader: 4, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.652034  6696 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:15.643126  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.655758  2261 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:15.601442  6690 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.656024  1542 raft_consensus.cc:2376] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16. Re-sending same reply.
I20260709 13:02:15.596068  6664 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.643615  1693 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:15.648772  6644 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:15.587510  6585 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.610598  6683 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.664722  1696 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:15.667085  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.673379  1541 raft_consensus.cc:2393] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 15: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:15.631127  6626 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.668589  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:15.644529  6671 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:15.672421  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.669260  1545 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:15.681380  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:15.657179  6674 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:15.684587  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:15.655448  6489 consensus_queue.cc:1059] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:02:15.664886  6356 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.685443  1539 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 16: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:15.685565  1545 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:15.667869  6690 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.635399  6580 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.690546  2261 raft_consensus.cc:1275] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:15.691589  6675 consensus_queue.cc:260] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.692780  6411 raft_consensus.cc:3055] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:15.699791  6634 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:15.700416  6664 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:15.701813  6698 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:15.703342  6585 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:15.676173  6683 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.708609  1614 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:15.688640  6674 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.709219  6671 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.719954  6489 raft_consensus.cc:3055] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:15.737249  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.723806  6675 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:15.738881  1688 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:15.733402  1545 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:15.709971  6632 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:15.756301  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.760401  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.761605  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:15.733994  6411 raft_consensus.cc:740] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.734920  6634 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.765013  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.765704  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:15.767742  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:15.772245  1620 raft_consensus.cc:1240] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:15.749015  6489 raft_consensus.cc:740] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:15.786983  6703 raft_consensus.cc:2764] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:15.787326  6411 consensus_queue.cc:260] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.788746  6411 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:15.735316  6502 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.765540  6646 raft_consensus.cc:2764] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:02:15.767707  6644 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:15.770987  6634 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:15.796990  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 129781us
I20260709 13:02:15.766909  6645 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.804430  1540 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:02:15.793781  6632 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:15.812248  6701 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:02:15.815816  6637 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.816319  6637 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:15.817334  6637 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.817639  6489 consensus_queue.cc:260] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.819455  6489 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:15.821525  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.822240  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.823400  1661 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:15.825191  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.818372  6637 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.830914  1619 raft_consensus.cc:2393] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:15.831478  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:15.857141  6702 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.858323  6688 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:15.858145  6671 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.863555  6580 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.869431  6685 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.869916  6655 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.870595  6552 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:15.870664  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 284598us
I20260709 13:02:15.922585  6683 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:15.872644  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 51665.2us
I20260709 13:02:15.946903  2260 raft_consensus.cc:2368] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16.
I20260709 13:02:15.947031  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:15.873245  5982 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:15.805603  6664 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:15.795712  6356 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.874284  6646 raft_consensus.cc:2764] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:02:15.824915  6644 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:15.850481  6626 raft_consensus.cc:2804] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:15.875240  6585 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.952672  6585 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.952805  6644 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.953540  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.870499  6542 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:15.954173  1620 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:15.808038  6632 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:15.954818  6632 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.882191  6502 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.882795  6690 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.955876  1544 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:15.890018  6463 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:15.895120  1618 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:02:15.903880  6221 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:15.895170  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:15.906052  6669 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.916746  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 915) took 1664 ms. Trace:
W20260709 13:02:15.917029  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 85641.7us
W20260709 13:02:15.921888  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.929488  1687 raft_consensus.cc:1240] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:15.797587  6674 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:15.956451  1618 pending_rounds.cc:85] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
W20260709 13:02:15.956405  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.986304  1618 pending_rounds.cc:107] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:02:15.987583  1511 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.989619  1618 raft_consensus.cc:2889] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:15.988317  1613 raft_consensus.cc:2393] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:15.990131  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:15.990840  1695 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:15.965658  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.988555  1692 rpcz_store.cc:276] 0709 13:02:14.252572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.258791 (+  6219us) service_pool.cc:224] Handling call
0709 13:02:15.231109 (+972318us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800181b98. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8b3fc0 00007f7f1f89e929 00007f7f1f89e3d2 00007f7f18e15bd4
0709 13:02:15.231321 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:15.572956 (+341635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.916487 (+343531us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54004547d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:15.916673 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":736757888}
I20260709 13:02:15.985101  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:15.997018  5982 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:15.997515  5982 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.997874  5982 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:15.998054  6690 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.002806  1690 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:16.005927  1695 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:15.870877  6500 raft_consensus.cc:3055] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:15.985368  6221 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:15.954283  6542 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:15.991767  6155 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.944597  6703 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:02:16.013516  6542 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.014014  6502 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:16.025297  6643 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:16.063576  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:16.014881  6585 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.015827  6200 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:16.020087  6648 consensus_queue.cc:1059] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:15.923938  6634 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.010140  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:16.026077  1659 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.040901  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:16.034291  6500 raft_consensus.cc:740] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:16.053968  6552 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.064278  1695 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.049021  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:16.007923  6626 raft_consensus.cc:697] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:16.010519  6683 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.059114  6674 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.162904  6646 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.163479  6646 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.163875  6646 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.184090  6221 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:16.137073  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 127025us
I20260709 13:02:16.206344  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.082446  6411 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:02:16.137691  6489 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.056713  6155 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.065639  6413 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:02:16.144783  6697 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:16.153046  6500 consensus_queue.cc:260] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.153481  6626 consensus_queue.cc:237] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.153991  6641 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:16.138906  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 90035.3us
I20260709 13:02:16.154927  1695 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
W20260709 13:02:16.136356  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.187731  6717 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:16.259490  6669 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:15.956403  6685 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.260686  5982 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.261664  6685 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.193324  6646 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.263479  6634 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.264180  6646 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.059739  6520 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:02:16.038430  6632 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.267421  6632 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.199792  1620 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:16.268214  6155 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.268487  1617 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:16.217216  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 214929us
I20260709 13:02:16.269466  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:16.270933  1511 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:16.271845  1511 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.274974  1620 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:16.274041  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:16.136852  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 49587.9us
I20260709 13:02:16.216632  6527 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:16.284363  5982 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:15.956337  6655 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.286767  6655 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.273725  6500 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.288261  6660 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:16.288816  6660 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.290838  6463 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:16.281919  6552 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.292706  6552 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.293062  6552 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:16.294974  6667 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:16.295553  6667 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:16.296506  6667 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.298303  6478 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:16.298859  6696 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:16.299295  6478 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:16.299381  6696 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:16.299772  6478 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:16.300359  6696 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.300848  6478 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.302798  6542 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:16.306907  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54736.7us
I20260709 13:02:16.307715  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:16.255383  6697 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.308815  2231 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:16.310133  6697 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.311925  6676 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:16.313150  6672 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:16.313714  6672 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:16.231432  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 246391us
I20260709 13:02:16.316836  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.333279  1543 raft_consensus.cc:2368] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:16.319717  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.302423  6478 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:16.319784  1545 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:16.342329  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.320106  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:16.320401  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.338440  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.339641  6655 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.328574  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.362860  1618 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:16.327818  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.319130  1546 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:02:16.323994  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.364197  1613 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:16.359287  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.355163  1661 leader_election.cc:400] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:16.368465  1661 leader_election.cc:403] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:16.331996  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:16.323565  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.318790  6502 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.359804  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:16.389746  1614 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:16.390688  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 67121.1us
I20260709 13:02:16.358637  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.343096  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:16.387920  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:16.392263  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:16.403409  1541 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:16.406977  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:16.407775  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 52805.3us
I20260709 13:02:16.395113  1538 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:16.416483  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.335259  6226 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:02:16.403312  6463 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.416144  6542 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:16.410854  6251 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.415617  6585 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.378764  6655 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.314601  6672 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:16.428194  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 402234us
W20260709 13:02:16.428709  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.448812  1616 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:16.415402  6155 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:02:16.464311  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.458976  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 390235us
I20260709 13:02:16.464429  1659 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.466840  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:16.457952  1614 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
W20260709 13:02:16.455086  6664 consensus_meta.cc:287] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.001s
I20260709 13:02:16.484625  1616 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:16.468458  1587 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.418170  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:16.487897  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.427771  6502 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:16.493891  1545 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:02:16.494081  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 75999us
I20260709 13:02:16.494602  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.499915  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:16.427106  6675 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:02:16.503782  1614 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:02:16.511987  1614 pending_rounds.cc:85] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 7
I20260709 13:02:16.512522  1614 pending_rounds.cc:107] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:02:16.433409  6674 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:02:16.533200  1694 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:02:16.524425  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.526737  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.536506  1691 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:16.537757  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.538906  6628 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:16.539386  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.539863  6702 consensus_queue.cc:1048] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:16.540984  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:16.548950  6637 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:16.556942  6660 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:16.559542  6221 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:16.561699  1692 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:16.562945  6632 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:16.523274  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:16.565652  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.566406  6628 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:16.566952  6628 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:16.567163  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:16.568063  6628 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.569815  6628 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:16.500530  6725 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:16.575390  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:16.577512  6632 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:16.578662  6645 raft_consensus.cc:3055] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:16.579103  6645 raft_consensus.cc:740] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:16.579938  6645 consensus_queue.cc:260] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.583623  1618 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:02:16.585278  2264 raft_consensus.cc:1240] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:16.577031  1616 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:02:16.528246  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:16.461861  6489 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:02:16.515712  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.596213  1618 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:02:16.596963  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 81399.1us
I20260709 13:02:16.598127  1659 leader_election.cc:400] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16.
I20260709 13:02:16.598448  1659 leader_election.cc:403] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:16.588737  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 60563us
I20260709 13:02:16.589141  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:16.528735  1614 raft_consensus.cc:2889] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:16.601675  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.499643  6520 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.496948  6669 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.586267  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.595686  1617 raft_consensus.cc:1275] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:16.494387  6439 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.599556  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:16.623438  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:16.580955  6645 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.623672  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:16.501468  6641 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.641666  6641 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.487316  6727 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:02:16.499799  6585 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:16.608114  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.644728  1691 raft_consensus.cc:2393] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:16.501674  6703 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.646003  6703 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:16.646813  6703 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:16.604387  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.591595  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:16.529800  6627 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:16.609611  1696 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:16.649036  1538 raft_consensus.cc:1240] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:16.623709  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.661159  1616 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:16.616796  6502 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.602087  6723 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:16.601917  6634 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:16.525341  6463 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:02:16.634680  5982 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:16.624996  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:16.651068  1511 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:16.664331  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 72832.3us
I20260709 13:02:16.705291  1688 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:16.622795  6200 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.620254  6383 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16.
I20260709 13:02:16.602519  6674 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:16.670327  6585 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:16.512900  6730 consensus_queue.cc:1059] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.174s
I20260709 13:02:16.682938  6723 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:16.685513  6641 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.687166  6632 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:16.626307  6669 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.692763  6655 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:16.695377  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:16.697006  1542 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:16.612169  6702 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:02:16.706630  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:16.706884  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:16.715309  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 64295.5us
I20260709 13:02:16.658849  6697 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.718876  6463 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:16.716287  6725 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:02:16.671334  6359 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.673074  6626 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.733810  1693 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:16.733949  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:16.634120  6439 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.673763  6634 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:16.736545  6730 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:16.737465  6200 raft_consensus.cc:3055] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:16.737658  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:16.672394  6489 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:02:16.714152  5982 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.737928  6723 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.790911  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:16.795677  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.771500  6632 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:16.774866  6492 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.773906  6625 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.822243  1542 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:16.838047  1659 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:16.806401  6463 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:16.808197  6200 raft_consensus.cc:740] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:16.829185  6697 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.829614  5982 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:16.855172  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 230618us
I20260709 13:02:16.801774  6359 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:16.856995  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 238165us
I20260709 13:02:16.835282  6702 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.844643  6383 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:16.879235  6359 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.879832  2257 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
W20260709 13:02:16.882251  6733 log.cc:927] Time spent T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:02:16.884058  1659 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:16.847961  6625 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:16.871080  6527 consensus_meta.cc:287] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.004s
I20260709 13:02:16.849920  6492 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:16.876152  6676 consensus_meta.cc:287] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
I20260709 13:02:16.858562  6697 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:16.910398  6383 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.911731  6439 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.890904  6702 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:16.897557  6527 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:16.860453  6634 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.905942  6676 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:16.871738  6632 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:16.941522  6552 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.001s
I20260709 13:02:16.941998  6552 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.919268  6383 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.909022  6463 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.945611  6655 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:16.884387  6200 consensus_queue.cc:260] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:16.951037  1615 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:16.921130  6702 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.946609  6492 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:16.991335  6655 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:16.963429  6739 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:02:16.994719  1540 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:16.963301  6734 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:16.960409  6660 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:16.933981  6251 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
W20260709 13:02:16.985628  6478 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.620s	user 0.014s	sys 0.000s
I20260709 13:02:16.999660  6655 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.030923  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:16.963649  6669 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:16.987164  6634 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.019261  6641 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:17.021373  6383 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:17.022946  6625 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:16.988003  6702 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.027331  1692 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:17.029412  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.030113  2261 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:02:17.031111  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 170379us
I20260709 13:02:16.993474  6632 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.008137  6697 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.030963  6505 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.048130  6655 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:17.052369  6696 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:17.031589  6200 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:16.997709  6660 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:17.067943  6660 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:17.069187  6740 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:02:17.061888  6696 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.077108  6696 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.059142  6505 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.080724  6505 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.031243  6500 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:17.083038  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.083036  6500 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.087164  6500 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.040409  6641 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:17.091719  6742 raft_consensus.cc:3055] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:17.092175  6641 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:17.099774  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56884.7us
I20260709 13:02:17.100610  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:17.092358  6742 raft_consensus.cc:740] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:17.107697  2260 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:17.110836  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.112738  1696 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:17.113387  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.114048  1690 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:17.114255  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.119060  1541 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:17.119895  1687 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:17.125818  1543 raft_consensus.cc:1240] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:17.137631  5982 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.137944  6702 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.119309  6660 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.141301  6685 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.148015  2264 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:02:17.152004  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:17.104651  6756 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:17.152757  6478 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:02:17.169210  2264 pending_rounds.cc:85] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 12
I20260709 13:02:17.171548  2264 pending_rounds.cc:107] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:02:17.171849  2264 raft_consensus.cc:2889] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.173578  6628 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:17.170545  6681 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:17.153626  5982 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.178503  1695 raft_consensus.cc:2393] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:17.176182  6681 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.195541  1541 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:17.189236  6714 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:02:17.185035  6681 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.174817  6685 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.221355  6675 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:17.221598  6625 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:17.223202  6685 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.216790  6383 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.224211  6383 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.226903  6625 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:17.224205  6744 consensus_queue.cc:1059] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:02:17.228251  6669 consensus_queue.cc:1048] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:17.228843  6674 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:17.229964  6627 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:17.230168  6356 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:17.230391  6627 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:17.230571  6356 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:17.170163  6742 consensus_queue.cc:260] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.231422  6627 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.236572  6552 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:17.239641  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.253542  1687 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:17.261142  6627 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.263710  6383 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:17.269959  6744 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:17.232685  6628 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:02:17.341601  6155 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.342662  6155 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.344987  6155 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:17.352023  6725 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.352249  6702 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.352573  6725 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.353519  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:17.354164  2261 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.355180  6725 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.359236  6502 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:17.359805  6502 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.363457  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1937) took 1038 ms. Trace:
I20260709 13:02:17.363595  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.364343  2265 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:17.365131  2261 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:17.365448  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:17.366752  6725 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:17.367156  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1943) took 1037 ms. Trace:
I20260709 13:02:17.367164  6725 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.367973  6725 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.368718  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2320) took 1053 ms. Trace:
I20260709 13:02:17.369109  1540 rpcz_store.cc:276] 0709 13:02:16.315360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.318737 (+  3377us) service_pool.cc:224] Handling call
0709 13:02:16.319007 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.995405 (+676398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.368481 (+373076us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400257954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:17.368659 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553523072}
W20260709 13:02:17.376608  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 517870us
I20260709 13:02:17.377416  6681 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.377802  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:17.379076  1659 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:17.379323  6745 consensus_queue.cc:1059] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:17.380259  6413 raft_consensus.cc:2804] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:17.380507  6745 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:17.380930  6413 raft_consensus.cc:697] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:17.382045  6413 consensus_queue.cc:237] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.387007  6725 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.390786  6200 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.392135  6200 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.398988  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.400597  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.391412  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:17.412448  2260 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:17.414760  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.418032  1539 raft_consensus.cc:1275] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:17.422996  6683 raft_consensus.cc:3055] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:17.367820  1621 rpcz_store.cc:276] 0709 13:02:16.329862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.330140 (+   278us) service_pool.cc:224] Handling call
0709 13:02:16.357375 (+ 27235us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:16.357740 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.357767 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:16.368204 (+ 10437us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.632324 (+264120us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:16.831691 (+199367us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.366823 (+535132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.366904 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.366950 (+    46us) raft_consensus.cc:1685] finished
0709 13:02:17.366966 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.367102 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553511,"prepare.queue_time_us":269473,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":546398,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":10390,"thread_start_us":370823,"threads_started":2,"wal-append.queue_time_us":278664}
W20260709 13:02:17.424475  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.425151  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:17.426543  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:17.435614  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.436591  1547 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:17.439422  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:17.446156  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.446594  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:17.452203  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.452889  1615 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:17.456034  1542 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:02:17.458400  2260 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:17.458961  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.363998  1619 rpcz_store.cc:276] 0709 13:02:16.325054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.325581 (+   527us) service_pool.cc:224] Handling call
0709 13:02:16.325989 (+   408us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:16.326451 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:16.326491 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:16.351635 (+ 25144us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.610957 (+259322us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.806124 (+195167us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.362770 (+556646us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b1800468760. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:02:17.362975 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.363059 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.363106 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:17.363213 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.363385 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38508,"prepare.queue_time_us":278604,"prepare.run_cpu_time_us":801,"prepare.run_wall_time_us":9731,"raft.queue_time_us":565515,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":16215,"spinlock_wait_cycles":5278592,"thread_start_us":369992,"threads_started":2,"wal-append.queue_time_us":450777}
I20260709 13:02:17.464308  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.466102  1619 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:17.422897  6725 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.423524  6683 raft_consensus.cc:740] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:17.471028  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.475739  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:17.477378  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 53179.8us
W20260709 13:02:17.480476  1587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.444639  6703 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:17.394517  6200 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.509362  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.486001  1543 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:17.510005  1615 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:17.438064  6627 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:17.502115  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.514132  1544 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:17.444916  6626 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.457718  6463 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.456947  6251 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.472504  6221 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:17.457540  6645 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.481434  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.476845  5982 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:17.508003  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.478570  6634 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:17.514446  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.515520  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.533907  1539 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:17.483614  6155 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:17.513677  1617 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:17.538856  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:17.510592  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.519716  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.541368  1544 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:17.451625  6478 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:02:17.446929  6685 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:02:17.529947  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.542857  1585 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:17.531601  1622 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:17.483565  6730 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:02:17.532728  1538 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:17.533439  1542 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:17.545132  1622 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:17.550771  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.524556  6676 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.554960  1619 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:17.532160  6359 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.534610  5982 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:02:17.590463  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 99683.8us
I20260709 13:02:17.521389  6627 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.518685  6703 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.610854  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:17.545992  6697 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:17.527817  6200 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:02:17.561599  6634 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:17.617324  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.551486  6696 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:17.528275  6746 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 13:02:17.616703  6765 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:02:17.529162  6626 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.638810  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.552961  6675 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:02:17.538566  6155 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.532903  6251 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.658757  6411 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:17.612645  5982 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.642728  1616 raft_consensus.cc:2468] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 10.
I20260709 13:02:17.645823  6641 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.678699  6411 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.652704  6356 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.612146  6359 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.658143  6155 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.695705  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.659526  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.665812  1622 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
I20260709 13:02:17.697548  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:17.621596  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:17.698530  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 77150.7us
I20260709 13:02:17.536651  6645 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.617743  6681 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.699496  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:17.595820  6676 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:17.679596  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 222389us
W20260709 13:02:17.685114  6764 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:02:17.685854  6771 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.004s
W20260709 13:02:17.686678  6769 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:17.687436  6775 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:17.639302  6634 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:17.639894  6696 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.629902  6697 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.617264  6683 consensus_queue.cc:260] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.736639  6359 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.736756  6683 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.727607  1620 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:17.739375  6645 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:17.739763  6778 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:17.711524  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.724630  6413 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:17.741406  6626 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.741797  6413 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.742262  6413 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:17.712282  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:17.744307  1622 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:17.712821  1619 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:02:17.651829  6770 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:17.717334  6463 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:17.718448  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 210549us
I20260709 13:02:17.723243  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:17.688396  6411 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:17.727142  6777 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:17.750093  6777 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.750509  6777 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:17.751717  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:17.753418  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:17.753260  6502 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.757067  6155 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:17.757220  6439 consensus_queue.cc:1175] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" responder_term: 18 status { last_received { term: 17 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:17.758414  6155 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:17.762001  6783 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:17.763952  6155 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:17.732275  6634 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:17.735024  6251 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.735424  6627 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:17.775684  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.735908  6697 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.720602  6552 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:17.761538  6356 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.761955  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.780709  1692 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 10.
I20260709 13:02:17.762610  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.781571  1695 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:17.764181  6783 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:17.765173  6645 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:17.729460  6676 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.731102  6625 consensus_queue.cc:1048] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:17.767086  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:17.787328  1693 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.779532  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.788517  1545 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:17.779798  6502 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.792862  6648 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.801590  6648 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.795410  6703 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.783748  6783 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:17.795496  6784 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:17.773202  6155 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:17.814440  1693 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:17.786600  6645 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.830073  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.831081  2260 raft_consensus.cc:2368] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12.
I20260709 13:02:17.784154  6552 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.835307  6645 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.837042  5982 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.827984  6155 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.839021  6782 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.839195  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:17.839592  6782 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.840209  6683 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:17.840642  6683 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:17.840977  6683 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:17.841790  6782 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:17.842104  5982 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.828088  6251 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:17.843134  6251 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.846802  1585 leader_election.cc:400] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12.
I20260709 13:02:17.847245  1585 leader_election.cc:403] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:17.812443  6696 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:17.862247  1617 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 2 to 8, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:17.845491  6703 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:17.845233  6502 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:17.861193  6527 raft_consensus.cc:3060] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:17.865227  6782 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:17.877164  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 125538us
I20260709 13:02:17.880621  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.882280  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.883884  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.886730  1696 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:17.872651  6251 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:17.914935  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:17.915666  1613 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:17.888747  1692 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:17.893425  6413 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:17.894187  1588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.871022  6783 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.895929  6777 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.876389  6703 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.879558  6502 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.903031  6648 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:17.912516  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.171118  1615 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:17.912140  6411 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.915076  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.893322  6645 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:17.945281  6789 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:17.935772  1691 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
W20260709 13:02:18.178215  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.179423  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.954373  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:17.952283  1621 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:18.069558  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:18.182518  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.943665  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.183521  1691 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:17.952885  6723 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.031728  1659 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:18.185009  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 153427us
I20260709 13:02:17.951757  5982 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.033368  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:17.948148  6155 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.882066  6782 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.916539  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.946601  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:18.192663  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 246129us
I20260709 13:02:17.936779  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.170042  1442 catalog_manager.cc:5697] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 7, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:17.940081  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.195209  1696 raft_consensus.cc:2410] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:02:17.952307  6696 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.196599  1619 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:18.194264  1442 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 10, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:18.200606  6463 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.201452  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.202069  2260 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:18.202996  6226 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.203020  6505 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:18.203540  6226 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.204842  6781 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.205657  6226 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.205528  6781 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.208063  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.208698  2266 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:18.202010  6500 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.211987  6781 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.213147  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.214404  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.217365  6505 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:18.219138  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.219945  2261 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:18.222997  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:18.222088  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:17.957508  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:17.954905  6671 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:17.942256  6769 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:18.008782  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.016713  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:17.965461  6742 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:17.951308  1614 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 6. (term mismatch)
W20260709 13:02:18.131625  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 215631us
I20260709 13:02:18.259825  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.260290  2231 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:18.132426  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 216050us
I20260709 13:02:18.166790  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:18.105926  6655 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.177145  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.189718  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.191113  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:18.201269  6463 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.187600  6723 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:17.971678  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:18.227013  1659 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.002962  1541 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:18.196767  1689 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 2 to 8, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:18.235934  6790 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:02:18.236136  6703 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.193395  5982 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.287067  5982 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.289366  6463 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.257321  6671 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:18.291359  2230 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.291777  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.292695  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.294442  6714 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:18.294844  6714 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.295195  6714 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.295786  6492 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:18.296350  6492 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:18.297211  6492 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.299314  6226 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.301487  6660 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:18.244319  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.223356  6697 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:18.317682  1543 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:18.238281  6502 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.224918  6439 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.323290  6439 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.324985  1613 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:18.325335  6439 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.259874  1614 pending_rounds.cc:85] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 5
I20260709 13:02:18.325942  1614 pending_rounds.cc:107] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:02:18.326196  1614 raft_consensus.cc:2889] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:18.262454  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.242606  6527 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12.
I20260709 13:02:18.212560  2264 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:18.261828  1694 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 11.
I20260709 13:02:18.278920  1547 raft_consensus.cc:3060] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.278806  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:18.223069  6696 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.316994  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.339959  1511 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.284094  6645 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.291301  6671 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:18.308230  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 64033.8us
I20260709 13:02:18.190608  6792 raft_consensus.cc:2804] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:18.316416  6463 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.316628  6697 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:18.332576  1546 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:18.340380  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.365128  1694 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:18.331815  6626 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.264935  6655 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.253939  6683 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.354550  1547 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:18.363703  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.350245  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.409885  1695 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:18.340565  6356 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:18.400594  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60691.5us
I20260709 13:02:18.411295  1511 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.413153  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.299377  6756 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:02:18.347185  6500 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.345983  6660 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:02:18.366560  6697 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.359985  6804 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:18.407503  6787 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:02:18.349949  6505 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:02:18.404410  6671 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.369656  6792 raft_consensus.cc:697] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:18.409955  6463 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:02:18.444154  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 217269us
I20260709 13:02:18.444965  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.448103  1541 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:18.417265  2231 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.453347  6439 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:18.453778  6439 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.454119  6439 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.473351  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.429183  6804 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:18.481285  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:18.491927  1547 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:18.406906  6626 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.428020  6809 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:18.493561  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.497331  1693 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
W20260709 13:02:18.489017  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 75957.9us
I20260709 13:02:18.439873  6502 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:18.439864  6810 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:18.504776  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.443071  6777 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.508450  1695 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:18.508967  6810 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.513579  6810 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.516669  1614 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:18.495877  6155 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.494850  6478 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.517786  6478 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.517944  6783 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:18.518203  6478 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:18.519323  6799 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:18.520232  6747 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:02:18.487375  6463 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.524679  6552 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.526094  6411 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.526261  6413 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.526547  6792 consensus_queue.cc:237] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.531518  6478 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.534081  6626 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.534163  6478 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.535140  6627 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:18.535686  6627 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.536054  6627 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.539217  6696 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:18.540707  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 95828.3us
I20260709 13:02:18.551278  6714 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.553613  6714 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.555814  6655 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.475729  6439 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.494659  6804 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:18.565768  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2225) took 1154 ms. Trace:
I20260709 13:02:18.569322  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.572458  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:18.526341  6803 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:02:18.575464  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1947) took 1051 ms. Trace:
I20260709 13:02:18.577108  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.576146  1695 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:18.233963   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:18.566159  1618 rpcz_store.cc:276] 0709 13:02:17.411075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.412348 (+  1273us) service_pool.cc:224] Handling call
0709 13:02:17.412670 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.457254 (+ 44584us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:17.524471 (+ 67217us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.761502 (+237031us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b4800032358. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:02:17.821914 (+ 60412us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b18002bdbc0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a 00007f7f1a8e4a2a
0709 13:02:17.863021 (+ 41107us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.903956 (+ 40935us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4800032358. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
0709 13:02:18.562393 (+658437us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.562912 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.563063 (+   151us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:18.563114 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.565496 (+  2382us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.565546 (+    50us) raft_consensus.cc:1685] finished
0709 13:02:18.565561 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.565705 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1527920,"prepare.queue_time_us":67305,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":1926,"raft.queue_time_us":767973,"raft.run_cpu_time_us":2043,"raft.run_wall_time_us":333466,"spinlock_wait_cycles":24329984,"thread_start_us":9872,"threads_started":1,"wal-append.queue_time_us":341490}
I20260709 13:02:18.574232  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.581247  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.499665  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:18.511878  6782 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.579761  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.609620  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.612618  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:18.620772  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 671031us
I20260709 13:02:18.605327  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:18.625372  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.626682  1696 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:18.623452  1695 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:18.634123  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.000s
W20260709 13:02:18.634678  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.000s
I20260709 13:02:18.591490  6632 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:18.594713  6702 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:02:18.636140  6646 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.636466  6723 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.564862  6810 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.671257  6703 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:18.639461  6648 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.650385  6527 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.701593  6527 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.669788  6644 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.657953  6742 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.670217  6786 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.707823  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 208305us
I20260709 13:02:18.709136  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:18.710471  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 131197us
I20260709 13:02:18.578872  1617 rpcz_store.cc:276] 0709 13:02:17.523761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.556686 (+ 32925us) service_pool.cc:224] Handling call
0709 13:02:17.557418 (+   732us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:17.558065 (+   647us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:17.633220 (+ 75155us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.760101 (+126881us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b1800204f40. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed522 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:17.782931 (+ 22830us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:17.828136 (+ 45205us) log.cc:844] Serialized 616 byte log entry
0709 13:02:17.828328 (+   192us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:17.828627 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.027291 (+198664us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.561886 (+534595us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800204f40. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f1e7ae58f 00007f7f177ed571 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd
0709 13:02:18.575105 (+ 13219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.575190 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.575237 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:18.575249 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.575406 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551485,"prepare.queue_time_us":75158,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":3156,"raft.queue_time_us":632663,"raft.run_cpu_time_us":625,"raft.run_wall_time_us":30512,"spinlock_wait_cycles":35311872,"thread_start_us":91105,"threads_started":1,"wal-append.queue_time_us":189055}
W20260709 13:02:18.709878  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 59051us
I20260709 13:02:18.679294  6683 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.647778  6632 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.719123  6812 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.717502  6714 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.719715  6812 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.720366  6812 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.720247  6714 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.722393  6714 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.722819  6806 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:18.723716  6806 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.728430  6664 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.729038  6664 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.731482  6664 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.713181  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.711902  6644 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.705066  6648 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.716342  6742 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.715837  6786 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.742452  6492 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:18.685115  6646 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.742440  6816 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.780258  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.790176  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:18.784011  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 74940.5us
I20260709 13:02:18.791939  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.792042  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:18.789384  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.784215  1695 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:18.796913  6816 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:18.797123  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 84031.6us
I20260709 13:02:18.797519  6816 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.798337  6646 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.798527  6696 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.799124  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.799497  6696 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.799716  6810 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.799824  6816 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.801928  6697 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.802561  6502 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:18.803246  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.803139  6817 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:18.804061  1688 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:18.804726  6527 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.798219  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:18.784631  1622 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:18.799857  1614 raft_consensus.cc:2393] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 11: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:18.703286  6703 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.812937  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:18.828112  2257 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:18.832619  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:18.838135  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:18.840664  5982 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:18.840919  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:18.837224  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:18.818159  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:18.834574  2266 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:18.860308  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.861325  1622 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:18.786757  6645 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.861987  6645 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.864234  6645 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.856521  6696 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.864821  6696 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.865185  6696 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.865814  6742 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:18.866318  6811 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:18.855396  6655 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:18.867134  6655 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.867492  6655 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.781834  6492 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:18.781700  6200 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:18.872949  6815 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:02:18.873690  6821 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:02:18.873889  6492 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:18.877132  2257 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 19.
I20260709 13:02:18.877030  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.878952  5982 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:18.890080  1695 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:18.880656  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.883137  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.884236  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:18.808899  6439 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:18.871295  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 53150.2us
I20260709 13:02:18.891687  1547 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:18.887615  6645 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.850278  6783 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.894059  1510 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:18.894821  1694 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:18.856822  6782 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.896581  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.872985  6703 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:18.896250  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:18.887903  6809 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:18.892815  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:18.947368  1538 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:18.887529  6505 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:18.887315  6200 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.895364  6781 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:18.898123  6725 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:18.949687  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 53516.6us
W20260709 13:02:18.942719  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48740.3us
I20260709 13:02:18.909333  6645 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.966550  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:18.961416  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:18.967500  1613 raft_consensus.cc:3060] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:18.967893  1618 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:18.957221  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49942.5us
I20260709 13:02:18.972321  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.974934  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.910914  6625 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.976330  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.978303  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:18.978971  1620 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:18.977377  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:18.944205  6463 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:18.942528  6782 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.003190  1696 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:19.003652  1613 raft_consensus.cc:2468] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:18.952769  6817 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:19.005678  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:19.003643  1547 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:19.018162  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:18.959227  6781 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:18.923957  6783 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:18.977176  6645 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:19.069757  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 54007.2us
I20260709 13:02:18.977015  6809 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:19.077390  1538 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:18.954514  6828 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.979710  6806 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:19.079689  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:19.004302  6827 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:18.977792  6703 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:02:19.013454  6463 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:19.113451  1618 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
W20260709 13:02:19.138566  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 58962.8us
I20260709 13:02:19.138260  1695 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:18.977409  6725 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.146776  6683 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.069468  6817 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 19 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:19.080422  6781 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.152647  2230 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:19.006207  6625 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.164016  1621 raft_consensus.cc:1275] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:19.164232  6359 raft_consensus.cc:2804] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:19.100073  6627 consensus_meta.cc:287] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.005s
I20260709 13:02:19.159987  6683 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.161293  6817 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.075498  6746 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:19.153081  6822 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.373s	user 0.002s	sys 0.000s
I20260709 13:02:19.186060  6359 raft_consensus.cc:697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:19.186218  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:19.203795  1621 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.085628  6772 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:19.165027  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:19.206867  1613 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.167306  6664 raft_consensus.cc:2764] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:02:19.208915  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.220820  1613 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:19.223153  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:19.221875  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:19.224494  1687 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:19.224488  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:19.077096  6804 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.086278  6809 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:19.202704  6746 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.248539  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:19.141755  6827 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.221750  6786 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.165014  6463 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.271267  1693 raft_consensus.cc:3060] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.277050  1613 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:19.227829  6697 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.196957  6627 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.277957  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:19.295037  1613 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.296133  2264 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:19.247551  6809 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.296558  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:19.260466  6746 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.297780  2257 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:19.309711  1693 raft_consensus.cc:2468] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:19.109490  6828 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.274003  6625 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.241504  6772 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.296468  6808 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:19.309098  6648 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.311363  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:19.316847  6826 log.cc:927] Time spent T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:02:19.306025  1613 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
W20260709 13:02:19.319166  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 86552.6us
I20260709 13:02:19.319612  1621 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:19.333369  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:19.334142  1613 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
W20260709 13:02:19.334667  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 456305us
W20260709 13:02:19.318770  6818 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.365s	user 0.001s	sys 0.001s
I20260709 13:02:19.333314  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:19.341446  2231 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.004s	sys 0.020s
W20260709 13:02:19.343235  2231 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.021s
W20260709 13:02:19.343602  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 731109us
I20260709 13:02:19.344808  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:19.315173  6807 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:02:19.336629  6820 log.cc:927] Time spent T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:02:19.330875  6200 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.363641  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:19.339463  6792 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:19.370749  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:19.371484  1545 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:19.315312  6359 consensus_queue.cc:237] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.372318  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.376403  1541 raft_consensus.cc:2410] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:19.344056  6502 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:19.373939  1547 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:19.372188  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.381384  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.346402  6782 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:19.362082  6830 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:19.381965  1541 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:19.442237  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.385812  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:19.443608  1543 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:19.326298  6808 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.384411  6683 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.390353  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:19.393433  6838 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:02:19.395183  6834 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:02:19.395874  6671 consensus_meta.cc:287] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.957s	user 0.011s	sys 0.003s
W20260709 13:02:19.396144  6841 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:02:19.419147  6836 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:02:19.424404  6781 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:19.425396  6837 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
W20260709 13:02:19.425681  6812 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.705s	user 0.012s	sys 0.000s
I20260709 13:02:19.467808  6830 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:19.431923  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 2074) took 1548 ms (client timeout 1784 ms). Trace:
I20260709 13:02:19.433686  6463 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.434157  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:19.500015  1688 rpcz_store.cc:269] 0709 13:02:17.883792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.883912 (+   120us) service_pool.cc:224] Handling call
0709 13:02:19.431604 (+1547692us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54001f72d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:19.431815 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403511296}
I20260709 13:02:19.435892  6772 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:19.390733  6833 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:02:19.437178  6804 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.382380  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
W20260709 13:02:19.438556  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 106327us
I20260709 13:02:19.544222  1539 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.373109  6792 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.458236  1541 raft_consensus.cc:2393] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:19.459558  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:19.438252  6818 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:02:19.545045  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:19.545683  1540 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:19.546739  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.468880  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:19.547613  1690 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:19.476944  1545 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:19.549031  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.549616  1545 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:19.477317  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:19.551258  1694 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:19.551620  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.419024  6645 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.486948  6828 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.565861  1543 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:19.496732  6808 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.497457  6807 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.497205  6746 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.498451  6627 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.499099  6812 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.601140  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:19.575208  6655 consensus_meta.cc:287] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 13:02:19.501978  1547 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:19.503470  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.506542  6625 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:19.465801  6782 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:19.550436  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.562079  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:19.487525  6827 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.570536  1688 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:19.582363  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.611187  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51308 (request call id 2628) took 1526 ms. Trace:
W20260709 13:02:19.593844  6843 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 13:02:19.588941  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 396767us
W20260709 13:02:19.589326  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44353.1us
I20260709 13:02:19.429690  6809 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.500418  6830 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.552080  6792 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:19.602461  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:19.604799  1542 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:19.621483  1692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 2086) took 1399 ms. Trace:
I20260709 13:02:19.618067  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:19.621905  1692 rpcz_store.cc:276] 0709 13:02:18.222279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.308568 (+ 86289us) service_pool.cc:224] Handling call
0709 13:02:18.319197 (+ 10629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.668402 (+349205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.668447 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.668993 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.896603 (+227610us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:18.896652 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.896727 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.621270 (+724543us) raft_consensus.cc:1685] finished
0709 13:02:19.621292 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.621424 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21492,"raft.queue_time_us":44364,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":37398,"thread_start_us":554421,"threads_started":2,"wal-append.queue_time_us":335487}
I20260709 13:02:19.616523  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:19.623811  1539 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:19.620291  6645 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.628242  6808 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:19.629163  6627 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:19.637322  6632 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.644222  6853 consensus_queue.cc:1048] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:19.645964  6853 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:19.653226  1538 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:19.614949  6625 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.659232  6625 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.611581  1691 rpcz_store.cc:276] 0709 13:02:18.085204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.194028 (+108824us) service_pool.cc:224] Handling call
0709 13:02:18.194302 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.194637 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.194666 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.195099 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.464029 (+268930us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b180018e440. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a0d1 00007f7f1a895a0f
0709 13:02:18.618258 (+154229us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:18.774144 (+155886us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.775413 (+  1269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.775485 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.605718 (+830233us) raft_consensus.cc:1685] finished
0709 13:02:19.610976 (+  5258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.611128 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89945,"prepare.queue_time_us":154736,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":2641,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7464,"spinlock_wait_cycles":17608576,"thread_start_us":137171,"threads_started":1,"wal-append.queue_time_us":664241}
I20260709 13:02:19.600991  6807 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.666986  6439 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:19.667575  6439 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:19.671265  6439 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.600250  6804 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:19.624801  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.682183  1539 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:19.625334  1690 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
W20260709 13:02:19.688007  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.675124  6809 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:19.675472  6840 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.348s	user 0.002s	sys 0.000s
I20260709 13:02:19.654500  1538 raft_consensus.cc:1240] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:19.678120  6781 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.620414  6746 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:19.613711  6696 consensus_meta.cc:287] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
W20260709 13:02:19.680528  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52801.2us
I20260709 13:02:19.818501  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:19.665335  6807 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.813983  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.646492  6853 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:19.605471  6655 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.819940  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:19.824025  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.690217  6478 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.825480  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.830930  1539 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:19.828998  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:19.831828  1538 raft_consensus.cc:2468] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:19.825260  6500 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:19.838131  6500 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.753863  6226 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:19.840284  6226 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.842283  6226 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.843204  1541 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:19.618196  6782 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.822850  6804 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:19.861271  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 491533us
I20260709 13:02:19.862354  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:19.866598  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 242752us
I20260709 13:02:19.823124  6696 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.876348  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:19.880942  6832 log.cc:927] Time spent T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 1.019s	user 0.001s	sys 0.011s
I20260709 13:02:19.884743  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2358) took 1753 ms. Trace:
I20260709 13:02:19.886287  6696 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.885188  1544 rpcz_store.cc:276] 0709 13:02:18.131171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.186698 (+ 55527us) service_pool.cc:224] Handling call
0709 13:02:18.186997 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.503003 (+316006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.503054 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.503702 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.732913 (+229211us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:18.732973 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.657444 (+924471us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540003aa54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:19.657524 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.880373 (+222849us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:19.884491 (+  4118us) raft_consensus.cc:1685] finished
0709 13:02:19.884518 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.884678 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9012,"raft.queue_time_us":82909,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":29842,"spinlock_wait_cycles":567571584,"thread_start_us":222372,"threads_started":2,"wal-append.queue_time_us":349362}
I20260709 13:02:19.873785  6854 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:19.874215  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:19.889649  6627 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:19.891891  6792 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.894184  6792 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.870872  6808 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:19.895038  6808 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.897259  6808 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.846302  6478 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:19.980990  6725 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:19.984282  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.902783  6854 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:20.004927  6812 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.984316  6714 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.007073  6782 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:19.977556  6696 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.008113  6644 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:19.868741  6804 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:19.902290  6853 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.043932  6478 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:20.046697  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 172570us
I20260709 13:02:20.088349  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:20.090265  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.054087  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2713) took 1790 ms. Trace:
I20260709 13:02:20.090878  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.052433  6697 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.115425  1690 raft_consensus.cc:2410] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:02:20.120909  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 241731us
I20260709 13:02:20.087265  6714 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.090926  1546 rpcz_store.cc:276] 0709 13:02:18.264685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.365192 (+100507us) service_pool.cc:224] Handling call
0709 13:02:18.365498 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.491225 (+125727us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:18.509932 (+ 18707us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.778288 (+268356us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.791459 (+ 13171us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.824983 (+ 33524us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:18.825240 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.835075 (+  9835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.672152 (+837077us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b54003f91a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a84fdbe 00007f7f1a85a930 00007f7f1a85a8d8 00007f7f1a85a858 00007f7f1a85a813 00007f7f1a859a9c 00007f7f20745626 00007f7f2073fdd8 00007f7f1a8967cb 00007f7f1a8992c0
0709 13:02:20.053759 (+381607us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400083ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:20.053817 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.053861 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:20.053873 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.054030 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134910,"prepare.queue_time_us":19758,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":14186,"raft.queue_time_us":156806,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":44458,"spinlock_wait_cycles":370968064,"thread_start_us":74105,"threads_started":1,"wal-append.queue_time_us":255719}
I20260709 13:02:20.122578  6854 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.122942  6714 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.093111  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.125243  6714 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.091655  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.119437  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.135850  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.138571  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:20.139493  1691 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:20.136767  1544 raft_consensus.cc:2468] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:20.143426  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:20.155910  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:20.156383  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:20.157575  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:20.085583  6492 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:20.108774  6478 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:20.147289  6697 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.054800  6783 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:20.085860  6696 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.170866  6861 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.172556  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.173619  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.174472  2263 raft_consensus.cc:2368] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:02:20.178689  1544 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:20.146276  6725 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:20.180825  6725 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.183182  6725 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:20.184383  6703 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.184527  2230 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:20.185070  6703 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.185544  6646 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:20.185968  6646 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:20.187062  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.186801  6646 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.146785  6857 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.187963  6646 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:20.188230  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.188141  6857 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.189702  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 1010) took 1229 ms. Trace:
I20260709 13:02:20.190353  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.190595  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2242) took 1177 ms. Trace:
I20260709 13:02:20.194743  1620 rpcz_store.cc:276] 0709 13:02:19.012728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.013039 (+   311us) service_pool.cc:224] Handling call
0709 13:02:19.013293 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.013474 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.019745 (+  6271us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.190220 (+1170475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.190292 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.190339 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.190401 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.190533 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":914394,"prepare.queue_time_us":80068,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":12373,"thread_start_us":239391,"threads_started":1,"wal-append.queue_time_us":305337}
I20260709 13:02:20.191308  1613 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.172037  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.177503  1546 raft_consensus.cc:2468] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:20.203073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.203897  1613 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:20.204807  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.205447  1613 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.190053  1614 rpcz_store.cc:276] 0709 13:02:18.960160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.960354 (+   194us) service_pool.cc:224] Handling call
0709 13:02:19.000007 (+ 39653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.005231 (+  5224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.005259 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.012545 (+  7286us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.298881 (+286336us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:19.314958 (+ 16077us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.189409 (+874451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.189482 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.189524 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:20.189537 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.189649 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1980642,"prepare.queue_time_us":25108,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":12375,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":67412,"thread_start_us":147494,"threads_started":1,"wal-append.queue_time_us":285768}
I20260709 13:02:20.206223  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.210873  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:20.211442  1613 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:20.212226  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.213318  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:20.215113  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:20.215876  2257 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.219467  6703 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.219822  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.220685  1621 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.215015  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:20.173179  6860 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.174872  6478 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.263200  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.256177  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:20.278105  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.213568  6714 raft_consensus.cc:2804] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:20.284621  6478 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:20.292681  1613 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 19.
I20260709 13:02:20.221779  6814 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.277217  2263 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
W20260709 13:02:20.319540  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 159549us
I20260709 13:02:20.320057  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2241) took 1362 ms. Trace:
I20260709 13:02:20.332613  1619 rpcz_store.cc:276] 0709 13:02:18.962474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.962591 (+   117us) service_pool.cc:224] Handling call
0709 13:02:18.962889 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.963081 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:18.963301 (+   220us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.182075 (+1218774us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b18002bd920. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f17767c0a 00007f7f20ea7219 00007f7f177efa40 00007f7f177ea4e4 00007f7f177ea455 00007f7f1a8d2060 00007f7f1a8e4716 00007f7f1a8f5287 00007f7f1a8f5208
0709 13:02:20.319714 (+137639us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.319775 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:20.319815 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.319877 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.320003 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7637,"prepare.queue_time_us":50325,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":1104891,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":6096128,"thread_start_us":251824,"threads_started":2,"wal-append.queue_time_us":304394}
I20260709 13:02:20.193418  6492 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.207839  6861 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:20.338253  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.419198  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 1009) took 1460 ms. Trace:
I20260709 13:02:20.277283  6860 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.451570  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.460465  6782 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:20.461997  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:20.356602  6644 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.320446  6632 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.476706  6632 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.479498  6632 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.464074  6644 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.462478  6814 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:20.289077  6714 raft_consensus.cc:697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:20.457053  1619 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:20.462342  6782 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.455947  1585 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:20.462908  6863 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.457489  6723 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.464560  2266 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:20.463603  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:20.465972  2257 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:20.499756  6723 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:20.456199  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63120.9us
I20260709 13:02:20.500838  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:20.501708  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:20.501943  6723 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.502048  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:20.449717  6697 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.469964  1659 leader_election.cc:400] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:02:20.503098  1659 leader_election.cc:403] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.358966  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2243) took 1265 ms. Trace:
I20260709 13:02:20.328896  6580 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.504626  1619 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:02:20.466341  6655 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.508374  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.509202  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:20.456041  1511 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:20.511404  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.490409  6804 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:20.490590  6814 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.494789  6782 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:20.487849  6857 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.494169  6854 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:20.496394  6860 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.499049  6492 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.502465  6807 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:20.504287  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:20.512239  6725 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:20.482846  6644 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.517479  6697 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:20.508226  1540 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:20.337965  6359 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:20.512437  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56480.1us
I20260709 13:02:20.513005  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.455302  1622 rpcz_store.cc:276] 0709 13:02:18.959347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.960550 (+  1203us) service_pool.cc:224] Handling call
0709 13:02:18.960895 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.981890 (+ 20995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.015895 (+ 34005us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.017091 (+  1196us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.269567 (+252476us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:19.302012 (+ 32445us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.405534 (+1103522us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.418809 (+ 13275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.418898 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.418945 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:20.418960 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.419127 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2140032,"prepare.queue_time_us":32261,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":943779,"raft.run_cpu_time_us":6225,"raft.run_wall_time_us":65785,"thread_start_us":399907,"threads_started":2,"wal-append.queue_time_us":271755}
I20260709 13:02:20.290163  6828 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.516045  1694 raft_consensus.cc:2368] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:20.502930  6625 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:20.534008  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.505050  6827 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:20.510699  6830 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:20.505908  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:20.613426  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 107588us
I20260709 13:02:20.503933  1615 rpcz_store.cc:276] 0709 13:02:19.093331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.137059 (+ 43728us) service_pool.cc:224] Handling call
0709 13:02:19.192907 (+ 55848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.193130 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:19.239192 (+ 46062us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.358499 (+1119307us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.358567 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:20.358650 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.358747 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.358891 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1046027,"prepare.queue_time_us":50422,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":5175,"raft.queue_time_us":1019818,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":3592,"thread_start_us":100125,"threads_started":1,"wal-append.queue_time_us":151415,"wal-append.run_cpu_time_us":1247,"wal-append.run_wall_time_us":1001285}
I20260709 13:02:20.512728  6863 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:02:20.575186  1691 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.507367  1692 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:20.591922  6725 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:20.596110  6814 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:20.599435  6823 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.810s	user 0.008s	sys 0.008s
I20260709 13:02:20.510262  6580 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.610838  6625 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.588272  6730 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.574659  6703 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.574880  6807 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:20.728986  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.729730  2257 raft_consensus.cc:2368] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:20.573997  6714 consensus_queue.cc:237] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.612056  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:20.731606  1694 raft_consensus.cc:2410] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 13:02:20.576004  6707 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:02:20.593135  6696 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.624676  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:20.715831  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:20.604467  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:20.721903  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.614897  6830 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.724404  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.608659  6359 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.611536  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.734898  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:20.773861  1619 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 11.
I20260709 13:02:20.737087  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:20.613313  6828 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.725674  6625 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.618294  6869 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:20.771461  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 253294us
I20260709 13:02:20.770341  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:20.829821  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45637 timed out after 1.760s (SENT) [suppressed 3 similar messages]
W20260709 13:02:20.758930  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.771124  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 166791us
W20260709 13:02:20.772626  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 56946us
I20260709 13:02:20.828653  1694 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:20.835542  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:20.777773  1615 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.782754  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:20.837248  1617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.022s	sys 0.034s
I20260709 13:02:20.785552  6580 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.796941  1692 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:20.771050  6814 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.802201  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.803090  6725 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.804329  1691 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:20.778488  6827 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:20.814039  6359 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:20.772919  6830 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.739692  6723 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:20.868059  6723 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.818179  6439 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:20.822597  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.828344  6869 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.824648  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:20.774087  6863 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:20.859100  6870 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.799049  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:20.839181  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.829517  1442 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 11, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.731937  6807 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:20.860590  6696 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.846957  1510 leader_election.cc:400] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:20.858954  1692 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:20.860036  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.912328  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:20.913265  1615 raft_consensus.cc:2368] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:02:20.913961  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.914991  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:20.916899  1615 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.854156  1659 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:20.728917  6730 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:20.824410  6835 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.717s	user 0.012s	sys 0.013s
I20260709 13:02:20.873528  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:20.838094  1617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.022s	sys 0.034s
I20260709 13:02:20.740080  6703 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:20.878940  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 43613.5us
I20260709 13:02:20.866765  6861 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.890232  6863 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:20.889014  6870 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.873725  6869 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:20.894593  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:20.896239  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 375913us
I20260709 13:02:20.979671  1620 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:20.896502  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2640) took 1076 ms. Trace:
I20260709 13:02:20.908201  1545 raft_consensus.cc:1275] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:20.978308  2258 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:20.981994  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.908612  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.908273  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:20.983191  1543 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.863114  6814 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:20.944711  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:20.944660  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.985970  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.986598  1538 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:20.986819  1620 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:20.943077  1510 leader_election.cc:403] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:20.945506  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:20.946926  1695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51308 (request call id 2634) took 1972 ms (client timeout 2040 ms). Trace:
I20260709 13:02:20.987762  1619 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:20.945396  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.988713  1615 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:20.959411  1511 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:20.949947  6851 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:20.950454  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:20.948182  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 94366.5us
I20260709 13:02:20.953183  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.990527  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:20.956035  1544 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:20.956339  6703 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:20.957655  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:20.896734  6877 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:20.958575  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47468 (request call id 1008) took 2617 ms. Trace:
I20260709 13:02:21.003850  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:20.963719  6828 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:20.967871  6478 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.002s
I20260709 13:02:20.987905  1512 leader_election.cc:400] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:20.980705  1690 rpcz_store.cc:276] 0709 13:02:19.819628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.819731 (+   103us) service_pool.cc:224] Handling call
0709 13:02:20.894537 (+1074806us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b540023b4d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:20.896443 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662843136}
I20260709 13:02:20.950680  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:21.012322  1614 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:20.973289  6863 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:20.993885  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.005039  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:20.987677  1695 rpcz_store.cc:269] 0709 13:02:18.974349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.974552 (+   203us) service_pool.cc:224] Handling call
0709 13:02:20.946758 (+1972206us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540012d9d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:20.946863 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373844864}
I20260709 13:02:21.017292  1615 raft_consensus.cc:2393] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 12: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:21.005697  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:20.995591  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50975.4us
I20260709 13:02:20.898196  6696 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.003728  1616 rpcz_store.cc:276] 0709 13:02:18.340698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.340870 (+   172us) service_pool.cc:224] Handling call
0709 13:02:18.360738 (+ 19868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.596713 (+235975us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.596746 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.639046 (+ 42300us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.886318 (+247272us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:19.659743 (+773425us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b18002bed60. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a4824bc 00007f7f177d048b 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ea455 00007f7f1e2d23c7 00007f7f1a8e49a7 00007f7f1a8f40bf
0709 13:02:19.659889 (+   146us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.328528 (+668639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.328625 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.823685 (+495060us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:20.958355 (+134670us) raft_consensus.cc:1685] finished
0709 13:02:20.958376 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.958494 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933011,"prepare.queue_time_us":68794,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":910664,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":17934,"spinlock_wait_cycles":175451776,"thread_start_us":306596,"threads_started":2,"wal-append.queue_time_us":316964}
I20260709 13:02:21.021127  1543 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:21.018344  1619 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:21.024253  1538 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:20.959523  6723 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:20.960031  6730 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.033891  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.034598  1616 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:21.012182  6860 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:20.975008  6827 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:21.038041  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 205453us
I20260709 13:02:21.016426  6785 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.016624  6851 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:21.022826  6810 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:21.046346  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 216555us
I20260709 13:02:21.019186  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.051846  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.052098  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.052790  1616 raft_consensus.cc:1275] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:02:21.028276  6870 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.030539  6781 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.060164  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.063470  1614 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:21.043771  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:21.067474  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.075050  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.077280  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:21.014981  6478 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.079984  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.084336  6644 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:21.084774  6644 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.085280  6644 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.085608  6886 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.086499  6886 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.050796  6810 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:21.055781  6730 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:21.075016  6703 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.075580  6580 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:21.122917  2261 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:21.126001  6874 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.125995  6580 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.091346  6632 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:21.053943  6827 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.088407  6792 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:21.050487  6860 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.130577  1617 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:21.128743  6877 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:21.087914  6697 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925) with higher term. Message: Invalid argument: T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:21.117650  6810 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:21.118829  6730 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.121842  6828 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.140549  6792 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.105150  6872 consensus_queue.cc:1059] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:02:21.156219  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 318164us
I20260709 13:02:21.157441  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:21.169273  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 155396us
I20260709 13:02:21.148622  6730 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:21.157047  6792 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:21.207754  6894 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:02:21.208755  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2719) took 1834 ms. Trace:
I20260709 13:02:21.209200  1541 rpcz_store.cc:276] 0709 13:02:19.375050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.581565 (+206515us) service_pool.cc:224] Handling call
0709 13:02:21.208554 (+1626989us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b540003a554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:21.208699 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":535149440}
I20260709 13:02:21.209755  6627 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:21.210263  6627 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.210649  6627 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.211046  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 1097) took 1094 ms. Trace:
I20260709 13:02:21.211403  2261 rpcz_store.cc:276] 0709 13:02:20.116541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.116742 (+   201us) service_pool.cc:224] Handling call
0709 13:02:20.117130 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.124830 (+1007700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.210808 (+ 85978us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005fd054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:21.210989 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312698752}
I20260709 13:02:21.195925  6703 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.214900  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:21.208832  6868 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.589s	user 0.000s	sys 0.001s
I20260709 13:02:21.215638  1622 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
I20260709 13:02:21.216646  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.243654  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:21.217932  6827 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.215185  6703 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.220656  6627 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.220994  6500 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.214046  6830 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.196547  6697 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:21.197263  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:21.266673  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:21.296461  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 99269.1us
I20260709 13:02:21.160457  6861 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:21.280808  1695 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:21.145889  6877 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.285977  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.256946  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.157660  6828 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:21.267727  6880 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:02:21.288100  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 295917us
I20260709 13:02:21.322403  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.325532  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.345757  1617 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:21.160107  6851 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.283650  6814 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.312258  6500 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:21.358253  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:21.362385  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.311519  6886 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.321727  6696 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.323365  6667 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:21.371798  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.374118  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.356308  6781 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.313585  6697 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:21.382084  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 216718us
I20260709 13:02:21.375965  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.357889  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.359781  6356 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:02:21.385010  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.388793  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.312831  6861 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.373093  6667 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:21.376575  6886 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.414208  1621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1972) took 1215 ms. Trace:
I20260709 13:02:21.417507  1621 rpcz_store.cc:276] 0709 13:02:20.198694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.221369 (+ 22675us) service_pool.cc:224] Handling call
0709 13:02:20.465421 (+244052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.491174 (+ 25753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.491206 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.493538 (+  2332us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.732357 (+238819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:20.732415 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.893411 (+160996us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54002a76d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:20.893473 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.389717 (+496244us) raft_consensus.cc:1685] finished
0709 13:02:21.389743 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.414117 (+ 24374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6183,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":13117,"spinlock_wait_cycles":41587584,"thread_start_us":238400,"threads_started":1,"wal-append.queue_time_us":379365}
I20260709 13:02:21.379961  6870 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.380756  6500 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:21.425268  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 337749us
I20260709 13:02:21.427892  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:21.390703  6439 consensus_meta.cc:287] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:02:21.456295  1693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 982) took 2827 ms (client timeout 1760 ms). Trace:
W20260709 13:02:21.456800  1693 rpcz_store.cc:269] 0709 13:02:18.609240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.609383 (+   143us) service_pool.cc:224] Handling call
0709 13:02:21.436540 (+2827157us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b540019c154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:21.436723 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1520078720}
I20260709 13:02:21.465045  1617 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:21.466830  2260 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:21.389298  6696 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:21.397006  6580 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.471092  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:21.472776  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:21.474352  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:21.500452  1543 raft_consensus.cc:2376] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15. Re-sending same reply.
I20260709 13:02:21.482589  1539 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:21.484928  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.499840  1541 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
W20260709 13:02:21.495632  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 109527us
I20260709 13:02:21.417009  6667 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:21.475947  6871 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:21.463852  6860 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.479655  6696 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:21.601502  6888 log.cc:927] Time spent T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:02:21.601672  6696 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:21.606901  6500 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:21.610364  6644 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
W20260709 13:02:21.623529  6893 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:02:21.429646  6886 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:21.615353  6807 consensus_meta.cc:287] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.709s	user 0.010s	sys 0.000s
I20260709 13:02:21.636050  6830 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:21.612686  6625 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.000s
I20260709 13:02:21.633379  6861 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.619855  6703 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.584298  6552 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.629966  6627 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.462145  6870 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.676258  1619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2259) took 1099 ms. Trace:
I20260709 13:02:21.695453  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.695247  1619 rpcz_store.cc:276] 0709 13:02:20.576763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.047118 (+470355us) service_pool.cc:224] Handling call
0709 13:02:21.047469 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:21.047943 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.047983 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:21.055385 (+  7402us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.384717 (+329332us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:21.384771 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.385993 (+  1222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.675986 (+289993us) raft_consensus.cc:1685] finished
0709 13:02:21.676009 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.676177 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5073,"raft.queue_time_us":109,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":24890,"thread_start_us":282539,"threads_started":1,"wal-append.queue_time_us":448551}
W20260709 13:02:21.673997  6902 log.cc:927] Time spent T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
W20260709 13:02:21.646765  6904 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
I20260709 13:02:21.680526  1618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2244) took 2517 ms. Trace:
I20260709 13:02:21.652623  6697 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:21.687964  6876 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:02:21.667744  6891 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:21.702067  1618 rpcz_store.cc:276] 0709 13:02:19.162879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.165591 (+  2712us) service_pool.cc:224] Handling call
0709 13:02:19.165874 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.305222 (+139348us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:19.382414 (+ 77192us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.289352 (+906938us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.289404 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:20.289448 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.680244 (+1390796us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400231c54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:21.680296 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.680458 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682516,"prepare.queue_time_us":19275,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3561,"raft.queue_time_us":711593,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":21381,"spinlock_wait_cycles":319732992,"thread_start_us":292670,"threads_started":2,"wal-append.queue_time_us":433185,"wal-append.run_cpu_time_us":1396,"wal-append.run_wall_time_us":1021702}
I20260709 13:02:21.674585  6827 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.672794  6580 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:21.717084  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 179043us
W20260709 13:02:21.723898  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 337702us
I20260709 13:02:21.690937  6842 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:21.697732  6877 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.728632  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:21.745967  1541 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.729921  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:21.748173  1539 raft_consensus.cc:2368] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
W20260709 13:02:21.744563  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 191564us
I20260709 13:02:21.676959  6807 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.684975  6696 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.689854  6625 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.751616  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 989) took 2269 ms. Trace:
I20260709 13:02:21.752290  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1976) took 1552 ms. Trace:
I20260709 13:02:21.746713  6842 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.752445  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.771263  1694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 2102) took 1262 ms. Trace:
I20260709 13:02:21.766727  1696 rpcz_store.cc:276] 0709 13:02:19.481950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.482640 (+   690us) service_pool.cc:224] Handling call
0709 13:02:19.482942 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.867482 (+384540us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.867510 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.867551 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:19.867582 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.751352 (+1883770us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540023b754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:21.751399 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.751541 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883937536}
I20260709 13:02:21.766784  1613 rpcz_store.cc:276] 0709 13:02:20.199799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.313549 (+113750us) service_pool.cc:224] Handling call
0709 13:02:20.313883 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:20.400076 (+ 86193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.400144 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:20.831641 (+431497us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b2c00013bb8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f191d3a11 00007f7f191e3372 00007f7f1a915a01 00007f7f1a8da43a 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2
0709 13:02:20.832660 (+  1019us) log.cc:844] Serialized 26 byte log entry
0709 13:02:21.015240 (+182580us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:21.015290 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.015388 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:21.742249 (+726861us) raft_consensus.cc:1685] finished
0709 13:02:21.742277 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.752206 (+  9929us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81841,"raft.queue_time_us":88001,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"spinlock_wait_cycles":11530624,"thread_start_us":145869,"threads_started":1,"wal-append.queue_time_us":302564}
I20260709 13:02:21.680892  6644 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.741384  6814 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:21.772135  1660 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:21.697072  6552 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.741670  6781 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:21.771848  1694 rpcz_store.cc:276] 0709 13:02:20.516402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.857385 (+340983us) service_pool.cc:224] Handling call
0709 13:02:20.858095 (+   710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.858582 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:20.870598 (+ 12016us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.685083 (+814485us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18004c23a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177cfe07 00007f7f2062aab9 00007f7f177ec69b 00007f7f177ea93f 00007f7f177ecc02 00007f7f1a47420b 00007f7f1a479d23 00007f7f1a47a23a 00007f7f1a8e4a2a
0709 13:02:21.770914 (+ 85831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.770974 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:21.771028 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.771092 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.771210 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11718,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2976,"spinlock_wait_cycles":7925632,"thread_start_us":85595,"threads_started":1}
I20260709 13:02:21.779745  1541 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:21.782080  1547 raft_consensus.cc:1240] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:21.726953  6580 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.755535  6860 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:21.792122  6913 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.790493  1660 leader_election.cc:400] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 11 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 11. Current term is 12.
I20260709 13:02:21.799336  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.722572  6891 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.727291  6827 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:21.808467  6869 consensus_meta.cc:287] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.804s	user 0.014s	sys 0.000s
I20260709 13:02:21.812577  6914 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:21.779896  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:21.813112  6914 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:21.808961  6869 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.813648  6914 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.815461  6869 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.815793  6580 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.816810  1688 raft_consensus.cc:2368] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:21.817013  6644 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.780652  6814 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.796200  6917 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:21.824072  6842 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.824434  6917 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:21.824644  6909 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:02:21.824909  6917 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:21.825068  1696 raft_consensus.cc:606] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:21.825712  1696 raft_consensus.cc:614] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:21.832010  6807 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.812474  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.834178  1660 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.835191  1613 raft_consensus.cc:2410] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:02:21.836072  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:21.838114  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 60516.1us
I20260709 13:02:21.841368  1660 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.823983  6827 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.844579  1660 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.787838  6781 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.840570  6869 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:21.850871  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:21.802487  6860 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.854511  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.845261  6627 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:21.859404  6627 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:21.859715  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.859933  6914 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.860713  6781 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.860908  6924 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:21.861315  6924 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.861657  6924 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:21.861742  6806 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:21.862071  6914 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.862200  6806 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:21.863034  6806 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.858333  6851 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.863679  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51302 (request call id 2098) took 1360 ms. Trace:
I20260709 13:02:21.864156  6806 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.864109  1687 rpcz_store.cc:276] 0709 13:02:20.503360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.503492 (+   132us) service_pool.cc:224] Handling call
0709 13:02:20.895720 (+392228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.895960 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:21.175922 (+279962us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.425605 (+249683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.425682 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:21.425755 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.425847 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.863510 (+437663us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540023b4d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:21.863621 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31643,"prepare.queue_time_us":10006,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":242590,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5345,"spinlock_wait_cycles":1029215744,"thread_start_us":508106,"threads_started":2,"wal-append.queue_time_us":393341}
I20260709 13:02:21.866242  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.868116  6854 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.868623  6854 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:21.870010  6792 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 13:02:21.870958  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:21.871136  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:21.871702  2265 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.877300  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.878067  1618 raft_consensus.cc:2368] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:21.878927  6860 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:21.879382  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.880412  6827 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:21.881273  6827 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:21.881557  1619 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:21.881990  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.882647  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:21.882913  6552 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.884658  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:21.885278  1621 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.847910  6807 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:21.887351  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:21.889534  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:21.888640  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.890007  1614 raft_consensus.cc:2376] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15. Re-sending same reply.
I20260709 13:02:21.890115  1613 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.889390  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.891430  1622 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:21.893484  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:21.892016  6730 consensus_meta.cc:287] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 13:02:21.896001  1694 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:21.896541  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.897024  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.898873  1622 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:02:21.900518  1622 pending_rounds.cc:85] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 6
I20260709 13:02:21.900404  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:21.901366  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:21.902364  1622 pending_rounds.cc:107] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:02:21.902796  1622 raft_consensus.cc:2889] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:21.907162  1660 leader_election.cc:400] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:21.907578  1660 leader_election.cc:403] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:21.907410  2265 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:21.893748  6627 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.910473  1614 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:21.910766  6816 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:21.911852  6842 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:21.913187  6842 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:21.913305  6924 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.913885  1621 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:21.914785  6926 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.889647  6807 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.915418  6807 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:21.915588  6926 raft_consensus.cc:3060] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:21.916342  6627 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:21.917338  6857 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:21.881587  6827 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:21.917688  6857 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:21.918110  6885 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.834s	user 0.006s	sys 0.009s
I20260709 13:02:21.918464  6827 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.918977  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:21.919579  1693 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:02:21.910780  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.920449  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:21.921658  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.921620  1661 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.843922  6913 consensus_queue.cc:1048] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:02:21.924505  1613 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:21.925590  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:21.923499  1660 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.858271  6886 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.928858  2257 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:21.933266  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.933465  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.870415  6792 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.930228  6816 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:21.947999  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 67304.4us
I20260709 13:02:21.930747  6860 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.931823  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:21.948469  1660 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:21.950125  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.932030  1693 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:21.934875  6854 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.935688  6625 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.936182  6500 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:21.920724  6870 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:21.924247  6918 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:21.937956  6851 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:21.939074  6810 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.786s	user 0.013s	sys 0.000s
I20260709 13:02:21.939015  6910 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:21.929570  6827 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:21.907721  6917 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.943639  6924 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.927349  6916 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.921001  6857 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.926992  6914 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:21.947801  2259 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 798) took 1455 ms. Trace:
I20260709 13:02:21.955199  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:21.961167  6781 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:21.986030  6781 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.969229  6810 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.961371  6863 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:21.980458  6906 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:21.982781  6655 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.983686  6356 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:21.971200  6851 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:21.984504  6816 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.960270  6861 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:21.961275  6714 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:02:21.985224  6667 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:21.919664  6730 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.976473  2259 rpcz_store.cc:276] 0709 13:02:20.492646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.493042 (+   396us) service_pool.cc:224] Handling call
0709 13:02:20.526663 (+ 33621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.814823 (+288160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:20.814870 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.814928 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:20.815000 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.947544 (+1132544us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54006009d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:21.947603 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.947743 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662007552}
I20260709 13:02:21.989487  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.004151  1621 raft_consensus.cc:2368] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:21.969626  6854 consensus_queue.cc:1048] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:21.995244  6810 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:21.989480  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:21.986464  6781 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:21.999421  6914 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.005407  1511 leader_election.cc:400] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:22.012327  1511 leader_election.cc:403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:21.991765  6500 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.966889  6926 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:22.007647  1620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50342 (request call id 1978) took 1393 ms. Trace:
I20260709 13:02:22.017117  1620 rpcz_store.cc:276] 0709 13:02:20.614482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.098386 (+483904us) service_pool.cc:224] Handling call
0709 13:02:21.103601 (+  5215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.145098 (+ 41497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:21.145126 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.145164 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:21.145192 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.007451 (+862259us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54002cae54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:22.007495 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.007604 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95004544}
I20260709 13:02:22.009864  1661 leader_election.cc:400] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13.
I20260709 13:02:22.016248  1693 raft_consensus.cc:1240] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:21.996464  6932 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:21.993846  6869 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:02:22.017593  6810 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.021673  6927 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.022248  6927 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.024541  6927 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.025581  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51302 (request call id 2105) took 1472 ms. Trace:
I20260709 13:02:22.026005  1688 rpcz_store.cc:276] 0709 13:02:20.553272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.824290 (+271018us) service_pool.cc:224] Handling call
0709 13:02:22.025322 (+1201032us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b540040f954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:22.025514 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2168649088}
I20260709 13:02:22.008247  6905 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:02:22.019217  6914 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.019961  6500 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:21.998592  6655 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.026396  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:22.026738  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:22.028671  6866 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 1.693s	user 0.009s	sys 0.007s
I20260709 13:02:21.995469  6792 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:21.993124  6552 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:02:22.032284  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.033515  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.035573  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:22.061764  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.012130  6675 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:22.062495  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.066901  1539 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.064005  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.068017  1543 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:22.064572  1538 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:22.065898  1545 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:22.065210  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.063712  1622 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 11.
I20260709 13:02:22.070346  1544 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:22.049404  6932 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.074940  6696 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.076143  6917 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.055559  6851 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.065212  6918 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:22.084126  6478 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:22.090781  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:22.090658  6781 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.094125  1621 raft_consensus.cc:1275] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:02:22.097848  1614 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:22.056576  6756 consensus_queue.cc:1059] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:02:22.070549  6632 raft_consensus.cc:3055] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:22.105859  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.102522  6675 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:22.105384  6918 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.107007  6632 raft_consensus.cc:740] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:22.123914  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.124888  1546 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.124178  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.126154  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.127302  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.128641  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.129575  1621 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:22.130311  6696 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.130349  6756 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:22.130945  6696 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.131549  6756 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:22.131188  6932 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.134341  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.136227  6725 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.131946  6756 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:22.144560  6869 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:22.145062  6869 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.145597  6792 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:22.145401  6756 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.146891  6756 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.138794  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.152738  1622 raft_consensus.cc:2410] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:22.141304  1539 raft_consensus.cc:2468] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:22.155949  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.156616  1544 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:22.172569  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 224185us
I20260709 13:02:22.174496  1694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:22.174757  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.175372  1694 raft_consensus.cc:606] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.175415  1622 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.175873  1694 raft_consensus.cc:614] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:22.177014  1661 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.177374  6901 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.177500  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.178097  1621 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.178017  6901 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.180194  6901 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.121949  6500 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.120715  6478 consensus_queue.cc:1048] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:02:22.145419  6869 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.160996  6816 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:22.199975  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.201059  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.205268  1621 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:22.207693  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.208523  1619 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:22.214020  1660 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.220273  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.220888  1616 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.173049  6792 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:22.235400  1544 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:22.236063  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:22.239184  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.239972  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:22.219589  6939 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:22.245518  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.242765  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.206501  6816 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.244316  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.208931  6730 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.223541  6863 raft_consensus.cc:2804] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:22.249567  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.248446  1687 raft_consensus.cc:2368] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:22.252980  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.268567  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:22.256075  1616 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:22.243822  6667 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:22.271749  6857 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.272192  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:22.272974  1692 raft_consensus.cc:3060] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:22.248109  6580 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:22.275899  1690 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:22.277124  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.280453  6785 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.286051  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.288715  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.237774  6927 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.278280  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.254321  6664 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.309561  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.249771  6816 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.326056  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.326155  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.300848  1692 raft_consensus.cc:2468] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:22.296725  6863 raft_consensus.cc:697] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.248505  6913 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:22.298280  6810 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:22.363373  1587 leader_election.cc:400] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:22.363713  1587 leader_election.cc:403] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:22.233090  6918 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.300197  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.367862  1687 raft_consensus.cc:2468] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:22.219825  6675 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.287333  6655 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.345778  1546 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:22.309537  6781 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.328806  6901 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.353453  6725 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:22.354969  6911 log.cc:927] Time spent T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.744s	user 0.006s	sys 0.000s
I20260709 13:02:22.356954  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.357699  6869 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.350505  6863 consensus_queue.cc:237] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.313977  6807 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.361068  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:22.325377  6664 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.368139  1587 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.366753  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.334129  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.379966  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.410439  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.411223  1546 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:22.412258  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.413553  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.382376  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:22.414546  1687 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.374410  6785 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 14. Current term is 15.
I20260709 13:02:22.239354  6632 consensus_queue.cc:260] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.392885  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.422400  1544 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:22.423628  1696 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.312196  6927 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.407279  1693 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:22.403699  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.372499  6625 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:22.407954  1542 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:22.419175  1694 raft_consensus.cc:2410] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:22.330533  1622 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:22.426534  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.428527  1695 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:02:22.433265  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.400367  6814 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.434823  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:22.403611  6891 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.435477  1538 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:22.438407  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.445273  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.445343  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.438723  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:22.452584  1687 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:22.463421  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.464432  1620 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 16.
I20260709 13:02:22.399843  6901 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.475076  1693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7316b60a2ea04a109142470c7a827717"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:22.479988  1693 raft_consensus.cc:606] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.463220  6814 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:22.487320  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.489353  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.490216  1544 raft_consensus.cc:3060] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.464656  6785 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:02:22.503454  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.504805  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.509064  6664 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.443920  6625 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.519793  6625 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.525121  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.526242  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.526934  1543 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:22.527166  1544 raft_consensus.cc:2468] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:22.523823  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.463384  6806 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:22.537348  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 169283us
W20260709 13:02:22.539471  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.527590  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.541379  1543 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:22.541319  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:22.523157  6944 log.cc:927] Time spent T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:22.486153  6814 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.473078  6792 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:22.544037  1543 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:22.546414  1538 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:22.547164  1543 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.544466  1542 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:22.522821  6949 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:22.589483  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 1.75138e+06us
I20260709 13:02:22.590438  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.596903  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.599857  6827 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:22.567431  6792 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.603555  6792 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.604720  6854 raft_consensus.cc:3055] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:22.605134  6854 raft_consensus.cc:740] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:22.609877  6869 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.610455  6828 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.559028  6806 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.612222  6806 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.616871  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.626158  6655 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:22.626446  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:22.626991  6655 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:22.627132  1695 raft_consensus.cc:606] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.627640  1695 raft_consensus.cc:614] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:22.628183  6655 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.628897   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:22.629285  2263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 799) took 2136 ms. Trace:
I20260709 13:02:22.632948  1512 leader_election.cc:400] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:22.629612  2263 rpcz_store.cc:276] 0709 13:02:20.493023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.493176 (+   153us) service_pool.cc:224] Handling call
0709 13:02:20.828492 (+335316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.828697 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:21.128476 (+299779us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.858606 (+730130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.858676 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:21.858720 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.858782 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:22.629099 (+770317us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54007828d0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:22.629212 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":471135,"prepare.queue_time_us":296679,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":479389,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":75,"spinlock_wait_cycles":768737024,"thread_start_us":518171,"threads_started":2,"wal-append.queue_time_us":542632}
I20260709 13:02:22.594995  6807 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.606038  6854 consensus_queue.cc:260] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:22.641258  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 100065us
I20260709 13:02:22.655936  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.657482  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.646353  6953 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:22.647738  6950 log.cc:927] Time spent T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:02:22.622033  6891 raft_consensus.cc:2764] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:02:22.664451  6953 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.619802  6886 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.663096  6827 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:22.663980  6941 log.cc:927] Time spent T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 13:02:22.667297  6949 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.673098  1621 raft_consensus.cc:1275] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:22.675510  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.676605  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.659472  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:22.679262  1587 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.680493  2261 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:22.683455  1587 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:22.685019  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.686188  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42620 (request call id 807) took 1300 ms. Trace:
I20260709 13:02:22.691679  2260 rpcz_store.cc:276] 0709 13:02:21.375634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.375737 (+   103us) service_pool.cc:224] Handling call
0709 13:02:22.675881 (+1300144us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54003a4654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:22.676008 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191220608}
I20260709 13:02:22.662349  6696 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.688796  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.689680  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.693833  1587 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:22.695708  1543 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.697407  6901 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.698716  6792 consensus_queue.cc:1048] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:22.698904  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.699383  2264 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:22.699517  6814 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:22.688534  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.690137  6828 raft_consensus.cc:2804] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:22.700238  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.695405  6580 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.700930  1538 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.688504  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.701092  6927 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.689982  6827 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.708233  1547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2387) took 1236 ms. Trace:
I20260709 13:02:22.708649  1547 rpcz_store.cc:276] 0709 13:02:21.471618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:21.471757 (+   139us) service_pool.cc:224] Handling call
0709 13:02:21.472019 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:21.782655 (+310636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:22.707950 (+925295us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b540003b954. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:22.708170 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712571776}
I20260709 13:02:22.687671  6949 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:22.709549  6949 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.709936  6949 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.713277  6953 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.713935  6854 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:22.717958  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:22.719249  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.719408  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:22.719911  2260 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:22.720846  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.720935  6927 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:22.721998  6927 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:22.722036  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.722474  6927 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:22.723258  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.723374  6927 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.724839  6927 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.729025  1538 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:22.730023  6632 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.731432  6924 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:22.732365  6877 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:22.733364  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:22.782722  6877 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:22.783136  2258 raft_consensus.cc:2393] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 17: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:22.734753  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.783861  6877 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:22.784309  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 49670.8us
I20260709 13:02:22.785082  6877 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:22.738575  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.787207  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.788364  6914 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:02:22.741839  6957 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:22.742642  1619 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:22.743374  1615 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:02:22.798244  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 104503us
I20260709 13:02:22.745875  1511 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:22.754384  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.757398   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:22.758344  1442 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:22.752121  6816 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.771265  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.775756  1543 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:22.801915  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:22.801729  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47430.1us
W20260709 13:02:22.801393  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55616.9us
I20260709 13:02:22.805580  1546 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:22.822355  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:22.821550  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.809763  6886 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:22.808964  6785 raft_consensus.cc:2804] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:22.833997  6781 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:22.843171  6781 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.843696  6781 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:22.831717  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.814204  6827 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.802681  6828 raft_consensus.cc:697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:22.807971  6696 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:22.806212  6816 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.850912  1691 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:22.855855  1542 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:22.859707  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 57876.2us
I20260709 13:02:22.861143  1587 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.862602  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.863515  1622 raft_consensus.cc:2410] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:02:22.863935  6886 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:22.867839  6886 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.871012  6955 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.880649  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.883262  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.883906  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
W20260709 13:02:22.884389  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.885547  1542 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:22.885825  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.889433  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.890224  1543 raft_consensus.cc:2376] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14. Re-sending same reply.
I20260709 13:02:22.892975  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:22.894650  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:22.897581  1542 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:22.895596  1661 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.902534  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.848043  6696 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:22.907760  1587 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:22.908648  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.913121  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:22.913849  1615 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:22.916263  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:22.918442  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.920162  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.875407  6810 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:22.927099  2261 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:22.875077  6785 raft_consensus.cc:697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:22.930122  2231 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.936911  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.938426  1542 raft_consensus.cc:2468] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:22.941699  1511 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:22.942205  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:22.865614  6827 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:22.944032  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.921563  6730 raft_consensus.cc:2804] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:22.922225  6696 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:22.911167  6955 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.925380  6953 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.940547  6870 consensus_queue.cc:1059] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:02:22.971604  6870 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:22.971418  6785 consensus_queue.cc:237] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.972004  6870 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.972855  6870 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.952770  6964 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:22.931797  6901 consensus_queue.cc:1059] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:02:22.953050  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.930457  6806 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:22.941798  6756 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:22.967147  6958 log.cc:927] Time spent T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:02:22.949268  6816 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:22.960106  6828 consensus_queue.cc:237] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:22.975837  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:22.943432  6492 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.932346  6956 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:02:22.946280  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:22.977875  6580 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:22.947044  6478 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:02:22.985148  6806 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:22.987968  6827 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:22.974581  6730 raft_consensus.cc:697] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:22.954020  6945 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:02:22.979537  6644 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:22.976581  6714 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:22.973968  6500 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:22.991168  6949 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.029691  6956 consensus_queue.cc:1243] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:02:23.035470  2258 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:23.006067  6632 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.033026  6664 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.028244  6725 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.045375  6781 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.072625  6949 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:23.123464  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.003698  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:23.129925  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 126139us
I20260709 13:02:23.136410  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:23.043056  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 97719us
W20260709 13:02:23.024935  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 79302.8us
W20260709 13:02:23.152208  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 208155us
I20260709 13:02:23.150377  1661 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.156751  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.160519  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.160705  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.161839  1691 raft_consensus.cc:2393] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:23.162387  1694 raft_consensus.cc:2393] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:23.163115  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.173466  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.175830  6625 raft_consensus.cc:2804] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:23.176771  6632 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.063274  6730 consensus_queue.cc:237] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.181540  6828 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.182667  6625 raft_consensus.cc:697] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:23.055851  6664 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.196965  1541 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:02:23.207374  6664 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:23.065308  6806 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.200659  6949 consensus_queue.cc:1059] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:02:23.201920  1541 pending_rounds.cc:85] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 10
I20260709 13:02:23.206249  6781 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.222874  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:23.235118  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 81668.1us
I20260709 13:02:23.182963  6632 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:23.236927  6655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.007s	sys 0.003s
I20260709 13:02:23.237296  6696 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.219389  1541 pending_rounds.cc:107] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:02:23.244300  6870 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.244089  6945 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:23.249140  6814 raft_consensus.cc:3055] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:23.249652  6814 raft_consensus.cc:740] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:23.253830  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:23.259824  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:23.260882  1616 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
W20260709 13:02:23.263161  6973 log.cc:927] Time spent T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:02:23.278124  6632 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:23.239248  1541 raft_consensus.cc:2889] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:23.284143  1692 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
W20260709 13:02:23.280886  6655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.003s
I20260709 13:02:23.303527  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:23.304360  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 168352us
I20260709 13:02:23.305585  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.305823  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:23.311662  1442 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 10, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.335758  1616 raft_consensus.cc:1240] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:02:23.306684  6356 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.339429  6926 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:23.352077  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.354100  6872 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.355947  6872 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.352573  6632 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:23.360441  6696 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.366137  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.369305  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:23.369585  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 63980.5us
I20260709 13:02:23.369943  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:23.293718  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 226154us
I20260709 13:02:23.370690  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.371592  6872 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:23.352692  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47253.4us
I20260709 13:02:23.371991  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.372745  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.332427  6877 raft_consensus.cc:3055] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:23.322870  6478 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.380005  6877 raft_consensus.cc:740] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:02:23.387125  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 47246.9us
W20260709 13:02:23.388046  1444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 339) took 33525 ms (client timeout 15000 ms). Trace:
I20260709 13:02:23.395718  6918 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:23.403524  6976 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.414501  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:23.416054  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 45637.7us
I20260709 13:02:23.417127  2231 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.419788  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.420778  1689 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:23.422503  1442 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 10, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.424482  6625 consensus_queue.cc:237] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.426295  1688 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:23.427309  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.422207  6912 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.425016  1442 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:23.452857  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.457425  1442 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:23.459394  1442 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.463200  1618 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:23.449424  6664 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:23.466329  6664 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:23.460978  1442 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 10, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:23.388541  1444 rpcz_store.cc:269] 0709 13:01:49.862554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.862773 (+   219us) service_pool.cc:224] Handling call
0709 13:02:23.387768 (+33524995us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:10.550213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:10.942985 (+392772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:10.951908 (+  8923us) write_op.cc:435] Acquired schema lock
0709 13:02:10.951939 (+    31us) tablet.cc:662] Decoding operations
0709 13:02:11.116235 (+164296us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:11.116301 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:11.116331 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:02:11.117702 (+  1371us) tablet.cc:701] Row locks acquired
0709 13:02:11.117724 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:11.117867 (+   143us) write_op.cc:270] Start()
0709 13:02:11.118104 (+   237us) write_op.cc:276] Timestamp: P: 1783602131117823 usec, L: 0
0709 13:02:11.118131 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:02:11.123196 (+  5065us) log.cc:844] Serialized 7466 byte log entry
0709 13:02:13.081219 (+1958023us) op_driver.cc:464] REPLICATION: finished
0709 13:02:13.860957 (+779738us) write_op.cc:301] APPLY: starting
0709 13:02:13.873098 (+ 12141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.264920 (+391822us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.273638 (+  8718us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:14.541581 (+267943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:14.541986 (+   405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:02:14.542049 (+    63us) write_op.cc:312] APPLY: finished
0709 13:02:14.542606 (+   557us) log.cc:844] Serialized 172 byte log entry
0709 13:02:14.663885 (+121279us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.851063 (+187178us) write_op.cc:454] Released schema lock
0709 13:02:14.851184 (+   121us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:14.851921 (+   737us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.851963 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1445694,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":763298,"apply.run_cpu_time_us":52037,"apply.run_wall_time_us":1000453,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83509,"num_ops":19,"prepare.queue_time_us":639453,"prepare.run_cpu_time_us":30980,"prepare.run_wall_time_us":897292,"raft.queue_time_us":821821,"raft.run_cpu_time_us":57275,"raft.run_wall_time_us":792846,"replication_time_us":1962781,"thread_start_us":2073604,"threads_started":5,"wal-append.queue_time_us":607059,"wal-append.run_cpu_time_us":47443,"wal-append.run_wall_time_us":3364572}]]}
I20260709 13:02:23.467557  6664 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.475236  2261 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:23.479499  1616 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:23.474805  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:23.463217  6828 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:23.469079  1442 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 2 to 10, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.484937  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.486930  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.489583  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:23.486955  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:23.495628  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.501468  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:23.505017  1692 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:23.492810  6969 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:02:23.499151  6926 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.513276  6915 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.513167  6926 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.513936  6915 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.515643  6807 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:23.516512  6807 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.520618  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:23.521328  6926 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.523805  6552 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:23.524374  6552 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:23.524801  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.525349  6552 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.525815  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.526369  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.527280  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.522204  1442 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 14, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.530799  1622 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
W20260709 13:02:23.538825  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49468.4us
I20260709 13:02:23.542335  6478 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.542784  6872 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.543061  6478 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.543524  6478 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.553201  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.551469  6912 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:23.563792  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.564209  1442 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 11, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.565547  6915 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:23.556649  6926 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:23.565994  1442 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 8 to 10, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.577612  1690 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:23.578552  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47182.8us
W20260709 13:02:23.579218  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92365.9us
I20260709 13:02:23.608593  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:23.611629  1690 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.618309  1687 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:23.618394  6912 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:23.620697  6912 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.624426  6877 consensus_queue.cc:260] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.610975  6926 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.629899  6926 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.637219  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.640689  2263 raft_consensus.cc:2393] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:23.651321  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:23.644521  1442 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 9, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.654484  6877 raft_consensus.cc:3060] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:23.664531  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.667338  1691 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 16.
I20260709 13:02:23.671902  6814 consensus_queue.cc:260] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.671749  1442 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 9, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:23.673053  6814 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.674150  1442 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 9, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:23.680763  6985 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260709 13:02:23.681404  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:23.687668  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.695027  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:23.696027  6872 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.696460  6872 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.696848  6872 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:23.697633  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:23.699319  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:23.699909  6625 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:23.702370  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.703460  2264 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:23.705191  6828 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:23.700138  1616 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:23.705711  6828 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:23.702570  6625 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:23.708231  6987 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:23.717613  1690 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:23.720224  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.716459  1442 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 6 to 11, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:23.715826  6625 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.734766  6730 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.736588  6730 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.731473  6356 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:02:23.751307  6356 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:02:23.751669  6356 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:23.752755  6969 consensus_queue.cc:1059] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:23.753672  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.754840  6872 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.752616  6356 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.754400  1541 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:23.746343  6632 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:23.758826  1442 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.762179  6785 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:23.763144  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:23.764361  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.764634  6356 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:23.765096  1544 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:23.762493  1442 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:23.762892  6785 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.770902  6730 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.771052  6655 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.771519  6785 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.771628  6655 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.773126  6872 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:23.753715  6969 raft_consensus.cc:3055] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:23.778411  6969 raft_consensus.cc:740] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:23.779587  6969 consensus_queue.cc:260] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.780869  6969 raft_consensus.cc:3060] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:23.784233  6984 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.232s	user 0.002s	sys 0.000s
W20260709 13:02:23.777509  6981 log.cc:927] Time spent T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.238s	user 0.000s	sys 0.002s
I20260709 13:02:23.777377  1619 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:23.792486  1690 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:02:23.786697  6989 log.cc:927] Time spent T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:02:23.770918  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.829115  1691 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:23.807917  6918 consensus_queue.cc:1059] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:02:23.839926  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 69234.8us
I20260709 13:02:23.844254  6807 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:23.798389  6478 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.851087  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.851819  6696 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.852659  1544 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
W20260709 13:02:23.859992  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68142.4us
I20260709 13:02:23.841959  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.861429  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:23.867249  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:23.883015  1619 raft_consensus.cc:2393] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:23.886591  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44961.3us
I20260709 13:02:23.894191  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.895452  6478 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:23.895828  6814 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.896302  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.897324   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:23.898736  6828 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.901095  6828 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:23.903156  6696 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.903941  1544 raft_consensus.cc:1240] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:23.906965  6781 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:23.907543  6781 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.909662  6781 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:23.910168  6781 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:23.911540  1539 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:02:23.911769  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.913411  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.914846  6696 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:23.915060  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.915727  6696 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:23.918047  6806 raft_consensus.cc:3055] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:23.918756  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.919852  6810 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.891342  6891 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:23.920701  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.889133  6926 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:23.921562  6891 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.923388  6655 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:23.924887  1541 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:23.915779  1547 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:23.926388  1538 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:23.927448  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:23.918467  6806 raft_consensus.cc:740] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:23.928850  6806 consensus_queue.cc:260] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.930291  6806 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:23.939559  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.938511  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.932261  1538 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:02:23.943118  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:23.950194  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.989885  1547 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
W20260709 13:02:23.990764  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66368.5us
I20260709 13:02:23.991729  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:23.952196  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 61198.4us
I20260709 13:02:23.994414  1585 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:23.995012  6891 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:23.995858  6828 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:23.954969  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 56231.7us
W20260709 13:02:23.958820  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.998984  1660 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.001679  6857 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:24.003212  2259 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:24.005506  6945 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:24.006553  6870 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:23.951432  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:24.008634  1620 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.009138  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:24.011981  6918 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.012444  6918 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.012836  6918 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.016326  6625 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:24.017302  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:23.970304  1691 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:24.018359  6810 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:23.963891  6912 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:23.979993  1545 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:23.944938  1539 raft_consensus.cc:1275] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:23.987445  6807 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:23.990830  6814 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:23.938838  6781 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:23.973214  1619 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:23.977842  1543 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:24.039186  1620 raft_consensus.cc:2468] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:24.042697  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:24.047125  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:24.049587  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 67912.2us
I20260709 13:02:24.052795  1619 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:24.053164  6664 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:24.054489  6356 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:24.054286  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.055003  6356 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:24.047547  1540 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:24.056608  2230 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:24.062569  2260 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:24.064069  2263 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:24.039130  6814 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.067617  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:24.077970  1585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.079588  6671 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.080159  6671 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:24.082232  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 87674.4us
I20260709 13:02:24.069530  6814 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.067152  6632 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:24.089110  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 43673.8us
W20260709 13:02:24.111850  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 69331.8us
I20260709 13:02:24.077126  6976 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:24.082377  6671 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.122426  6861 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.123250  6861 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.124421  6860 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:24.125587  6995 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:24.126008  6861 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:24.126205  6995 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.131944  6828 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.133071  6932 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:02:24.135283  6781 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.137948  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.146809  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.116572  6891 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.150797  6970 raft_consensus.cc:2804] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:24.151039  6478 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.151479  6970 raft_consensus.cc:697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:24.151741  6478 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.152514  6970 consensus_queue.cc:237] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.154172  6478 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:24.162386  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.088289  6356 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.175206  6356 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.114166  6655 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:24.185205  6810 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:24.203579  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 84667.9us
W20260709 13:02:24.235872  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 132150us
I20260709 13:02:24.219022  6644 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:24.238372  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:24.187692  6995 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:24.240945  6644 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:24.277470  6997 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:02:24.241403  6912 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:24.286828  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 168152us
I20260709 13:02:24.292038  1621 raft_consensus.cc:1240] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:24.292719  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54447us
W20260709 13:02:24.295089  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.301143  6644 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:24.320292  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 330791us
I20260709 13:02:24.320663  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:24.320571  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 264040us
I20260709 13:02:24.324146  2260 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:24.325219  7005 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:02:24.326213  7005 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:24.326565  7005 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:24.327523  7005 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.328806  7005 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.332446  6644 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.345749  6632 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.346341  6632 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.348480  6632 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:24.350829  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 279197us
I20260709 13:02:24.364852  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:24.365540  2257 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:24.368266  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:24.368779  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:24.369374  1696 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:24.370342  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:24.377223  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.360628  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:24.394094  1621 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:24.350802  6995 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:24.395538  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.363224  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.301468  6785 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:24.400820  1511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.408383  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:24.408993  1540 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:24.363075  6807 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:02:24.405892  6644 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:24.411918  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 68558.6us
I20260709 13:02:24.409710  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:24.410753  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.415818  1690 raft_consensus.cc:1275] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:24.417534  1621 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:24.419104  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:24.392714  6828 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:02:24.409235  6785 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:24.420745  6785 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.402994  6995 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.421471  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:24.421936  6995 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.427347  6655 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:24.428138  6655 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.428612  6655 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.429323  7007 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:24.392673  6994 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:02:24.428587  1540 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:24.434950  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:24.350482  6872 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:02:24.272835  6891 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.419976  1544 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.430750  6655 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.441535  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.441947  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:24.442221  1696 raft_consensus.cc:1275] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:24.443149  1614 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 11.
I20260709 13:02:24.447607  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:24.448458  1694 raft_consensus.cc:3060] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.454833  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:24.451387  6644 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:24.389555  6810 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:02:24.449790  6857 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:24.451534  6655 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:24.481745  6857 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.483436  2230 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:24.468703  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:24.466437  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.478904  1696 raft_consensus.cc:1275] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:02:24.492527  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48587.5us
I20260709 13:02:24.504170  1691 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
W20260709 13:02:24.523355  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 183216us
I20260709 13:02:24.525108  1613 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:24.517951  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 141584us
I20260709 13:02:24.507809  6969 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:24.538354  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:24.541728  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 54737.4us
W20260709 13:02:24.543422  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 77098.6us
I20260709 13:02:24.544524  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.546828  6932 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.547210  6932 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.547544  6932 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.547575  6857 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:24.547910  6915 consensus_queue.cc:1048] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:24.548292  6857 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:24.548657  6857 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:24.549075  6857 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:24.550767  6828 consensus_queue.cc:1048] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:02:24.548795  6696 raft_consensus.cc:3055] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:24.552222  6696 raft_consensus.cc:740] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:24.552420  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:24.553537  6632 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:24.553963  6632 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:24.554330  6632 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:24.556223  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:24.529886  6872 consensus_queue.cc:1048] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:24.559751  7014 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:02:24.536182  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.562382  6891 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.536854  7022 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:24.533015  6994 consensus_queue.cc:1048] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:24.568723  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:24.569494  6918 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 13:02:24.569972  6918 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.576520  1585 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.483273  7007 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:02:24.486402  6644 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:24.582106  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.584131  1544 raft_consensus.cc:2468] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:24.579962  1691 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:24.586884  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.587459  1587 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.600129  1545 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:24.574934  6969 raft_consensus.cc:493] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.518839  6972 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:02:24.602192  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:24.585410  7016 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:02:24.609530  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:24.610910  1538 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:24.610134  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:24.584021  6994 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.573917  6995 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.624493  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:24.625288  1540 raft_consensus.cc:2410] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:02:24.607451  6969 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:24.629388  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.627822  1694 raft_consensus.cc:2468] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:24.631304  1543 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:24.607929  6872 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:24.631358  1544 raft_consensus.cc:1275] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:24.607601  6807 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.639302  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 63926us
I20260709 13:02:24.639586  1620 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:24.640413  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.641520  6810 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.642445  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.655470  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:24.659104  1660 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:24.631206  6828 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:24.639191  6995 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:24.622715  6806 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:24.667632  2259 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:02:24.678470  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54055us
I20260709 13:02:24.647922  6872 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:24.696414  1587 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:24.644958  6891 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:24.670852  6994 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:02:24.710114  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53939.4us
W20260709 13:02:24.711848  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 45934.4us
I20260709 13:02:24.693614  7007 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.648159  6807 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.667140  6552 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:02:24.721839  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:24.707604  6918 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:24.709828  7022 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.733799  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:24.735070  7017 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:24.739221  6644 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.719808  6995 raft_consensus.cc:2804] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:24.744329  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 101949us
I20260709 13:02:24.752143  1614 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
W20260709 13:02:24.731536  6814 consensus_meta.cc:287] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.001s
I20260709 13:02:24.711058  6828 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:24.765728  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 108115us
I20260709 13:02:24.771082  6807 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:24.771631  6814 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.773468  6857 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.778896  7003 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:24.765668  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 69389.2us
I20260709 13:02:24.784032  1542 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:24.799986  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.803942  1687 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:24.796082  1587 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:24.733040  6891 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:02:24.817521  6891 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:24.768360  6995 raft_consensus.cc:697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:24.818054  6891 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.796787  7003 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.818352  6857 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:24.818558  6891 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.818962  6995 consensus_queue.cc:237] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.820340  7003 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:24.820968  6891 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:24.821676  7031 raft_consensus.cc:2804] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:24.822073  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:24.822242  7031 raft_consensus.cc:697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:24.822741  2259 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:24.816215  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.823423  7031 consensus_queue.cc:237] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.824213  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:24.825203  7022 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:24.825930  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:24.839622  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.840968  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:24.844697  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 132020us
W20260709 13:02:24.844942  7032 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:24.856827  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:24.858100  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:24.788919  6932 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.827597  6918 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:24.825624  7022 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.814843  7019 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:24.798754  6807 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:02:24.866012  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 49891us
I20260709 13:02:24.841956  6814 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:24.827273  7007 consensus_queue.cc:1059] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:24.874791  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:24.881525  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.884164  1696 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:02:24.903849  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:24.904954  1540 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:24.907065  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:24.866123  6655 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:24.869907  7022 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:24.911036  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:24.951004  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 138843us
I20260709 13:02:24.878132  7019 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:24.842517  6872 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:24.966315  6994 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:24.967051  6994 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:24.968801  6870 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:24.951638  7025 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:02:25.041921  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.963429  7008 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.005s
I20260709 13:02:25.079404  1540 raft_consensus.cc:2468] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 18.
I20260709 13:02:24.955631  6918 consensus_queue.cc:1048] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.128s
W20260709 13:02:25.078890  7033 log.cc:927] Time spent T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:02:24.960537  7003 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 13:02:25.096800  7037 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.232s	user 0.000s	sys 0.003s
I20260709 13:02:25.080966  6870 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:25.177050  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 205424us
I20260709 13:02:25.176452  6972 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.183988  6972 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:25.185737  6785 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.001s
I20260709 13:02:25.186142  6972 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.137148  6644 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:25.225756  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 323086us
I20260709 13:02:25.228431  1587 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:25.158699  6870 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.235809  7038 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:25.236599  7041 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:02:25.237306  7049 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:02:25.237865  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.238570  7044 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:25.249989  7027 log.cc:927] Time spent T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.518s	user 0.007s	sys 0.003s
I20260709 13:02:25.251677  6945 raft_consensus.cc:3055] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:25.191787  7036 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.373s
W20260709 13:02:25.276199  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 365289us
I20260709 13:02:25.186182  6785 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.278260  1546 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 16: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:25.260322  6932 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.287599  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.290755  7054 raft_consensus.cc:2804] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:25.292379  6915 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:25.293429  6915 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.295814  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:25.296536  1546 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.297816  6915 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.274700  6945 raft_consensus.cc:740] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:25.298769  6632 consensus_meta.cc:287] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.002s
I20260709 13:02:25.299229  6632 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:25.284538  6969 consensus_meta.cc:287] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.006s
I20260709 13:02:25.299302  6945 consensus_queue.cc:260] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.285064  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:25.307471  1545 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:25.307358  2259 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:25.317902  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:25.322662  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 115039us
I20260709 13:02:25.325868  7054 raft_consensus.cc:697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:25.331498  1695 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
W20260709 13:02:25.341993  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.341892  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:25.343758  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.283546  7044 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.347335  7044 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.348120  7018 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:02:25.349107  1617 raft_consensus.cc:1240] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:25.284046  7038 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.337813  6785 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.351903  1689 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 19.
I20260709 13:02:25.352397  7038 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.349963  7022 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.357581  6632 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.358264  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.359011  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:25.361572  6870 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:25.320940  6969 raft_consensus.cc:515] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.363382  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.334218  6696 consensus_queue.cc:260] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.366927  6664 raft_consensus.cc:3055] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:25.375572  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:25.380419  1546 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:25.382957  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:25.385615  7067 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.390131  7010 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:25.379431  7038 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:25.392658  6969 leader_election.cc:290] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:25.394006  1614 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
W20260709 13:02:25.403105  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47058.4us
I20260709 13:02:25.406540  7010 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.406827  7067 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.406564  7038 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.393764  6664 raft_consensus.cc:740] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:25.412864  1545 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:25.424712  1618 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.386003  6994 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:25.411966  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 76880us
I20260709 13:02:25.411270  1614 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:25.337370  7054 consensus_queue.cc:237] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.400318  6552 consensus_queue.cc:1059] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:02:25.460351  7070 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:25.461448  7067 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.461113  7070 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.467726  7070 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.476323  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:25.462968  7044 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:25.485075  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:25.485152  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:25.460441  6664 consensus_queue.cc:260] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.465898  6994 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:25.490208  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.490149  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:25.493410  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:25.499852  1621 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.474373  6552 consensus_queue.cc:1243] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:25.499758  1615 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:25.505625  7072 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.512528  6945 raft_consensus.cc:3060] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.512399  7072 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.508244  7022 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.508803  7019 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.511086  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:25.516745  7010 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:25.500486  7044 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.510382  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43624 (request call id 1031) took 1141 ms. Trace:
I20260709 13:02:25.518224  1687 rpcz_store.cc:276] 0709 13:02:24.368744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.370078 (+  1334us) service_pool.cc:224] Handling call
0709 13:02:25.510170 (+1140092us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54004547d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:25.510292 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625799424}
I20260709 13:02:25.488014  6969 consensus_queue.cc:1059] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:02:25.520485  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56132 (request call id 2759) took 1113 ms. Trace:
I20260709 13:02:25.522990  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:25.523813  2261 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
I20260709 13:02:25.525336  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:25.521237  1542 rpcz_store.cc:276] 0709 13:02:24.407342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.407492 (+   150us) service_pool.cc:224] Handling call
0709 13:02:25.520252 (+1112760us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400107054. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:25.520406 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781831552}
I20260709 13:02:25.543787  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:25.544613  2260 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:25.520490  7072 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.567688  7038 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.569576  1696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 1037) took 1003 ms. Trace:
I20260709 13:02:25.570006  1696 rpcz_store.cc:276] 0709 13:02:24.566129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.566258 (+   129us) service_pool.cc:224] Handling call
0709 13:02:24.566535 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.884753 (+318218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.569307 (+684554us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54002f4ed4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:25.569517 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729881856}
I20260709 13:02:25.571426  7079 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:25.571944  7079 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.572315  7079 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:25.574633  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:25.575445  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:25.576798  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:25.577639  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:25.578806  7044 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.579536  7023 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:25.579929  7023 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:25.580489  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:25.581472  2261 raft_consensus.cc:2393] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:25.580900  7023 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:25.591197  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:25.591821  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.593181  6828 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:25.594326  7068 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.595072  7068 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.598543  7068 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:25.616863  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 134556us
I20260709 13:02:25.624658  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:25.624936  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.587221  7023 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:25.633179  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 200957us
I20260709 13:02:25.633567  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.633826  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:25.637638  1621 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:25.643604  2260 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:25.646891  1696 raft_consensus.cc:2393] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 12: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:25.623266  6860 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:25.648870  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 194794us
I20260709 13:02:25.656908  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:25.657881  1693 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:25.660250  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.660883  1690 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:25.632314  6872 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:25.657161  1510 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:25.632165  6969 consensus_queue.cc:1243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:02:25.663960  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.667816  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.665280  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:25.674975  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.677541  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.676260  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.683466  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:25.685794  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 53688.2us
I20260709 13:02:25.687963  1696 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 19: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:25.695855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:25.765120  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.765923  1545 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:25.766885  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.767037  7073 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:25.767593  7073 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:25.771531  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:25.773658  1545 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:25.766314  7064 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:25.768963  7086 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.832860  1544 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:25.859668  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:25.780692  1540 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:25.790793  1688 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:25.860993  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2326) took 1314 ms. Trace:
I20260709 13:02:25.875224  7077 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.224s
I20260709 13:02:25.875581  7085 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.194s
I20260709 13:02:25.875946  7012 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:25.768687  7095 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
W20260709 13:02:25.902581  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.678756  6872 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.891692  1617 rpcz_store.cc:276] 0709 13:02:24.520609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.520726 (+   117us) service_pool.cc:224] Handling call
0709 13:02:24.539508 (+ 18782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.349569 (+810061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.835051 (+485482us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54002b70d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:25.835304 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1750511360}
I20260709 13:02:25.920204  1544 raft_consensus.cc:1217] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 13.11->[15.12-15.12]   Dedup: 15.12->[]
W20260709 13:02:25.875227  7015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.010s	sys 0.014s
I20260709 13:02:25.968736  1544 raft_consensus.cc:1240] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:02:25.876454  7038 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.969209  6810 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:25.768693  7073 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.968560  7012 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:25.968923  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:25.966430  2231 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34175 timed out after 1.772s (SENT) [suppressed 8 similar messages]
I20260709 13:02:25.906587  7079 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.876991  7064 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:25.975188  7015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.235s	user 0.011s	sys 0.014s
I20260709 13:02:25.986429  1540 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:25.972347  7086 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:25.995932  7064 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.996865  7086 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:25.998777  6810 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.002765  1538 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:26.003549  1693 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:26.008435  1540 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 11. Current term is 13. Ops: []
I20260709 13:02:25.975627  7038 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:26.014137  1513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.033625  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 364750us
I20260709 13:02:26.038682  7018 raft_consensus.cc:3055] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:26.039310  7018 raft_consensus.cc:740] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:26.040447  7018 consensus_queue.cc:260] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.042094  7018 raft_consensus.cc:3060] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:26.069398  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.020694  6810 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.078483  1544 raft_consensus.cc:1240] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:02:26.023150  6828 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:26.070859  7020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.013s	sys 0.040s
I20260709 13:02:26.070837  6918 raft_consensus.cc:493] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:26.091342  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:26.092092  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.092412  1545 raft_consensus.cc:1240] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:26.065307  7070 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.110772  6644 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.111105  7070 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.111362  6644 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.068176  6807 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.096489  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:26.113293  6644 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.101181  7079 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.102609  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:26.113576  6807 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.114127  1545 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.104673  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:26.105432  7038 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.106508   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.107640  7012 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:26.118486  1541 raft_consensus.cc:2393] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 14: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:26.115285  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:26.120380  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 433136us
W20260709 13:02:26.096920  7020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.367s	user 0.013s	sys 0.040s
I20260709 13:02:26.129981  2264 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 19.
W20260709 13:02:26.182497  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 52052.2us
I20260709 13:02:26.113293  7070 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.098121  6828 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.189100  7038 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.131177  6918 raft_consensus.cc:515] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:26.225633  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 259241us
I20260709 13:02:26.237120  1545 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:26.244966  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.257941  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:26.263381  1693 raft_consensus.cc:3060] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:26.261546  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.265496  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.266499  1545 raft_consensus.cc:2393] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:02:26.239202  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 44731.9us
I20260709 13:02:26.268492  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.270943  7038 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.273116  7038 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.274127  7038 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:26.223109  7054 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:26.275027  7054 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.276201  6828 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.276889  7054 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.278331  1541 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:26.279855  1693 raft_consensus.cc:2468] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
W20260709 13:02:26.282202  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 185857us
I20260709 13:02:26.282990  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:26.277208  6807 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:26.262470  6995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.438s	user 0.027s	sys 0.049s
I20260709 13:02:26.225324  7070 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:26.274461  7038 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:26.294967  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.289323  6644 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:26.312170  7038 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:26.312563  6644 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.298823  7111 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.314160  7111 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:26.315691  7103 log.cc:927] Time spent T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:26.299682  7014 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.316404  7014 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.265666  7085 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.300351  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.317417  7085 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.318372  2263 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:26.300449  6918 leader_election.cc:290] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.310801  7044 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:26.292424  6995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.468s	user 0.027s	sys 0.049s
I20260709 13:02:26.311654  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:26.311851  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.321175  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.321630  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.287153  7079 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:26.327152  1694 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:26.372866  1622 raft_consensus.cc:1240] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:26.374605  6810 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:26.327895  1619 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
W20260709 13:02:26.378364  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 66799.5us
W20260709 13:02:26.380788  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 75141.3us
I20260709 13:02:26.340852  7085 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.383522  1660 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:26.328975  7090 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:02:26.388520  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:26.390079  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.382302  7116 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.393018  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.394049  7102 consensus_queue.cc:1059] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:26.379851  6995 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.406934  6995 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.385313  7004 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.402778  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:26.416024  2266 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:26.416208  2263 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:26.412400  7078 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.414383  7117 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.385396  7099 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:26.335889  7070 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.420701  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:26.405809  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:26.409569  7023 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.775s	user 0.012s	sys 0.000s
I20260709 13:02:26.427130  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.423327  7117 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.407984  6926 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.434530  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.436125  1621 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:26.439030  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.441721  7117 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:26.443993  7110 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:26.429725  7004 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.425777  6976 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:02:26.419438  7116 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.451562  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.469076  1688 raft_consensus.cc:1275] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:02:26.456805  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 73708.6us
I20260709 13:02:26.456699  2261 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:26.432104  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:26.447044  6644 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.470412  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.471233  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.472288  1694 raft_consensus.cc:2410] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:02:26.446940  7014 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.433143  6828 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.472908  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.448007  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.476478  1613 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:26.474633  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:26.475085  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.472239  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.427217  6870 consensus_queue.cc:1059] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:02:26.446770  7111 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.478686  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.478027  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:26.480026  2266 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:26.491425  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.452765  6995 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.492008  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.475239  7117 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.447513  7004 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.494386  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:26.476449  6969 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:02:26.506582  7047 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 1.407s	user 0.002s	sys 0.010s
I20260709 13:02:26.516870  7085 raft_consensus.cc:3055] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:26.517956  1546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2456) took 1225 ms. Trace:
I20260709 13:02:26.433854  7099 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.518731  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
W20260709 13:02:26.524907  7114 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:26.552105  1541 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:26.499459  6807 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:02:26.552253  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 57919.2us
I20260709 13:02:26.565357  1660 leader_election.cc:304] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:26.495229  6926 raft_consensus.cc:3055] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:26.490549  7054 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:26.497924  7072 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.563243  7076 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:26.566604  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.580502  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:26.590289  1621 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:26.500814  7117 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:26.558043  1546 rpcz_store.cc:276] 0709 13:02:25.292110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.401975 (+109865us) service_pool.cc:224] Handling call
0709 13:02:25.409475 (+  7500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:25.543827 (+134352us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:25.548208 (+  4381us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.080667 (+532459us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:26.099105 (+ 18438us) log.cc:844] Serialized 52 byte log entry
0709 13:02:26.099298 (+   193us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:26.116030 (+ 16732us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.288889 (+172859us) log.cc:844] Serialized 14 byte log entry
0709 13:02:26.289087 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.289148 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.511688 (+222540us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b18004771c0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f177ed3f3 00007f7f177ef7c1 00007f7f177ef779 00007f7f177ef709 00007f7f177ef6d1 00007f7f177ee9cd 000000000038f354 000000000038f199 00007f7f177d083a
0709 13:02:26.517689 (+  6001us) raft_consensus.cc:1685] finished
0709 13:02:26.517715 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.517860 (+   145us) inbound_call.cc:177] Queueing success response
0709 13:02:26.534210 (+ 16350us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b48000030d8. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1f803aa1 00007f7f1f7fab37 00007f7f1f7fa9ca 00007f7f1f8f226f 00007f7f1f8f1f37 00007f7f1f90655c 00007f7f1f906508 00007f7f1f906488 00007f7f1f906443 00007f7f1f9056ec 00007f7f1e82fa96
Metrics: {"mutex_wait_us":204323,"prepare.queue_time_us":6627,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":120,"raft.queue_time_us":219910,"raft.run_cpu_time_us":2599,"raft.run_wall_time_us":261332,"spinlock_wait_cycles":31864576,"thread_start_us":553991,"threads_started":2,"wal-append.queue_time_us":479377}
I20260709 13:02:26.575855  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2763) took 1945 ms. Trace:
W20260709 13:02:26.588757  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 112166us
I20260709 13:02:26.574357  6861 raft_consensus.cc:2749] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.605257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.612413  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.563479  7039 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.604449  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.606199  1616 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
W20260709 13:02:26.644426  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 161320us
I20260709 13:02:26.614216  1617 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:02:26.586664  7018 consensus_meta.cc:287] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:02:26.557874  7085 raft_consensus.cc:740] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:26.595122  1539 rpcz_store.cc:276] 0709 13:02:24.630037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.630160 (+   123us) service_pool.cc:224] Handling call
0709 13:02:24.644984 (+ 14824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.669983 (+ 24999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.670021 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.710933 (+ 40912us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.863059 (+152126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:24.864294 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.864436 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.505966 (+1641530us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b4400022b4c. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f17713c85 00007f7f177146a2 00007f7f1a4861db 00007f7f1a481aaf 00007f7f1a47586e 00007f7f1a474bb6 00007f7f1a4747d8 00007f7f1a47e221 00007f7f1a47e1d9 00007f7f1a47e169
0709 13:02:26.575316 (+ 69350us) raft_consensus.cc:1685] finished
0709 13:02:26.575368 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.575714 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16515,"raft.queue_time_us":11628,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":36477,"spinlock_wait_cycles":104965248,"thread_start_us":111406,"threads_started":1,"wal-append.queue_time_us":191725}
I20260709 13:02:26.551386  6969 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.650776  2264 raft_consensus.cc:1275] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:26.581312  7054 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:26.601493  7117 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.589594  7076 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.645709  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:26.649578  1621 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:26.584575  6926 raft_consensus.cc:740] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:26.647403  1613 raft_consensus.cc:1217] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[12.11-13.12]   Dedup: 12.11->[13.12-13.12]
I20260709 13:02:26.668823  1613 raft_consensus.cc:1240] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 13:02:26.653779  2231 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.651953  7119 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:26.564376  6807 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.599119  7072 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:26.650851  6969 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:26.646577  7070 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.653321  7004 consensus_queue.cc:1059] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:02:26.696990  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:26.692361  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.679309  7076 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:26.700313  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.695637  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.694288  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.701375  1692 raft_consensus.cc:2393] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:26.695096  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:26.695853  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.693279  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.614426  7038 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.697185  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.683113  6807 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:26.682962  6972 raft_consensus.cc:2804] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:26.710155  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.704957  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.706884  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.707474  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.706918  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.689782  6644 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:26.714946  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:26.717056  1614 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:26.715395  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.717800  2266 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:26.716089  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.653127  7039 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.699865  7119 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:26.725980  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:26.726323  1585 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:26.722026  6972 raft_consensus.cc:697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:26.728819  1585 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:26.728941  6926 consensus_queue.cc:260] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.729357  6972 consensus_queue.cc:237] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.730398  6926 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.728163  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:26.700445  7070 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:02:26.716893  6644 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.744890  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:26.756793  7023 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.751166  7121 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:26.734016  7116 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.757575  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:26.763026  1538 raft_consensus.cc:2376] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16. Re-sending same reply.
I20260709 13:02:26.766289  1614 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:26.776350  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab05924031f84a848a47260864c78193" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:26.777331  2257 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42592 (request call id 1116) took 1219 ms. Trace:
I20260709 13:02:26.777652  2257 rpcz_store.cc:276] 0709 13:02:25.557958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.558721 (+   763us) service_pool.cc:224] Handling call
0709 13:02:26.776178 (+1217457us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5800211298. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b5a22 00007f7f206cec09 00007f7f1f828ee0 00007f7f1f8f20ab 00007f7f1f8f2131 00007f7f1f8a00a0 00007f7f1f89f984 00007f7f18e1a6d4 00007f7f18e1a662
0709 13:02:26.777246 (+  1068us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36153216}
I20260709 13:02:26.787904  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:26.788807  1687 raft_consensus.cc:2393] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
W20260709 13:02:26.791265  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.784750  6696 raft_consensus.cc:3060] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:26.795601  7070 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:26.790707  7079 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.792399  6644 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:26.791123  7122 raft_consensus.cc:2764] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:26.793056  6655 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:26.744165  7004 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
W20260709 13:02:26.743695  7058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.508s	user 0.026s	sys 0.022s
I20260709 13:02:26.836997  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:26.733057  7054 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.808120  7099 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:26.818722  7070 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:26.844798  6872 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:26.846099  1695 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:02:26.836418  7058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.026s	sys 0.022s
I20260709 13:02:26.909686  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:26.792567  7072 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.832094  7079 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:26.839888  7003 raft_consensus.cc:493] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:26.917800  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 189113us
I20260709 13:02:26.901635  7070 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:26.974663  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 271930us
I20260709 13:02:26.975670  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:26.904389  7063 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:26.912469  7097 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 1.144s	user 0.001s	sys 0.007s
I20260709 13:02:26.840287  6655 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:26.982427  7070 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:26.920436  1585 leader_election.cc:304] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:26.990322  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 163967us
I20260709 13:02:26.995031  2230 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:27.002911  7079 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.003121  6995 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:26.992573  7038 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.005344  6995 raft_consensus.cc:2749] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:27.007098  7090 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:27.007727  7090 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.008095  7090 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.013633  7076 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:27.019385  7126 log.cc:927] Time spent T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:02:26.992806  7063 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.021000  7039 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:26.907575  7119 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.022768  7063 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.029588  7076 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.034315  1543 raft_consensus.cc:2410] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:02:27.037163  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:27.040220  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:27.040891  2266 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:27.041839  6972 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.041949  7080 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.042513  6972 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.042883  7080 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.044073  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:27.044922  6696 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:27.045217  6972 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.046006  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.049441  7090 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.052000  7090 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.055508  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:26.981215  7003 raft_consensus.cc:515] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.105671  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.106751  1619 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:27.109050  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2347) took 1536 ms. Trace:
I20260709 13:02:27.109557  1622 rpcz_store.cc:276] 0709 13:02:25.572315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.574744 (+  2429us) service_pool.cc:224] Handling call
0709 13:02:25.575005 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.377722 (+802717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.108777 (+731055us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400341cd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:27.108982 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834650496}
I20260709 13:02:27.111189  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:27.115545  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 216573us
I20260709 13:02:27.126986  1511 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:27.127986  1615 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:27.115464  7087 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.045266  6696 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.130036  7079 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.136384  6781 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:27.114584  6969 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:27.171128  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 184591us
W20260709 13:02:27.171525  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 251348us
I20260709 13:02:27.164654  6932 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:27.174033  6972 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.180090  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:27.187263  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:27.174186  6696 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:27.193547  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60339.4us
I20260709 13:02:27.175781  6781 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.195242  1587 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:27.199414  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.218098  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:27.216626  6781 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:27.222859  7134 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:27.190343  6655 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.222729  7072 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.231372  1617 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:27.177286  7087 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.232625  1696 raft_consensus.cc:606] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.234154  1696 raft_consensus.cc:614] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.193368  7135 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:27.192119  6932 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.217403  7058 consensus_queue.cc:1048] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:02:27.247713  7147 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.248860  6932 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.251135  6969 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.237424  7135 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.251354  7085 consensus_queue.cc:260] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.252061  7135 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.252492  7085 raft_consensus.cc:3060] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:27.254468  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.196319  6807 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.235283  6655 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.194860  6972 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.244753  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:27.267866  1615 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.231825  7142 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:27.228047  1587 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:27.239001  7070 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.259289  7003 leader_election.cc:290] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.264164  6696 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.272351  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:27.264657  7117 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.001s
W20260709 13:02:27.287587  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.290362  1621 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 18: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:27.292459  7138 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:02:27.278357  7116 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.287086  7129 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.294981  7129 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.296120  6781 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.297209  7129 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.270947  7063 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.298969  7063 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.299685  7087 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.301746  7063 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.305112  6696 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.256778  7072 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.308640  7072 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.309448  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:27.310034  2264 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.270267  6644 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.317498  2264 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:27.279727  7058 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.320364  1510 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:27.326009  2257 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:27.277724  6655 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.328514  6644 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.280594  7117 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.338408  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:27.340000  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 121993us
I20260709 13:02:27.341257  1620 raft_consensus.cc:1240] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:27.347751  6972 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.347950  6655 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.350495  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.353753  6807 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.333395  7038 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.360594  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:27.361250  7117 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.361335  1696 raft_consensus.cc:606] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.364596  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6548704b45e547b6ab8bc4081d8b3ad7"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
W20260709 13:02:27.365461  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.362543  7038 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.365676  1696 raft_consensus.cc:606] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.366207  1696 raft_consensus.cc:614] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:27.365043  7070 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.369009  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:27.371248  1614 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:27.370517  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.330579  6810 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:27.373974  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:27.400564  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.361171  7080 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.384768  6625 consensus_queue.cc:1059] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:02:27.338469  6781 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.446132  2260 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42620 (request call id 847) took 1054 ms. Trace:
I20260709 13:02:27.446802  7057 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:27.447639  1696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:27.463812  2260 rpcz_store.cc:276] 0709 13:02:26.392074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.408787 (+ 16713us) service_pool.cc:224] Handling call
0709 13:02:26.423320 (+ 14533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.638982 (+215662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:26.639041 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:26.639128 (+    87us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:26.639199 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.445891 (+806692us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400723154. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:27.445935 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:27.446049 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494787328}
I20260709 13:02:27.467199  1696 raft_consensus.cc:606] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:27.444017  7082 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:27.440814  7044 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.454955  1613 raft_consensus.cc:1240] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:27.470028  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78df79e3d5044daa8ed98fe19b18d0fe" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:27.459232  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 87291.9us
I20260709 13:02:27.461457  1615 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 20.
W20260709 13:02:27.456588  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 81263.5us
I20260709 13:02:27.465081  1619 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:27.484330   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:27.486886   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:27.491679  6664 raft_consensus.cc:3060] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:27.492426  7038 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.493307  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:27.493906  1619 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:27.495114  2261 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42592 (request call id 1119) took 1879 ms. Trace:
I20260709 13:02:27.495479  2261 rpcz_store.cc:276] 0709 13:02:25.616025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.616233 (+   208us) service_pool.cc:224] Handling call
0709 13:02:25.616540 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.470328 (+853788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.494898 (+1024570us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b5400574254. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:27.495058 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881435904}
I20260709 13:02:27.500743  7102 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:27.460752  6810 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:27.501151  7102 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
W20260709 13:02:27.502544  1543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35956 (request call id 806) took 1619 ms (client timeout 2010 ms). Trace:
I20260709 13:02:27.503392  1540 raft_consensus.cc:1275] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:02:27.502960  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.503729  1540 pending_rounds.cc:85] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting all ops after (but not including) 11
I20260709 13:02:27.504662  1540 pending_rounds.cc:107] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:02:27.504881  1540 raft_consensus.cc:2889] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.506372  1614 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
I20260709 13:02:27.484223  7044 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:27.502957  1543 rpcz_store.cc:269] 0709 13:02:25.882837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.883005 (+   168us) service_pool.cc:224] Handling call
0709 13:02:27.502338 (+1619333us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400256f54. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:27.502484 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417942272}
I20260709 13:02:27.475078  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:27.573153  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 98184.2us
I20260709 13:02:27.585364  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.585670  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.586032  1541 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:27.587007  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.587949  1545 raft_consensus.cc:2393] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 15: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:27.471583  7063 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.588828  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:27.589712  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 148172us
I20260709 13:02:27.595608  6625 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:27.603977  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35956 (request call id 818) took 1511 ms. Trace:
I20260709 13:02:27.604404  1540 rpcz_store.cc:276] 0709 13:02:26.092715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.188585 (+ 95870us) service_pool.cc:224] Handling call
0709 13:02:27.503068 (+1314483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.505279 (+  2211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.603757 (+ 98478us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400256f50. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8d98ad 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:27.603922 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3022500096}
I20260709 13:02:27.607355  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.608068  1546 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:27.608992  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:27.611404  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 140398us
I20260709 13:02:27.467067  7057 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.613776  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:27.614894  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.615767  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:27.616262  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.616920  1614 raft_consensus.cc:2368] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 17. Current term is 18.
I20260709 13:02:27.616827  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.618654  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:27.620453  1587 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:27.615502  1540 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:27.612812  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:27.622962  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:27.626048  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.628201  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:27.582962  6781 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:27.630446  1547 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 16: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:27.583622  6807 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.502018  6810 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.635874  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:27.591562  7038 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:27.640180  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.648516  1615 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:27.634680  6781 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.649863  6781 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.604032  6625 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.657267  6625 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.623668  6696 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.658586  6696 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.661660  6696 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.589697  6655 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:02:27.646728  7129 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.647015  6807 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.611743  7003 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.666929  7003 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.668958  7003 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.637589  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:27.670173  1547 raft_consensus.cc:3060] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:02:27.643322  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.645736  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.592967  7010 raft_consensus.cc:493] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.624384  6644 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.474362  7082 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.623463  7080 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:27.631407  7070 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:27.684975  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:27.678603  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.644243  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:27.635430  7122 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:27.683128  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:27.676707  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:27.646395  7117 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:27.501994  7102 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.693794  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.694219  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:27.695096  1689 raft_consensus.cc:2393] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 19: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:27.666442  6807 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.713244  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:27.635402  7063 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.684973  7147 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:27.742125  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 48429.1us
I20260709 13:02:27.695557  7058 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:27.684334  6696 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.751817  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.686153  7148 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.755707  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:27.698717  7117 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.674770  7038 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.686481  6644 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.691339  7010 raft_consensus.cc:515] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.750279  6807 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.743448  7087 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.789067  7087 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.789481  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:27.790102  1689 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.764751  1545 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:27.700829  7080 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.776690  7058 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.743642  7089 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.755430  6932 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.828291  7089 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.828419  6932 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.831445  6932 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.835222  1689 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:27.847883  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:27.757089  7147 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.710364  7003 raft_consensus.cc:493] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.780788  7148 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.781152  6696 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.781589  6915 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:27.782114  2259 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:27.778250  7117 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:27.783375  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:27.907073  1687 raft_consensus.cc:2368] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 16. Current term is 17.
I20260709 13:02:27.691025  7122 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.792822  1661 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:27.822007  6857 raft_consensus.cc:3055] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:27.822981  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:27.824026  7044 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:27.785686  7135 consensus_meta.cc:287] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:02:27.867919  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:27.929410  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 61545.9us
I20260709 13:02:27.868948  7154 raft_consensus.cc:493] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:27.935905  2231 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.938697  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:27.939378  2261 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
I20260709 13:02:27.876260  6932 raft_consensus.cc:493] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.878444  6625 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.882640  7082 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.883857  6644 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.885401  7010 leader_election.cc:290] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:27.886543  7063 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.035346  7038 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:27.890887  7085 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.036980  7085 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.905529  1540 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:27.930575  1587 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:27.875195  7089 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:27.929747  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 137064us
I20260709 13:02:28.050588  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.914810  7003 raft_consensus.cc:515] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.980476  1547 raft_consensus.cc:2468] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
I20260709 13:02:27.942975  1660 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:27.943024  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.944031  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:27.947096  7140 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:27.918056  6857 raft_consensus.cc:740] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:28.059794  1661 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:28.060520  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 117583us
I20260709 13:02:28.061466  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.061617  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:27.950946  7070 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:27.954843  6810 consensus_queue.cc:1059] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:27.955279  1511 leader_election.cc:400] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 17. Current term is 18.
I20260709 13:02:28.065032  1511 leader_election.cc:403] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:27.955668  7072 consensus_queue.cc:1059] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:02:27.956169  2259 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42608 (request call id 1215) took 2474 ms (client timeout 2133 ms). Trace:
I20260709 13:02:27.957525  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:28.077766  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 120318us
I20260709 13:02:27.933736  7135 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:27.933708  7116 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:27.959290  7119 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:27.903312  7111 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.939934  7044 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:27.940366  7076 raft_consensus.cc:2804] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:28.032285  7147 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.033550  6828 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:27.846697  7058 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.108721  1692 raft_consensus.cc:1275] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:28.042563  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:28.045404  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.046904  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:28.053064  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 122628us
I20260709 13:02:28.111505  1587 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:28.025705  7039 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.079195  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.114413  1690 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:27.918751  7122 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:28.077468  2259 rpcz_store.cc:269] 0709 13:02:25.481671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.481796 (+   125us) service_pool.cc:224] Handling call
0709 13:02:27.955978 (+2474182us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54006676d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8de2fa 00007f7f1f89fb17 00007f7f18e1a6d4 00007f7f18e1a662 00007f7f18e1a591 00007f7f18e1a50c 00007f7f18e197c2 00007f7f18c1548c 00007f7f18c148c6 00007f7f18c1426f
0709 13:02:27.956076 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5021434624}
I20260709 13:02:27.918377  7054 consensus_queue.cc:1048] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.182s
I20260709 13:02:28.018610  7057 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:27.941131  7087 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.049551  7128 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:02:28.107324  1619 consensus_meta.cc:287] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.001s
I20260709 13:02:28.059134  6994 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:28.076766  6860 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:27.917493  6781 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:28.153519  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.170657  2259 raft_consensus.cc:1240] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.093040  6932 raft_consensus.cc:515] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:27.965878  7154 raft_consensus.cc:515] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.074494  6625 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.155579  1619 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:28.092254  6926 raft_consensus.cc:2804] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:02:28.190469  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 225509us
W20260709 13:02:28.162782  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 207687us
I20260709 13:02:28.097146  6664 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:28.098810  7089 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.166512  1587 leader_election.cc:400] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 16. Current term is 17.
I20260709 13:02:28.187094  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.194214  1587 leader_election.cc:403] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:28.192000  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:28.189113  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.195663  2259 raft_consensus.cc:2410] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:02:28.172542  7156 log.cc:927] Time spent T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:02:28.167183  7054 consensus_queue.cc:1243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 17.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:02:28.200743  1544 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:28.200961  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 45595.9us
I20260709 13:02:28.075384  7140 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.163632  7087 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:28.202203  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 102743us
I20260709 13:02:28.174140  6644 raft_consensus.cc:2804] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:28.157766  6655 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 17. Current term is 18.
I20260709 13:02:28.115470  7111 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.192292  6915 raft_consensus.cc:2804] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:28.113838  6828 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.198195  7023 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.156404  7044 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.133334  7039 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.201874  6926 raft_consensus.cc:697] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:28.168336  7128 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.211941  6664 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:28.232204  7080 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.243232  7070 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 16. Current term is 17.
W20260709 13:02:28.265745  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 322722us
I20260709 13:02:28.263748  6915 raft_consensus.cc:697] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:28.193595  6857 consensus_queue.cc:260] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.242183  6644 raft_consensus.cc:697] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:28.280071  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.280532  1690 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 20.
W20260709 13:02:28.284473  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 242203us
I20260709 13:02:28.286018  7080 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:28.274988  7038 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:28.286314  6644 consensus_queue.cc:237] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.286942  7038 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.287503  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.288877  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.289103  7038 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.263314  7148 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.290735  1613 raft_consensus.cc:1240] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.286469  7080 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.272745  7170 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.292923  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.296767  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.296665  6664 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.297456  1694 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:28.298089  7003 leader_election.cc:290] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.299005  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.300392  7128 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:28.297497  6828 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.294011  7080 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.302066  7044 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.302304  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.302716  7170 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.303624  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.305015  7170 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.305644  7085 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:28.306569  7054 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:28.306325  6926 consensus_queue.cc:237] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.307132  7054 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.299057  6781 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.309320  7054 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.312088  6857 raft_consensus.cc:3060] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.313850  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.300486  6625 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:28.317124  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.318732  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:28.319222  7163 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:02:28.319339  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 12.
W20260709 13:02:28.320811  7157 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:02:28.322363  7166 log.cc:927] Time spent T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:28.319331  7080 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.324878  7080 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.327509  1691 raft_consensus.cc:2468] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:28.327232  6915 consensus_queue.cc:237] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.322168  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:28.335510  2231 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:28.332027  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 228358us
I20260709 13:02:28.332162  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.338455  7085 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:28.331384  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 269982us
I20260709 13:02:28.336212  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:28.339319  2266 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:28.343456  7116 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.345743  7063 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:28.348136  2261 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:28.348640  2266 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
I20260709 13:02:28.351545  7082 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:28.355768  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:28.357906  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 129436us
I20260709 13:02:28.358888  1510 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:28.361542  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:28.364601  1546 raft_consensus.cc:1240] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:02:28.366267  2230 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.368263  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.336191  7080 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:28.371101  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.371976  2259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:28.384752  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:28.375356  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.385857  2266 raft_consensus.cc:2393] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 18: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:28.375152  7076 raft_consensus.cc:697] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:28.373235  7160 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.308s	user 0.001s	sys 0.001s
I20260709 13:02:28.392180  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.357321  6781 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.404711  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.376557  7152 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:28.374478  7080 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:28.376157  7072 consensus_queue.cc:1243] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer c5f349bdadfc40b9bff8e1682b5c271b log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:28.373997  7168 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:28.382746  7135 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:28.416936  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 61709us
I20260709 13:02:28.472522  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:28.397034  7010 consensus_queue.cc:1059] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:02:28.427269  7158 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:02:28.431277  7161 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:02:28.423895  6857 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.434700  6781 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.447551  7039 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.448455  7154 leader_election.cc:290] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.449177  7140 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.454417  7185 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.461223  7129 consensus_meta.cc:287] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.005s
I20260709 13:02:28.425259  7152 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:28.469372  7076 consensus_queue.cc:237] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.474944  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.475054  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.477221  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.415385  7080 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.478909  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.482452  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.476099  7168 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
W20260709 13:02:28.495059  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.516842  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.522253  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.515048  7185 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.515846  7152 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.526816  7185 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:28.527705  7117 consensus_meta.cc:287] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.005s
I20260709 13:02:28.517732  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.495018  7181 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.528208  7117 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.528640  6781 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.528918  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.529457  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.530026  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.530519  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.527187  7168 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.531082  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.531594  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.532143  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.532966  1688 raft_consensus.cc:1240] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:02:28.533458  1692 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:02:28.533905  1619 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:28.534387  1693 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:28.518044  1690 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:28.536234  1695 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:28.538645  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.530364  7117 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.499076  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:28.552649  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54011.3us
I20260709 13:02:28.551290  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:28.555387  2232 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.548625  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.515081  7129 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.558609  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.559414  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.559536  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.563649  1695 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 16.
I20260709 13:02:28.548641  6696 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.583508  7122 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.564023  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:28.585800  7122 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.586391  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.587319  1616 raft_consensus.cc:2410] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:28.588099  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.589730  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.590912  1543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2794) took 1003 ms. Trace:
I20260709 13:02:28.591295  1543 rpcz_store.cc:276] 0709 13:02:27.587591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.596240 (+  8649us) service_pool.cc:224] Handling call
0709 13:02:27.635872 (+ 39632us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:27.677365 (+ 41493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:27.677397 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:27.677948 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 13:02:28.026140 (+348192us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:02:28.026223 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.026355 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.590688 (+564333us) raft_consensus.cc:1685] finished
0709 13:02:28.590714 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.590857 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9234,"raft.queue_time_us":35959,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10019,"thread_start_us":282150,"threads_started":1,"wal-append.queue_time_us":525333}
I20260709 13:02:28.592597  7135 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.593180  7135 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:28.593080  7080 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.593838  7135 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.594897  7054 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:28.595978  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.566053  7185 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:02:28.568717  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 152714us
I20260709 13:02:28.500319  7058 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.599694  7170 consensus_queue.cc:1048] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:28.602329  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.602941  7058 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.603632  1621 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:28.603549  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.605072  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.606066  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.608642  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:28.609795  6696 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.610531  6696 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.612737  7080 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.610824  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.613626  7111 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.597623  7185 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:28.615607  7185 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.616353  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:28.617105  7111 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.619639  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56132 (request call id 2792) took 1032 ms. Trace:
I20260709 13:02:28.620067  1541 rpcz_store.cc:276] 0709 13:02:27.587098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.587188 (+    90us) service_pool.cc:224] Handling call
0709 13:02:27.587472 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.737511 (+150039us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:27.737532 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:27.743240 (+  5708us) log.cc:844] Serialized 26 byte log entry
0709 13:02:27.813103 (+ 69863us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:27.813161 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.606421 (+793260us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540018a6d4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:28.606464 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.606508 (+    44us) raft_consensus.cc:1685] finished
0709 13:02:28.606521 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.619579 (+ 13058us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344416512,"thread_start_us":52950,"threads_started":1,"wal-append.queue_time_us":180620}
I20260709 13:02:28.625986  7111 consensus_queue.cc:1048] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:28.629453  7078 raft_consensus.cc:3055] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:28.630045  7078 raft_consensus.cc:740] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:28.630828  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:28.631218  7078 consensus_queue.cc:260] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.633180  7078 raft_consensus.cc:3060] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.633764  7111 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.637199  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.614029  6696 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.652787  1544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2471) took 1032 ms. Trace:
I20260709 13:02:28.653376  1544 rpcz_store.cc:276] 0709 13:02:27.620609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.677352 (+ 56743us) service_pool.cc:224] Handling call
0709 13:02:27.677601 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.215944 (+538343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.652482 (+436538us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400106654. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:28.652706 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198684928}
I20260709 13:02:28.523864   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:28.674672  1545 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:28.675098  1545 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:28.675817  1545 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.676879  1545 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:28.679725  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 486698us
I20260709 13:02:28.680694  1511 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:28.681813  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.683575  7080 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:28.684543  7154 raft_consensus.cc:3055] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:28.684955  7154 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:28.685704  7154 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.693343  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.695358  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.696617  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.690191  6696 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:28.697889  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.698171  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c2089bb9c240cc97c2b79e1d4c648f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.698311  2258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.699193  6696 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.699354  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb5d38534bcc45e19c58dcc3139a4ee6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.699753  6696 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:28.696768  1545 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:28.700891  7102 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:28.705437  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73951993cbd34d1cbe7ed6fe93812a5f" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.706943  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.708846  7154 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.709002  7135 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.712211  7135 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.691934  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:28.714542  7119 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.715121  7119 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.717293  7119 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:28.717706  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.718183  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.714546  7169 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:28.719295  7169 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.719744  7169 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.720410  2231 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:28.721765  7128 raft_consensus.cc:2804] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:28.722244  7128 raft_consensus.cc:697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:28.718664  7117 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:02:28.723204  7128 consensus_queue.cc:237] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.723829  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.731230  1613 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.731775  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.732970  1692 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:28.737721  1585 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.742008  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.743310  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.749157  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.750609  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.750907  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.751296  1547 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:28.751317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.755762  1541 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:28.758838  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.768488  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.769520  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:28.772229  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:28.773285  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.773852  1538 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 12.
I20260709 13:02:28.774199  6932 leader_election.cc:290] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:28.775146  2261 pending_rounds.cc:85] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 12
I20260709 13:02:28.775432  2261 pending_rounds.cc:107] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:28.775712  2261 raft_consensus.cc:2889] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:28.775844  7014 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:28.779225  2260 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:28.780439  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:28.781003  2260 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:28.783227  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.785180  1543 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.787058  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.793558  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:28.769083  6655 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:02:28.797209  2258 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:28.797935  1545 raft_consensus.cc:2410] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:02:28.794945  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:28.804623  1659 leader_election.cc:304] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.768851  7122 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:02:28.855762  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.857131  1618 raft_consensus.cc:1240] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:28.857628  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:28.862071  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 67239.8us
I20260709 13:02:28.863075  1617 raft_consensus.cc:2393] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:28.805728  6696 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.864588  7167 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:28.865041  7167 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.865374  7167 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:28.865545  7116 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.865944  6696 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.866034  7116 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.868088  7171 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:02:28.851413  7080 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.872632  7080 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.875995  6870 raft_consensus.cc:2749] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:28.876554  7132 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:28.876977  7132 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:28.804008  7117 consensus_queue.cc:1059] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:02:28.877324  7132 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:28.877795  7117 raft_consensus.cc:3055] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:28.878167  7117 raft_consensus.cc:740] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:28.875705  7169 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.868405  7116 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.886068  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:28.863935  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 59445.8us
I20260709 13:02:28.889221  1695 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:28.889339  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:28.889976  1696 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:28.851796  7014 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:28.892844  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:28.892838  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.894912  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:28.856222  6932 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:02:28.897933  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:28.904215  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.905222  1617 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:28.675704  7185 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:28.928292  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.928589  1696 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 20 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:28.905236  7080 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:28.944923  1659 leader_election.cc:304] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.947918  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.953236  1659 leader_election.cc:304] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.893802  7068 consensus_queue.cc:1059] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:28.958273  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.907262  7188 consensus_queue.cc:1059] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:28.890928  7117 consensus_queue.cc:260] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.902454  7014 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:28.975894  1545 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 17: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
W20260709 13:02:28.958640  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 424383us
I20260709 13:02:28.976969  1659 leader_election.cc:304] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:28.926110  7181 consensus_queue.cc:1059] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:28.978380  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:28.957829  6915 raft_consensus.cc:2749] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:28.987531  1512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.990279  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:29.002025  1544 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:29.006407  1618 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:28.981350  6926 raft_consensus.cc:2749] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.015544  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.016176  1544 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:28.998447  7080 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.012533  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.021512  1543 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.004735  7117 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:29.011593  1622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.014s	sys 0.015s
I20260709 13:02:28.979384  7192 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:29.030076  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.001524  7116 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:29.026073  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35468 (request call id 2473) took 1405 ms. Trace:
I20260709 13:02:29.035679  1540 rpcz_store.cc:276] 0709 13:02:27.621125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.738577 (+117452us) service_pool.cc:224] Handling call
0709 13:02:27.738879 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:28.051282 (+312403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.025792 (+974510us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b5400107554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:29.026002 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382750976}
I20260709 13:02:29.038050  1619 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:29.026358  1622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.014s	sys 0.015s
I20260709 13:02:29.034142  1547 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:29.044869  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.005498  7122 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:29.020859  7068 raft_consensus.cc:2749] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.050887  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.051059  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.051576  1545 raft_consensus.cc:2468] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:29.052273  2259 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:29.054373  1542 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 16: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:29.058561  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.060179  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:29.035473  7116 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.046329  7169 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.023741  7057 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:02:29.069375  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.067932  7116 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.027637  7080 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:29.098573  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.115437  7014 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.116571  7080 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:29.061508  7168 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:02:29.045929  6807 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:02:29.118600  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:29.123127  1542 raft_consensus.cc:2468] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
W20260709 13:02:29.124181  7197 log.cc:927] Time spent T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:02:29.126910  7195 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:02:29.129956  1512 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.089385  7129 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:29.130916  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.257015  1538 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:29.257231  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.133735  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:29.135409  7185 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.135764  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.136258  7132 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.137250  1543 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:29.053916  6926 consensus_queue.cc:1059] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:29.140920  2262 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:29.146379  1619 raft_consensus.cc:1240] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:29.147069  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:29.147814  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:29.154062  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 177174us
I20260709 13:02:29.154937  1544 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:29.164053  6932 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.169417  6857 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.178673  7063 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:29.181615  1614 raft_consensus.cc:1240] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:29.182600  7040 raft_consensus.cc:3055] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.190061  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.314770  1539 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.195556  1621 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:02:29.237483  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:29.241139  7153 raft_consensus.cc:3055] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.247264  2261 raft_consensus.cc:2410] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:29.131976  7167 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.258726  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:29.265291  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.267467  1618 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:29.275629  7010 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:29.286382  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 46295.7us
W20260709 13:02:29.288139  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 158243us
I20260709 13:02:29.288968  7189 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.290719  6781 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:29.290867  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 155165us
I20260709 13:02:29.301158  1615 raft_consensus.cc:2393] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 17: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:29.307752  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:29.322741  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 189085us
I20260709 13:02:29.339098  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.244694  7182 consensus_queue.cc:1059] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:02:29.354292  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:29.354763  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 47100.8us
I20260709 13:02:29.301144  6972 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.301082  6932 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:29.335331  7158 log.cc:927] Time spent T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:29.363462  1587 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:29.308080  6870 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:29.364771  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 106196us
I20260709 13:02:29.381443  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.307631  6857 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:29.324560  7040 raft_consensus.cc:740] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:29.368705  1620 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:29.323175  7153 raft_consensus.cc:740] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:29.358978  7078 consensus_meta.cc:287] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.718s	user 0.013s	sys 0.000s
I20260709 13:02:29.345557  6872 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:02:29.360029  7217 log.cc:927] Time spent T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:29.342876  7010 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:29.313215  7140 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:29.383497  1587 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:29.359678  7080 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.364187  6655 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.387137  1541 raft_consensus.cc:1240] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:29.366727  7135 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:29.339323  7063 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.372794  7181 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:29.387744  6644 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:02:29.435107  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68591.4us
I20260709 13:02:29.432605  1546 raft_consensus.cc:2468] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
W20260709 13:02:29.433593  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50225.3us
I20260709 13:02:29.466585  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:29.468628  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:29.477666  1512 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:29.457293  7207 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:02:29.431720  6872 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:29.434549  7122 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.384543  6972 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.390101  7168 consensus_queue.cc:1059] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
W20260709 13:02:29.498987  1586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.451887  7135 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
W20260709 13:02:29.493551  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 225128us
I20260709 13:02:29.457769  7181 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:29.459861  7140 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.459431  7010 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.517311  7153 consensus_queue.cc:260] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.571836  7153 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.558914  7080 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.482221  7169 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.574891  7010 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:29.523962  7210 log.cc:927] Time spent T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:02:29.577189  7140 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:29.553725  1539 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:29.475683  7185 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:02:29.589911  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80194.5us
I20260709 13:02:29.562610  7132 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.489725  6872 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.586335  2262 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:29.587373  2265 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:02:29.638777  2265 pending_rounds.cc:85] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting all ops after (but not including) 11
I20260709 13:02:29.639181  2265 pending_rounds.cc:107] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:02:29.639601  2265 raft_consensus.cc:2889] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.584076  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5f6768c02504c9cb4195745e3f1970e" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:29.570181  7117 consensus_meta.cc:287] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.000s
I20260709 13:02:29.517477  7135 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.645627  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:29.525360  7063 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.648401  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:29.548442  6972 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:29.588279  7040 consensus_queue.cc:260] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.657598  7040 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.560892  7189 raft_consensus.cc:3055] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.659010  7189 raft_consensus.cc:740] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:29.659999  7189 consensus_queue.cc:260] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.661449  7189 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.588133  7181 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.509474  6932 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.671486  6932 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:29.673334  7181 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:29.645502  7220 log.cc:927] Time spent T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.102s	user 0.004s	sys 0.000s
W20260709 13:02:29.645682  7214 log.cc:927] Time spent T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.004s
I20260709 13:02:29.561936  7167 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:29.688482  7181 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:29.645606  7219 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.160s	user 0.000s	sys 0.004s
W20260709 13:02:29.701541  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.715248  1543 raft_consensus.cc:1275] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:29.719862  7132 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:29.720669  7132 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.725090  7132 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:29.725272  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:29.725760  7132 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:29.726291  7132 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.729174  7068 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:29.729609  7068 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:29.729859  7132 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:29.730562  7068 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.732227  7068 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:29.738999  6926 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:29.739101  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 357785us
I20260709 13:02:29.739626  6926 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:29.740012  6926 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:29.740546  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.742076  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.743817  6806 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:29.744434  6806 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.744464  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:29.744971  1510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.748770  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:29.749500  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.752022  1690 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:29.754923  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:29.762948  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5be703fc2dd046c1b14909b95d460cd8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:29.762444  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0547666b41440ebc195aa8cd34bc9d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:29.764768  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.765707  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:29.771106  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 466535us
I20260709 13:02:29.779736  1620 raft_consensus.cc:1275] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:02:29.770119  7135 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:29.786029  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 417801us
I20260709 13:02:29.787949  1511 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.797624  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:29.543004  7076 raft_consensus.cc:3055] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:29.803081  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:29.804404  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:29.804774  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.817137  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
W20260709 13:02:29.807619  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 328423us
I20260709 13:02:29.823609  1618 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:29.828871  1544 raft_consensus.cc:1240] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:29.830312  1539 raft_consensus.cc:1275] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:29.834475  1539 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.806111  7154 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.812337  7189 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.838580  1539 raft_consensus.cc:1240] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:29.839684  1542 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.837385  1538 raft_consensus.cc:1275] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:02:29.840399  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.840982  1546 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.807207  7076 raft_consensus.cc:740] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
W20260709 13:02:29.837771  1442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 294) took 33994 ms (client timeout 15000 ms). Trace:
I20260709 13:02:29.837874  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.843850  1543 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:29.845278  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:29.846376  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:29.847971  1614 raft_consensus.cc:2393] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:29.849366  1620 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:02:29.849825  1620 pending_rounds.cc:85] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 12
I20260709 13:02:29.850157  1620 pending_rounds.cc:107] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:29.850445  1620 raft_consensus.cc:2889] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.852612  1587 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:29.816663  7063 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:02:29.814465  6912 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:02:29.869645  1613 raft_consensus.cc:1240] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:29.856854  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
W20260709 13:02:29.858700  1659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.856382  7117 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:29.875941  7117 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:29.876747  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:29.876860  7117 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.877183  7076 consensus_queue.cc:260] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.878176  7076 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:29.855661  7132 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:29.879431  7132 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:29.880311  7132 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.836383  7078 consensus_queue.cc:1059] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:02:29.883601  7078 raft_consensus.cc:3055] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:29.883977  7078 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:29.884758  7078 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:29.842681  1442 rpcz_store.cc:269] 0709 13:01:55.838295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.838667 (+   372us) service_pool.cc:224] Handling call
0709 13:02:29.832888 (+33994221us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:24.099022 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:24.185541 (+ 86519us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:24.185603 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:02:24.185630 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:24.285143 (+ 99513us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:24.285261 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:24.285309 (+    48us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:02:24.440469 (+155160us) tablet.cc:701] Row locks acquired
0709 13:02:24.453818 (+ 13349us) write_op.cc:260] PREPARE: finished
0709 13:02:24.459869 (+  6051us) write_op.cc:270] Start()
0709 13:02:24.460040 (+   171us) write_op.cc:276] Timestamp: P: 1783602144458650 usec, L: 0
0709 13:02:24.460085 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:02:24.596877 (+136792us) log.cc:844] Serialized 8232 byte log entry
0709 13:02:25.343256 (+746379us) op_driver.cc:464] REPLICATION: finished
0709 13:02:25.559388 (+216132us) write_op.cc:301] APPLY: starting
0709 13:02:25.559506 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:26.087495 (+527989us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:26.087630 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:27.308970 (+1221340us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b18002a18a0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f206b5de1 00007f7f206c25b1 00007f7f1a6190ec 00007f7f1a665c0a 00007f7f1a6654f7 00007f7f1a665490 00007f7f1a61cf48 00007f7f1e3311bb 00007f7f1e3785d4 00007f7f1e2248da 00007f7f1e2273cb
0709 13:02:27.889202 (+580232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:27.889629 (+   427us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:02:27.889687 (+    58us) write_op.cc:312] APPLY: finished
0709 13:02:27.890169 (+   482us) log.cc:844] Serialized 188 byte log entry
0709 13:02:28.096203 (+206034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:28.119175 (+ 22972us) write_op.cc:454] Released schema lock
0709 13:02:28.119633 (+   458us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:28.120163 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:28.120212 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6621846,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":165476,"apply.run_cpu_time_us":61199,"apply.run_wall_time_us":2569205,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91865,"num_ops":21,"prepare.queue_time_us":212254,"prepare.run_cpu_time_us":33381,"prepare.run_wall_time_us":666432,"raft.queue_time_us":129861,"raft.run_cpu_time_us":17614,"raft.run_wall_time_us":138323,"replication_time_us":872653,"spinlock_wait_cycles":58759168,"thread_start_us":388783,"threads_started":5,"wal-append.queue_time_us":475698,"wal-append.run_cpu_time_us":23583,"wal-append.run_wall_time_us":2627353}]]}
I20260709 13:02:29.854236  6972 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:02:29.893204  7167 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:29.893453  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 55667.4us
I20260709 13:02:29.893843  7167 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:29.894170  7140 consensus_queue.cc:1048] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:29.894371  1512 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.894896  7167 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.895938  6781 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.917507  1546 raft_consensus.cc:2468] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:29.836227  6655 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:02:29.904428  1587 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.931164  1614 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:02:29.911873  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 70371.4us
I20260709 13:02:29.925750  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:29.928139  1659 leader_election.cc:304] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.929410  1688 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:29.941676  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.943046  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:29.944152  1587 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:29.941519  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.947196  1541 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:29.951349  6807 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:29.951869  7080 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:29.949117  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:29.970458  1541 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:29.958509  6926 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:29.876911  6872 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:29.988761  1539 raft_consensus.cc:1275] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:02:29.949910  7169 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:29.925670  7119 consensus_queue.cc:1048] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:02:29.991314  1662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.959962  7122 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:29.985683  7057 raft_consensus.cc:2764] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:02:29.939469  6915 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:02:29.955219  7068 raft_consensus.cc:2749] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:29.950424  7153 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:02:30.033215  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 46489.8us
W20260709 13:02:30.050335  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 156049us
W20260709 13:02:29.991322  7116 consensus_meta.cc:287] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.004s
I20260709 13:02:30.044905  1693 raft_consensus.cc:1240] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:30.034255  1615 raft_consensus.cc:1240] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:30.050828  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 92472.8us
W20260709 13:02:30.029012  7223 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:02:30.051110  1512 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.054024  1512 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.058459  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:30.051620  7116 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.064639  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.032757  7228 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:02:30.057736  7063 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.068789  7063 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:30.069187  7063 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.069607  6926 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.071568  7080 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.048224  7212 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.030841  7209 consensus_queue.cc:1048] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:30.058923  7135 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.088850  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:30.091439  6872 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:30.095813  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 43800.6us
I20260709 13:02:30.098436  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.068152  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.103019  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:30.098342  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.065953  7240 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.125638  7116 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:29.999749  6857 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.126813  6857 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:30.127633  6932 consensus_queue.cc:1175] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9fbc4df0bb934bba941cfa20c0afead2" responder_term: 16 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:30.132992  6872 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.133682  6872 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:30.135818  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 68713us
I20260709 13:02:30.136560  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:30.141394  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 108223us
I20260709 13:02:30.141505  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.148564  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.149379  1542 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 17: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:30.148909  2230 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:30.152518  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:30.154050  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.162070  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.151685  7213 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.151443  7116 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.149358  7242 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.095904  7212 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.183686  1661 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.161108  7057 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.163925  7182 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
W20260709 13:02:30.188194  7010 consensus_meta.cc:287] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.001s
I20260709 13:02:30.189929  6696 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:30.193145  7246 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.195118  6872 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:30.199668  2262 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:30.201478  1541 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:02:30.242000  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.164422  6655 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.211160  1622 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:30.166179  7080 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.169929  7240 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.171075  7122 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:30.233774  6806 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.240773  6807 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.234078  6696 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:30.233817  6926 raft_consensus.cc:493] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.246374  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.250838  7178 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:30.172190  7068 consensus_queue.cc:1048] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:02:30.252794  7063 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.294387  7078 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.294633  6807 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.295917  7063 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:30.207259  7213 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.296806  6807 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.298051  7213 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.226780  7057 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.298897  6806 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.220677  7153 raft_consensus.cc:2804] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:30.235044  7209 consensus_queue.cc:1048] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:02:30.300967  6806 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.302526  6932 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.303103  6932 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.305110  6932 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.305223  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:30.264106  2229 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.305953  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.306605  1616 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:30.306007  1617 raft_consensus.cc:2393] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:30.308270  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:30.271893  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.234337  7182 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.310002  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.311306  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.313326  1613 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:30.316325  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:30.320546  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.321425  1614 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:30.323944  1616 raft_consensus.cc:2368] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 16. Current term is 17.
I20260709 13:02:30.322335  1585 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:30.332688  1511 leader_election.cc:400] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 16. Current term is 17.
I20260709 13:02:30.333078  1511 leader_election.cc:403] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.305830  6926 raft_consensus.cc:515] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.335997  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.337713  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.339828  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.300578  7057 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.340929  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.343240  1547 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:30.287387  7076 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:02:30.345813  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.346500  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.338874  7122 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.340157  7212 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.362993  7122 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.364903  6926 leader_election.cc:290] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.365278  7122 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:30.338788  7167 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:30.366044  7167 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:30.367187  7167 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.342697  7240 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.369625  1617 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:02:30.369899  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 48956.5us
I20260709 13:02:30.374464  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:30.375589  7153 raft_consensus.cc:697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:30.376590  7153 consensus_queue.cc:237] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.379377  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:30.360956  7259 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.388195  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c6ce8e6dbe04fc3bb43288095f2de7b" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.398134  1546 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:30.399513  1616 raft_consensus.cc:1240] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:02:30.410995  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 258562us
I20260709 13:02:30.425086  7242 consensus_queue.cc:1059] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:30.394538  7259 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.439549  1661 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.440876  1661 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.441313  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.441701  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.442906  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.443320  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:30.443490  1544 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:30.443531  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.444670  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:30.445289  1689 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:30.431404  7260 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:02:30.457054  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.457645  1695 raft_consensus.cc:3060] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.457679  1539 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
W20260709 13:02:30.459962  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 295490us
I20260709 13:02:30.460909  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.462479  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.468407  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.451617  6807 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.438752  7259 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.431047  6872 consensus_queue.cc:1059] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:02:30.451798  7264 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.497337  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:30.455931  6926 raft_consensus.cc:3060] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.465214  7063 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:30.474608  6806 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.500810  1512 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.507062  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.490706  7078 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.519963  7240 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685) with higher term. Message: Invalid argument: T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 16. Current term is 17.
I20260709 13:02:30.510969  7228 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.514572  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.510567  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:30.498083  7182 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.513361  7132 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:30.534416  7248 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:30.567482  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2389) took 1206 ms. Trace:
I20260709 13:02:30.567970  1615 rpcz_store.cc:276] 0709 13:02:29.360854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.361020 (+   166us) service_pool.cc:224] Handling call
0709 13:02:29.361340 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.051332 (+689992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.567215 (+515883us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400116554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:30.567415 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547115392}
W20260709 13:02:30.555109  7262 log.cc:927] Time spent T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:02:30.582464  1543 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:30.560105  6806 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.576829  7178 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.584321  7063 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.590032  1695 raft_consensus.cc:2468] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:30.564899  7248 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.583762  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 74418.9us
I20260709 13:02:30.577971  7245 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:30.590806  7178 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.655898  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:30.656243  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:30.656487  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:30.657274  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:30.658185  1690 raft_consensus.cc:2368] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 16. Current term is 17.
I20260709 13:02:30.648597  1688 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:30.629323  7248 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.669239  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:30.648051  7135 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:30.674726  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.678915  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.673884  7135 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.680567  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.681813  7135 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.681869  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:30.683038  7266 log.cc:927] Time spent T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:30.684171  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.686012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.690816  7173 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:30.688144  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.703343  1544 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:30.705276  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.668567  7063 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:02:30.710150  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:30.713147  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.677639  7080 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.649086  7245 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.714510  6655 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:30.678848  7078 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:30.677160  7119 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:02:30.721807  7240 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.743506  6926 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.720522  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.748636  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:30.722333  7173 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.750984  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:30.755748  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:30.757735  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 44528.4us
I20260709 13:02:30.724382  7080 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.760350  7233 raft_consensus.cc:3055] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.753926  7274 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:30.760810  7233 raft_consensus.cc:740] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:30.760964  7080 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.761572  1541 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
I20260709 13:02:30.761770  7233 consensus_queue.cc:260] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.764096  7233 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.746820  7078 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:30.767990  7269 log.cc:927] Time spent T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.272s	user 0.003s	sys 0.000s
I20260709 13:02:30.769608  7078 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.752470  6972 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:30.758930  1512 leader_election.cc:400] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 16. Current term is 17.
I20260709 13:02:30.785730  7248 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.789031  7245 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.796968  7248 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:30.757755  7170 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.801227  7254 raft_consensus.cc:3055] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:30.771188  7259 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.781263  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:30.830905  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 49759.4us
I20260709 13:02:30.814496  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:30.814922  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:30.808560  7261 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:02:30.817116  1546 raft_consensus.cc:1240] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:30.818416  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:30.819101  2261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:30.820783  1660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.820886  1587 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:30.835891  1659 leader_election.cc:304] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:30.806412  7178 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.838025  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.838511  2266 raft_consensus.cc:2393] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 18: Already voted for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in this term.
I20260709 13:02:30.838836  1545 raft_consensus.cc:2393] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 13: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:30.838997  7243 raft_consensus.cc:2804] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:30.839577  7243 raft_consensus.cc:697] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:30.840467  7243 consensus_queue.cc:237] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.840917  6625 consensus_queue.cc:1059] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:30.842147  6926 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:30.842516  6926 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:30.843315  6926 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.843812   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.822201  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.847604  1540 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.822296  1544 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:30.824577  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.852626  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:30.853078  7178 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.829123  7254 raft_consensus.cc:740] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:30.854751  7254 consensus_queue.cc:260] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.856019  7254 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.862790  7181 raft_consensus.cc:2749] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:30.870894  1692 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.826061  1693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43624 (request call id 1093) took 1078 ms. Trace:
I20260709 13:02:30.828199  1691 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:02:30.829893  1543 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:30.830917  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:30.875321  1694 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:02:30.833117  1688 raft_consensus.cc:3060] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:30.833206  1687 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:30.815668  1690 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:30.881603  1622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38818 (request call id 2394) took 1016 ms. Trace:
I20260709 13:02:30.882019  1622 rpcz_store.cc:276] 0709 13:02:29.865312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.868778 (+  3466us) service_pool.cc:224] Handling call
0709 13:02:29.869025 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.243066 (+374041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.881389 (+638323us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b5400231754. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:30.881552 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":786268928}
I20260709 13:02:30.833412  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:30.833554  7240 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:30.888599  1539 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:30.871717  1693 rpcz_store.cc:276] 0709 13:02:29.748099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.749078 (+   979us) service_pool.cc:224] Handling call
0709 13:02:29.749358 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:30.051300 (+301942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:30.825798 (+774498us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400453dd4. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a843571 00007f7f1a8dae01 00007f7f1a8d983e 00007f7f1f89e419 00007f7f18e15bd4 00007f7f18e15b62 00007f7f18e15a91 00007f7f18e15a0c 00007f7f18e14cc2 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:30.825973 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679224192}
I20260709 13:02:30.882766  7233 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:30.891657  7233 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.893750  7233 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:30.896399  6696 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:30.897805  6696 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:30.903998  6926 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.916373  1689 raft_consensus.cc:2368] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16.
I20260709 13:02:30.916963  2231 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.919970  1539 raft_consensus.cc:1240] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:02:30.922118  7014 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:30.929952  7259 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.930595  7192 consensus_queue.cc:1059] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:30.932353  7192 consensus_queue.cc:1243] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer 2080b3bca2e64a1a953c17b506b668d2 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:02:30.932950  7023 raft_consensus.cc:3055] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:30.933296  7023 raft_consensus.cc:740] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:30.934427  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:30.934130  7023 consensus_queue.cc:260] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.943514  7023 raft_consensus.cc:3060] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:30.944545  7102 consensus_queue.cc:1059] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:30.948480  7102 raft_consensus.cc:3055] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:30.948812  1542 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:02:30.948882  7102 raft_consensus.cc:740] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:30.950014  7102 consensus_queue.cc:260] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:30.952155  7102 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:30.955557  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
W20260709 13:02:30.957404  1661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.957643  1688 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:30.963725  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.964900  1587 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:30.965793  1540 raft_consensus.cc:2468] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:30.967274  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:30.974220  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:30.974869  1541 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:30.986706  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.989666  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.991063  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:30.992268  1512 leader_election.cc:400] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16.
I20260709 13:02:30.992679  1512 leader_election.cc:403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:30.994333  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:30.994648  1621 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:30.997757  7014 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:31.012614  1538 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:30.998518  7228 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:02:31.000069  1539 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:30.964263  7181 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.014932  7181 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.017297  7181 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:30.984983  7231 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.007342  7170 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.014348  6696 raft_consensus.cc:3055] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:02:31.018299  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 54673.5us
I20260709 13:02:31.018767  1613 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.023995  1541 raft_consensus.cc:2468] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:02:31.027916  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:31.037969  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:31.033802  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 69053.6us
I20260709 13:02:30.964809  7185 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.046170  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.046986  2231 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.048761  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.064204  2257 raft_consensus.cc:1275] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:02:31.069796  1511 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.027360  7260 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.027545  7209 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.036298  6696 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:31.042052  7254 raft_consensus.cc:2804] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:31.081377  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.027469  7285 raft_consensus.cc:3060] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.042518  7185 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.068090  7234 raft_consensus.cc:2804] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:31.107494  7229 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:31.115841  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.117765  1511 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.090234  6870 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.088035  7040 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.105700  7185 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.084434  7240 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:31.122550  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.035918  7231 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.112670  7254 raft_consensus.cc:697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:31.137542  1587 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.118747  7234 raft_consensus.cc:697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:31.136991  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.154991  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:31.155714  1695 raft_consensus.cc:606] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:31.156119  1695 raft_consensus.cc:614] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.162319  7254 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.144016  6644 raft_consensus.cc:2804] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:31.167780  6644 raft_consensus.cc:697] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:31.168867  6644 consensus_queue.cc:237] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.171144  7231 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.171758  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.175629  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.126374  7140 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:31.176278  1541 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:31.166719  1443 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 10, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.127574  7229 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.178884  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.130556  7135 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:02:31.144824  7040 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:31.193837  7040 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:31.194346  7040 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.129308  7248 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:02:31.199740  2257 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:51160
I20260709 13:02:31.200177  7263 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.200647  2257 raft_consensus.cc:606] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.200943  7263 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.173144  7240 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.203606   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:31.127878  7129 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:02:31.191220  7234 consensus_queue.cc:237] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:31.205300   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:31.189460  7153 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.208230  7153 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.208598  7153 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.209174  7285 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 15. Current term is 16.
I20260709 13:02:31.127702  6870 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.213848  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.214768  1541 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:31.124680  7243 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:02:31.130762  7181 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:02:31.218632  1613 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:31.222666  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:31.224373  2262 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 17. Current term is 18. Ops: []
I20260709 13:02:31.220590  1660 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.229993  1540 raft_consensus.cc:2468] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:31.228746  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.232937  6926 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:31.234201  6926 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.234565  6926 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.230703  7259 raft_consensus.cc:2804] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:31.226503  7003 consensus_queue.cc:1048] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:02:31.238981  7259 raft_consensus.cc:697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:31.239902  7259 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.231333  7263 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.248165  7170 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.251987  6696 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.253137  7040 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.281543  6870 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.244333  1443 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 5 to 8, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.283928  1443 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 3 to 12. New cstate: current_term: 12 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.286854  7278 consensus_queue.cc:1059] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:31.287961  7278 consensus_queue.cc:1243] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer e51b0b5dc04b4f5aaf6a3a870f291345 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:02:31.288539  7278 raft_consensus.cc:3055] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:31.288929  7278 raft_consensus.cc:740] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:31.309540  1613 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.314494  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.312194  7185 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.247807  6926 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.348609  7154 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.373191  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:31.375403  1689 raft_consensus.cc:1240] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:31.290011  7278 consensus_queue.cc:260] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:31.381600  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:31.348176  7168 consensus_queue.cc:1059] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:31.409162  1538 raft_consensus.cc:1240] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:02:31.375495  7254 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:31.389303  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.424067  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.416137  7040 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.431407  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:31.439523  7185 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.441697  7153 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.426024  7254 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.376807  7154 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.444527  7153 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.446282  7154 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.451547  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:31.452147  1621 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.454324  1688 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 16.
I20260709 13:02:31.413154  7278 raft_consensus.cc:3060] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:31.392840  7129 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:02:31.468122  7173 raft_consensus.cc:993] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: : Instructing follower c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:02:31.468636  7173 raft_consensus.cc:1081] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Signalling peer c5f349bdadfc40b9bff8e1682b5c271b to start an election
W20260709 13:02:31.470072  7296 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:31.444561  7254 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.473285  6926 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.390256  7116 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:02:31.474764  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:31.401809  7248 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:02:31.457176  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:31.458503  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:31.459806  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.460839  1619 raft_consensus.cc:2393] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 15: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:31.456914  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.483424  1538 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.430035  6807 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.455627  7263 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.484798  1539 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:31.488066  1621 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:31.493294  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.540747  6696 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:31.486377  7169 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:31.543187  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62893.4us
I20260709 13:02:31.533725  6625 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:31.553673  6625 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:31.554690  6625 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.562463  1544 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:31.563459  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:31.564064  1546 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.569219  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:31.569619  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:31.569859  1690 raft_consensus.cc:3060] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:31.574023  1538 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:31.576715  1538 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:31.577807  1695 raft_consensus.cc:1275] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:02:31.579455  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.580339  1541 raft_consensus.cc:2368] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16.
I20260709 13:02:31.582918  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.495201  7263 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.594544  1546 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:31.598047  1693 raft_consensus.cc:1240] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:02:31.603106  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.609122  1690 raft_consensus.cc:2468] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:31.609486  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.619058  1587 leader_election.cc:400] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16.
I20260709 13:02:31.619532  1587 leader_election.cc:403] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:31.551636  7169 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.611756  7264 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:31.622905  7181 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:31.647928  7181 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:31.648999  7181 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.665896  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.667488  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.668350  1541 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:31.668495  7248 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.669044  7248 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.672227  6696 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:31.672688  6696 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:31.673034  6696 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.611428  7003 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:31.624706  7244 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:31.684305  1541 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:31.676028  7278 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175) with higher term. Message: Invalid argument: T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for earlier term 15. Current term is 16.
I20260709 13:02:31.631595  7135 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:31.719702  7248 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.695040  7023 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:02:31.729321  7263 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:31.728792  6696 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:31.737265  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 125249us
I20260709 13:02:31.738173  6696 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.740264  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:31.744840  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.745407  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.745464  1541 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:31.746260  1538 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:31.753202  1542 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:02:31.756608  7309 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.757380  7309 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:31.760187  7309 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:31.762382  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:31.767500  7302 log.cc:927] Time spent T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:02:31.781791  1619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:47468
I20260709 13:02:31.782641  1619 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.783170  1619 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:31.775381  7169 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:31.742370  7244 consensus_queue.cc:1048] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:02:31.750703  7278 consensus_queue.cc:1059] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:02:31.798452  7278 raft_consensus.cc:3055] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:31.798983  7278 raft_consensus.cc:740] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:31.799978  7278 consensus_queue.cc:260] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.815279  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:31.815655  1618 raft_consensus.cc:1275] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:02:31.816001  1618 pending_rounds.cc:85] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting all ops after (but not including) 12
I20260709 13:02:31.816145  1538 raft_consensus.cc:2410] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:02:31.816205  1618 pending_rounds.cc:107] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:02:31.816576  1618 raft_consensus.cc:2889] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.814690  1619 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:31.830178  6972 consensus_queue.cc:1048] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:31.849015  1587 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.858551  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.835331  7278 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:31.857586  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:31.864061  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:31.872835  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:31.879503  1587 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:31.880358  7116 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:31.881783  7310 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.863269  7169 raft_consensus.cc:2804] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:31.870643  7135 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:31.890695  6870 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:31.897017  6870 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.897491  6870 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.906967  7135 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.907511  7135 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:31.907913  7169 raft_consensus.cc:697] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
W20260709 13:02:31.909500  7304 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:02:31.909281  7169 consensus_queue.cc:237] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:31.875221  7244 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:31.914057  7244 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.889930  1619 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 21 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:31.891914  1511 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:31.927203  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:31.914440  7244 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:31.936583  7306 log.cc:927] Time spent T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 13:02:31.942358  1613 raft_consensus.cc:1240] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 FOLLOWER]: Rejecting Update request from peer e51b0b5dc04b4f5aaf6a3a870f291345 for earlier term 20. Current term is 21. Ops: []
I20260709 13:02:31.944881  7023 consensus_queue.cc:1059] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:31.947113  7189 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:02:31.947294  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 55462.9us
I20260709 13:02:31.972556  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:31.985168  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:31.985450  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:31.986846  1615 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:31.990232  1540 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:32.017495  2262 raft_consensus.cc:3055] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:02:32.018071  2262 raft_consensus.cc:740] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:32.018890  1690 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:02:31.980875  7307 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:32.019093  2262 consensus_queue.cc:260] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.033020  2262 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.016083  6806 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.067039  1544 raft_consensus.cc:1240] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Rejecting Update request from peer c5f349bdadfc40b9bff8e1682b5c271b for earlier term 16. Current term is 17. Ops: []
I20260709 13:02:32.094923  1690 raft_consensus.cc:1275] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:02:32.105932  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:32.106841  1692 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:02:32.048400  7245 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.113165  2262 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 21.
I20260709 13:02:32.121297  7295 consensus_queue.cc:1048] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:32.121750  1585 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.123839  7295 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:02:32.124332  7295 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:32.123840  1619 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:02:32.117913  7309 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:32.049294  7181 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:02:32.131932  7023 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:02:32.136888  7003 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:02:32.101464  6806 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.147536  1544 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:02:32.052986  7307 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.139199  7231 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.128670  7135 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.128924  7245 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.191296  7247 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:02:32.228466  1621 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 17: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:32.232702  1692 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 21.
I20260709 13:02:32.189428  7129 consensus_queue.cc:1059] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:02:32.191675  7244 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.141526  7295 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.215409  7213 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:02:32.206209  7231 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:32.255594  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 112650us
I20260709 13:02:32.229290  6870 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.300001  1691 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 17: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:32.285873  7176 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.338034  7168 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:32.370286  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:32.341869  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:32.344534  7323 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.199s	user 0.006s	sys 0.000s
W20260709 13:02:32.346377  7325 log.cc:927] Time spent T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:02:32.373582  1542 raft_consensus.cc:3060] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.356210  7307 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:32.363438  6806 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:32.364120  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:32.365978  6870 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:32.366585  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:32.367132  7135 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:32.369938  7329 log.cc:927] Time spent T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:02:32.370112  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:32.384166  7245 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:32.351723  7231 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:32.371057  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:32.370411  7176 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.387034  2262 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:32.376554  7168 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.388670  1541 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 12.
I20260709 13:02:32.389127  7176 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.390998  1510 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.391597  7244 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.392184  7231 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:32.392594  7231 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.392952  7231 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.395551  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:32.396414  1538 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.386241  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:32.400315  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
W20260709 13:02:32.400686  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 96667.7us
I20260709 13:02:32.402520  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.403388  7245 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.403752  7245 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.404088  7245 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.438911  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.439706  1622 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:32.445034  1692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:32.445724  1692 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:32.451769  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.453163  7102 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:32.453570  7102 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.453958  7102 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.459178  7244 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.459944  7244 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.462141  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.463089  1615 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 13.
I20260709 13:02:32.464058  7244 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.464267  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:32.467803  7168 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.469687  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
W20260709 13:02:32.488142  7327 log.cc:927] Time spent T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.370s	user 0.004s	sys 0.003s
I20260709 13:02:32.517498  1542 raft_consensus.cc:2468] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:32.460536  1622 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:32.520895  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:32.581045  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 60302.6us
I20260709 13:02:32.528203  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.581908  1621 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
W20260709 13:02:32.544852  7321 log.cc:927] Time spent T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.400s	user 0.005s	sys 0.001s
I20260709 13:02:32.547196  7213 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.553037   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:32.549474  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:32.637584  1691 raft_consensus.cc:2393] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c5f349bdadfc40b9bff8e1682b5c271b in current term 17: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:32.550702  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:32.580041  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:32.526981  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.586602  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:32.590178  1541 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:32.638868  1619 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:32.638976  1687 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 13.
I20260709 13:02:32.585649  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:32.592991  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
W20260709 13:02:32.640125  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 47262.8us
I20260709 13:02:32.599226  1538 raft_consensus.cc:2468] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:32.645624  1688 raft_consensus.cc:1275] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:02:32.651289  1512 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:32.649765  1587 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:32.657366  6696 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:32.657744  6696 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:32.658057  6696 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:32.665611  1541 raft_consensus.cc:1240] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:02:32.666246  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:32.634807  7168 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.680085  7102 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.682286  7102 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.649183  7213 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.689160  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:32.690580  1688 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.650811  7233 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:32.669323  7339 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.684136  7309 raft_consensus.cc:2804] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:32.705538  1689 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:32.709291  1688 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:32.642266  1542 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:32.725016  2231 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.726212  7236 raft_consensus.cc:2804] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:32.726876  7236 raft_consensus.cc:697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:32.727959  7236 consensus_queue.cc:237] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.700982  6926 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:02:32.704206  7339 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.748256  7339 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.736056  7309 raft_consensus.cc:697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:32.745846  7278 raft_consensus.cc:3055] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:32.734205  7305 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.755606  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:32.703445  7233 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:32.782420  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 51138us
I20260709 13:02:32.786886  6696 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:32.774933  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 53141.8us
I20260709 13:02:32.799116  1587 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:32.806685  6696 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:32.813941  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 141623us
I20260709 13:02:32.739624  6870 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:02:32.759754  7278 raft_consensus.cc:740] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:32.828668  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:32.835348  1544 raft_consensus.cc:3060] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.810647  6872 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:32.810216  1440 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 6 to 14, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:32.841454  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:32.760461  7169 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:02:32.797835  7305 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.839911  6872 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.865339  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:32.867372  1544 raft_consensus.cc:2468] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:32.873732  1542 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:32.867187  6872 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.854939  7181 consensus_queue.cc:1059] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:02:32.905072  7209 raft_consensus.cc:3055] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:02:32.905489  7209 raft_consensus.cc:740] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:32.906524  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:32.906337  7209 consensus_queue.cc:260] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.907397  1621 raft_consensus.cc:2393] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 13: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:32.907696  7209 raft_consensus.cc:3060] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:32.891585  7233 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:32.869818  7254 consensus_queue.cc:1048] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:02:32.912403  7340 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:32.912920  2266 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:32.869199  7278 consensus_queue.cc:260] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.914750  7334 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:02:32.893191  7245 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.855304  7309 consensus_queue.cc:237] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.893843  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:32.896528  7231 consensus_meta.cc:287] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:02:32.928246  7231 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.930390  7231 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:32.900012  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 101014us
I20260709 13:02:32.934598  7278 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:32.900624  7335 raft_consensus.cc:2804] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:32.901051  7213 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:32.938983  7335 raft_consensus.cc:697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:32.939288  7305 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.940068  7346 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:32.940016  7335 consensus_queue.cc:237] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.940703  7346 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:32.942854  7346 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:32.902981  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:32.924054  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 48875.9us
I20260709 13:02:32.954022  1693 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:02:32.954344  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.954990  1618 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:32.955093  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:32.955680  2262 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.957314  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:32.957469  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:32.958066  7346 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:32.958434  7346 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:32.958815  7346 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.963176  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:32.963819  1613 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:32.969877  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:32.970695  2266 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.968156  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:32.975312  1618 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:32.979892  1613 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:32.981104  1511 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:32.981823  6696 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:32.982280  6696 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:32.982995  6696 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:32.983480  2262 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:32.995585  2266 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:32.965333  7245 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:32.997169  1510 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:32.967114  7346 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.012071  7245 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:32.994890  6644 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:02:33.040527  1618 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:33.069432  7346 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:33.071274  6872 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.073019  1615 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 16: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:33.073627  6872 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:33.042028  7245 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:33.079797  7245 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:33.090732  7339 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.091161  1661 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:33.091985  1689 raft_consensus.cc:2368] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:33.093394  7339 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:33.097432  6926 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:33.097827  6926 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.098147  6926 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.103785  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:33.104045  1693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:33.104565  1689 raft_consensus.cc:2368] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:33.105597  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:33.105870  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:33.106295  1689 raft_consensus.cc:2393] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 14: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:33.107201  1512 leader_election.cc:400] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:33.107517  1512 leader_election.cc:403] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.110399  1512 leader_election.cc:400] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:33.110699  1512 leader_election.cc:403] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:33.110601  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:33.111366  1544 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.113181  7228 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 14. Current term is 15.
I20260709 13:02:33.114312  1440 catalog_manager.cc:5697] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 9 to 10, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.116029  1440 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.117532  1440 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 14, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:33.118835  1544 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:33.119397  7346 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637) with higher term. Message: Invalid argument: T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 for earlier term 13. Current term is 14.
I20260709 13:02:33.138013  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:33.138661  1622 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:33.145087  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
W20260709 13:02:33.149612  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 155174us
I20260709 13:02:33.152204  1615 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 14.
I20260709 13:02:33.156867  1511 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:33.159891  7351 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:33.160416  7351 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:33.161237  7351 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.169673  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:33.170287  1539 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:33.170985  6926 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.172926  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:33.176302  1692 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:33.177927  7173 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:33.178498  1622 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:33.203272  1539 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:33.210374  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:33.217558  1587 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:33.230414  1693 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc4df0bb934bba941cfa20c0afead2 in current term 16: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:33.238415  7263 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:33.239059  7263 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:33.240080  7263 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.224148  7244 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:33.290760  7244 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:33.314188  7244 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:33.323611  7354 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:02:33.335016  7355 log.cc:927] Time spent T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:02:33.350432  6926 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:33.364400  7357 log.cc:927] Time spent T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.171s	user 0.003s	sys 0.001s
I20260709 13:02:33.404837  1440 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 7 to 11, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.410918  1440 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.420205  1540 raft_consensus.cc:1275] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:02:33.430029  1544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:33.434551  1544 raft_consensus.cc:2393] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 16: Already voted for candidate c5f349bdadfc40b9bff8e1682b5c271b in this term.
I20260709 13:02:33.422803  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:33.447382  1440 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.475867  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:33.483893  1660 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:33.495677  6655 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:33.498548  1619 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:33.495926  1540 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:33.506585  1696 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:02:33.542363  1539 raft_consensus.cc:1275] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:02:33.539173  7129 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:02:33.576570  1696 pending_rounds.cc:85] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Aborting all ops after (but not including) 7
I20260709 13:02:33.588045  1696 pending_rounds.cc:107] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:02:33.592792  1696 raft_consensus.cc:2889] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:33.595595  1443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 308) took 33217 ms (client timeout 15000 ms). Trace:
W20260709 13:02:33.595588  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 98858.4us
I20260709 13:02:33.502904  6655 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:02:33.516216  6806 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:02:33.616019  1621 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:33.531859  1440 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:33.622694  2266 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:33.622804  7335 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:33.627439  1696 raft_consensus.cc:1275] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:33.629009  7346 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:33.633600  7351 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:33.641211  1694 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:33.650321  7346 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:33.670377  1541 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:33.666034  7129 consensus_queue.cc:1048] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 13:02:33.599341  1443 rpcz_store.cc:269] 0709 13:02:00.339168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.339724 (+   556us) service_pool.cc:224] Handling call
0709 13:02:33.555999 (+33216275us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:31.694075 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:31.711421 (+ 17346us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:31.711457 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:02:31.711474 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:31.712025 (+   551us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:31.712102 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:31.712143 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:02:31.712469 (+   326us) tablet.cc:701] Row locks acquired
0709 13:02:31.712485 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:31.712611 (+   126us) write_op.cc:270] Start()
0709 13:02:31.712723 (+   112us) write_op.cc:276] Timestamp: P: 1783602151712568 usec, L: 0
0709 13:02:31.712745 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:31.713407 (+   662us) log.cc:844] Serialized 1375 byte log entry
0709 13:02:31.932283 (+218876us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b54003c8aa0. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a844090 00007f7f1a8516b8 00007f7f1a8512fa 00007f7f1a8d5965 00007f7f1a8d5e09 00007f7f1e310581 00007f7f1e30fd58 00007f7f1e3149f1 00007f7f1e3149a9 00007f7f1e314939 00007f7f1e314901
0709 13:02:32.007343 (+ 75060us) op_driver.cc:464] REPLICATION: finished
0709 13:02:32.308780 (+301437us) write_op.cc:301] APPLY: starting
0709 13:02:32.308870 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:32.359583 (+ 50713us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:32.359618 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:32.361698 (+  2080us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:32.361905 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:02:32.361949 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:32.362208 (+   259us) log.cc:844] Serialized 41 byte log entry
0709 13:02:32.362386 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:32.362483 (+    97us) write_op.cc:454] Released schema lock
0709 13:02:32.362524 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:32.518762 (+156238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:32.518794 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1311679,"reported_tablets":48,"spinlock_wait_cycles":114432,"child_traces":[["op",{"apply.queue_time_us":291437,"apply.run_cpu_time_us":6374,"apply.run_wall_time_us":212697,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16661,"num_ops":3,"prepare.queue_time_us":317937,"prepare.run_cpu_time_us":31985,"prepare.run_wall_time_us":293372,"raft.queue_time_us":189005,"raft.run_cpu_time_us":7700,"raft.run_wall_time_us":228910,"replication_time_us":294432,"spinlock_wait_cycles":12338048,"thread_start_us":648291,"threads_started":4,"wal-append.queue_time_us":97020,"wal-append.run_cpu_time_us":25195,"wal-append.run_wall_time_us":1552487}]]}
I20260709 13:02:33.692469  1440 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 9, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:33.696877  2257 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:33.695777  6644 consensus_queue.cc:1048] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:02:33.726864  7234 consensus_queue.cc:1048] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:33.731637  6696 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:33.694572  1440 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 7 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.760462  1440 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.764207  1620 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:33.764038  1440 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 12, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.771888  6696 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:33.771999  1440 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.774286  1440 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 8 to 10, now has a pending config: VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193), VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194), VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195), VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:33.802861  7263 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:33.820559  7263 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:33.824071  7338 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:02:33.831296  7263 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:33.843542  1695 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:33.859000  1622 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:02:33.864594  1543 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:33.868757  1619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:33.869781  1619 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:33.870929  7116 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:02:33.877542  7169 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:33.877866  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:33.878809  6806 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:33.879418  7338 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:33.879912  7338 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:02:33.880280  7373 log.cc:927] Time spent T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:02:33.880330  7338 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:33.928534  1545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2" is_pre_election: true
I20260709 13:02:33.929590  1545 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 17: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:33.935837  1440 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 15, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:34.062309  7379 log.cc:927] Time spent T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.137s	user 0.003s	sys 0.012s
I20260709 13:02:34.062983  1440 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.079411  1440 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.088783  1440 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 14, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.090673  1440 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 11, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.093127  7346 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.093792  7346 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:34.096933  7346 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:34.098395  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:34.099805  1440 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 11, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.101991  1440 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 9 to 10, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.109885  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:34.132196  1620 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
I20260709 13:02:34.231483  1440 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.234403  1440 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.258778  1440 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 9 to 12, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.265800  7338 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:34.305243  7384 log.cc:927] Time spent T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:34.303978  1440 catalog_manager.cc:5697] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:34.328106  1694 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
W20260709 13:02:34.498785  7386 log.cc:927] Time spent T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:34.500363   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:34.531308  7338 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:34.565759  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 264794us
I20260709 13:02:34.585417  1546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:34.591691  1546 raft_consensus.cc:2393] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2080b3bca2e64a1a953c17b506b668d2 in current term 17: Already voted for candidate 9fbc4df0bb934bba941cfa20c0afead2 in this term.
I20260709 13:02:34.597127  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:34.629520  1620 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:34.636184  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:34.646142  6655 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:34.648293  6655 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.648725  6655 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:34.697997  6655 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:34.717798  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:34.718420  1690 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:34.738940  1690 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
I20260709 13:02:34.739563  6655 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:34.752995  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 128745us
I20260709 13:02:34.758976  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:34.772799  7213 raft_consensus.cc:2764] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:02:34.793823  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:34.794443  1622 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:34.810773  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 129062us
I20260709 13:02:34.802520  1622 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
W20260709 13:02:34.852032  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 94299.6us
I20260709 13:02:34.854627  1512 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:34.855453  7350 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:34.855948  7350 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:34.856914  7350 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:34.964092  1543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:49324
I20260709 13:02:34.964920  1543 raft_consensus.cc:606] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:34.965296  1543 raft_consensus.cc:614] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:34.968811  2260 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4bd73d471194556a9ba093049d04790"
dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:51160
I20260709 13:02:34.969394  2260 raft_consensus.cc:606] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:34.969723  2260 raft_consensus.cc:614] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:34.971345   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:34.973023   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:35.249326  1440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 205) took 27189 ms (client timeout 15000 ms). Trace:
W20260709 13:02:35.249838  1440 rpcz_store.cc:269] 0709 13:02:08.060200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.060759 (+   559us) service_pool.cc:224] Handling call
0709 13:02:35.249248 (+27188489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:34.676210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:34.676966 (+   756us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:34.677025 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:02:34.677044 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:34.731002 (+ 53958us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:34.731126 (+   124us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:34.731158 (+    32us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:02:34.807117 (+ 75959us) tablet.cc:701] Row locks acquired
0709 13:02:34.807165 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:34.807357 (+   192us) write_op.cc:270] Start()
0709 13:02:34.807502 (+   145us) write_op.cc:276] Timestamp: P: 1783602154807264 usec, L: 0
0709 13:02:34.807547 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.808361 (+   814us) log.cc:844] Serialized 10039 byte log entry
0709 13:02:34.927671 (+119310us) op_driver.cc:464] REPLICATION: finished
0709 13:02:34.931159 (+  3488us) write_op.cc:301] APPLY: starting
0709 13:02:34.931270 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:34.965707 (+ 34437us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:34.965830 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:34.989091 (+ 23261us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:34.989483 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:02:34.989542 (+    59us) write_op.cc:312] APPLY: finished
0709 13:02:34.990053 (+   511us) log.cc:844] Serialized 220 byte log entry
0709 13:02:34.992882 (+  2829us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.993088 (+   206us) write_op.cc:454] Released schema lock
0709 13:02:34.993168 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:34.994979 (+  1811us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:34.995008 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":955123,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":3195,"apply.run_cpu_time_us":29082,"apply.run_wall_time_us":63787,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108577,"num_ops":25,"prepare.queue_time_us":114692,"prepare.run_cpu_time_us":76892,"prepare.run_wall_time_us":242634,"raft.queue_time_us":14033,"raft.run_cpu_time_us":2569,"raft.run_wall_time_us":7454,"replication_time_us":119962,"thread_start_us":147718,"threads_started":4,"wal-append.queue_time_us":79370}]]}
I20260709 13:02:35.416018  1615 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:02:35.465171  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 56298.1us
I20260709 13:02:35.459136  6655 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:02:35.502367  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 82350.2us
I20260709 13:02:35.523500  1439 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 2 to 8, term changed from 10 to 12, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193), VOTER c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194), VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195), VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.545811  1689 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:02:35.555804  7233 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:35.526103  1439 catalog_manager.cc:5697] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.564608  1439 catalog_manager.cc:5697] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 11 to 13, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.593931  1439 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 8 to 14. New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.595387  1439 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 14 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.596957  1439 catalog_manager.cc:5697] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.598290  1439 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.639647  1439 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.641489  1439 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 12 to 13, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.651681  1439 catalog_manager.cc:5697] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 15 to 16, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.662074  1439 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.663599  1439 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.665658  1439 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 8 to 15, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.714190  1439 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.717612  1439 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 11, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.738878  1439 catalog_manager.cc:5697] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 11 to 12, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.741133  1439 catalog_manager.cc:5697] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 8 to 13, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.757663  1439 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 10, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.776024  1439 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.777596  1439 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 11, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.788020  1439 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 12, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.801904  1439 catalog_manager.cc:5697] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 13 to 15, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:35.803750  1439 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.824005  1439 catalog_manager.cc:5697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 4 to 13, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.825707  1439 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 9 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:35.827382  1439 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 10 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.974160   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:36.154939  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 295) took 13809 ms (client timeout 15000 ms). Trace:
I20260709 13:02:36.194504  1438 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.266830  1438 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 10 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:36.272053  1438 catalog_manager.cc:5697] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 12 to 13, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:36.181782  1439 rpcz_store.cc:269] 0709 13:02:22.345667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.346002 (+   335us) service_pool.cc:224] Handling call
0709 13:02:22.791858 (+445856us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b54002d0190. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5e9c 00007f7f177b60f6 00007f7f2072fa89 00007f7f206c7da6 00007f7f20699088 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc
0709 13:02:36.154850 (+13362992us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:35.865435 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:35.882715 (+ 17280us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:35.882749 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:02:35.882766 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:35.884534 (+  1768us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:35.884601 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:35.884627 (+    26us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:02:35.891585 (+  6958us) tablet.cc:701] Row locks acquired
0709 13:02:35.891609 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:35.891774 (+   165us) write_op.cc:270] Start()
0709 13:02:35.891916 (+   142us) write_op.cc:276] Timestamp: P: 1783602155891721 usec, L: 0
0709 13:02:35.891940 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:35.894823 (+  2883us) log.cc:844] Serialized 10246 byte log entry
0709 13:02:35.920372 (+ 25549us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.934666 (+ 14294us) write_op.cc:301] APPLY: starting
0709 13:02:35.934770 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.022026 (+ 87256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.022139 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.056799 (+ 34660us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.057184 (+   385us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=0,mrs_lookups=0
0709 13:02:36.057234 (+    50us) write_op.cc:312] APPLY: finished
0709 13:02:36.057743 (+   509us) log.cc:844] Serialized 228 byte log entry
0709 13:02:36.060884 (+  3141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.061121 (+   237us) write_op.cc:454] Released schema lock
0709 13:02:36.061194 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.061591 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.061621 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12939,"reported_tablets":48,"spinlock_wait_cycles":13654528,"child_traces":[["op",{"apply.queue_time_us":13995,"apply.run_cpu_time_us":30953,"apply.run_wall_time_us":126922,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112755,"num_ops":26,"prepare.queue_time_us":25202,"prepare.run_cpu_time_us":6450,"prepare.run_wall_time_us":56677,"replication_time_us":28270,"thread_start_us":45138,"threads_started":2}]]}
I20260709 13:02:36.301295  1438 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 11 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.310395  1438 catalog_manager.cc:5697] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.317237  1438 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 14 to 19, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.335196  1438 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.343318  1438 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 10 to 13, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:36.349828  1438 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 13 to 14, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.373739  1438 catalog_manager.cc:5697] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 4 to 12, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:36.380775  1438 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 12 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.399061  1438 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 7 to 12, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:36.405557  1438 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 12 to 14, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:36.604471  1442 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 16 to 18, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.606791  1442 catalog_manager.cc:5697] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.617748  1442 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:36.632321  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 309) took 13984 ms (client timeout 15000 ms). Trace:
W20260709 13:02:36.634784  1438 rpcz_store.cc:269] 0709 13:02:22.647691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.647984 (+   293us) service_pool.cc:224] Handling call
0709 13:02:36.632235 (+13984251us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.477795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.487753 (+  9958us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.487797 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:02:36.487832 (+    35us) tablet.cc:662] Decoding operations
0709 13:02:36.489084 (+  1252us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.489153 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.489187 (+    34us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:02:36.499161 (+  9974us) tablet.cc:701] Row locks acquired
0709 13:02:36.499187 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:02:36.499348 (+   161us) write_op.cc:270] Start()
0709 13:02:36.499474 (+   126us) write_op.cc:276] Timestamp: P: 1783602156499298 usec, L: 0
0709 13:02:36.499501 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:02:36.507063 (+  7562us) log.cc:844] Serialized 5168 byte log entry
0709 13:02:36.523819 (+ 16756us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.524135 (+   316us) write_op.cc:301] APPLY: starting
0709 13:02:36.524217 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.529981 (+  5764us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.530075 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.547725 (+ 17650us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.547969 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:02:36.548016 (+    47us) write_op.cc:312] APPLY: finished
0709 13:02:36.548333 (+   317us) log.cc:844] Serialized 121 byte log entry
0709 13:02:36.570911 (+ 22578us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.571082 (+   171us) write_op.cc:454] Released schema lock
0709 13:02:36.571145 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.571749 (+   604us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.571780 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5234,"reported_tablets":48,"spinlock_wait_cycles":5248,"child_traces":[["op",{"apply.queue_time_us":101,"apply.run_cpu_time_us":15184,"apply.run_wall_time_us":47361,"cfile_cache_hit":52,"cfile_cache_hit_bytes":54314,"num_ops":13,"prepare.queue_time_us":49338,"prepare.run_cpu_time_us":4895,"prepare.run_wall_time_us":61040,"replication_time_us":24149,"thread_start_us":48574,"threads_started":1}]]}
I20260709 13:02:36.633361  1442 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 13, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.639593  1442 catalog_manager.cc:5697] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 16, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.641433  1442 catalog_manager.cc:5697] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.647439  1442 catalog_manager.cc:5697] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.651863  1442 catalog_manager.cc:5697] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 16, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.653826  1442 catalog_manager.cc:5697] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 11 to 14, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.657239  1442 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 12 to 15, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.661445  1442 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.685067  1442 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.689312  1442 catalog_manager.cc:5697] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.709641  1442 catalog_manager.cc:5697] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.711416  1442 catalog_manager.cc:5697] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.713516  1442 catalog_manager.cc:5697] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 12 to 15, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.717201  1442 catalog_manager.cc:5697] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 7 to 18, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:36.899084  1442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 206) took 5890 ms. Trace:
I20260709 13:02:36.906289  1442 rpcz_store.cc:276] 0709 13:02:31.008380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.008580 (+   200us) service_pool.cc:224] Handling call
0709 13:02:31.027997 (+ 19417us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b54003c8554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a844090 00007f7f1a8e2f3a 00007f7f206991cc 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc 00007f7f1ec57392 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:36.898997 (+5871000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:36.785422 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:36.785947 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:36.785989 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:02:36.786007 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:36.787413 (+  1406us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:36.787478 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:36.787508 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:36.788786 (+  1278us) tablet.cc:701] Row locks acquired
0709 13:02:36.788808 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:02:36.788957 (+   149us) write_op.cc:270] Start()
0709 13:02:36.789076 (+   119us) write_op.cc:276] Timestamp: P: 1783602156788913 usec, L: 0
0709 13:02:36.789098 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:36.789807 (+   709us) log.cc:844] Serialized 6661 byte log entry
0709 13:02:36.792778 (+  2971us) op_driver.cc:464] REPLICATION: finished
0709 13:02:36.793290 (+   512us) write_op.cc:301] APPLY: starting
0709 13:02:36.793392 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:36.801981 (+  8589us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:36.802093 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:36.851386 (+ 49293us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:36.851682 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:02:36.851733 (+    51us) write_op.cc:312] APPLY: finished
0709 13:02:36.852131 (+   398us) log.cc:844] Serialized 156 byte log entry
0709 13:02:36.852998 (+   867us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.853185 (+   187us) write_op.cc:454] Released schema lock
0709 13:02:36.853247 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:36.853631 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:36.853664 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15223,"reported_tablets":34,"spinlock_wait_cycles":12530432,"child_traces":[["op",{"apply.queue_time_us":296,"apply.run_cpu_time_us":20477,"apply.run_wall_time_us":60303,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71026,"num_ops":17,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":4714,"prepare.run_wall_time_us":13343,"replication_time_us":3527}]]}
I20260709 13:02:37.044831  1444 catalog_manager.cc:5697] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.047307  1444 catalog_manager.cc:5697] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 15 to 16, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.049818  1444 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 10 to 16, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:02:37.055284  1445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47940 (request call id 204) took 46223 ms (client timeout 15000 ms). Trace:
W20260709 13:02:37.055781  1445 rpcz_store.cc:269] 0709 13:01:50.831392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.832633 (+  1241us) service_pool.cc:224] Handling call
0709 13:01:50.863874 (+ 31241us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002d0190. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b5b71 00007f7f177b60b2 00007f7f2072fa89 00007f7f206c7da6 00007f7f20699088 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc
0709 13:02:37.055082 (+46191208us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":34,"spinlock_wait_cycles":43804032}
I20260709 13:02:37.052692  1444 catalog_manager.cc:5697] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 13 to 17, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.058862  1444 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.069820  1444 catalog_manager.cc:5697] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.084101  1444 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 12 to 16, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.089884  1444 catalog_manager.cc:5697] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.092645  1444 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 14 to 15, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.101682  1444 catalog_manager.cc:5697] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 15, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.104841  1444 catalog_manager.cc:5697] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 16 to 17, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.116533  1444 catalog_manager.cc:5697] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.120995  1444 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 9 to 16, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.128271  1444 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.129803  1444 catalog_manager.cc:5697] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 8 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.137902  1444 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 12 to 13, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.139712  1444 catalog_manager.cc:5697] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.176821   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:37.309155  1444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 341) took 4460 ms. Trace:
I20260709 13:02:37.309659  1444 rpcz_store.cc:276] 0709 13:02:32.848504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.852180 (+  3676us) service_pool.cc:224] Handling call
0709 13:02:33.126069 (+273889us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b54002d0190. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f17675db1 00007f7f177b6640 00007f7f2068db76 00007f7f20797c3e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc 00007f7f1ec57392 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:37.309085 (+4183016us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.155096 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.155651 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.155701 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:02:37.155722 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:37.157148 (+  1426us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.157208 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.157239 (+    31us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:02:37.158448 (+  1209us) tablet.cc:701] Row locks acquired
0709 13:02:37.158466 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:37.158591 (+   125us) write_op.cc:270] Start()
0709 13:02:37.158733 (+   142us) write_op.cc:276] Timestamp: P: 1783602157158554 usec, L: 0
0709 13:02:37.158754 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.159409 (+   655us) log.cc:844] Serialized 6745 byte log entry
0709 13:02:37.162424 (+  3015us) op_driver.cc:464] REPLICATION: finished
0709 13:02:37.162753 (+   329us) write_op.cc:301] APPLY: starting
0709 13:02:37.162844 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:37.170933 (+  8089us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:37.171055 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.210007 (+ 38952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.210256 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:02:37.210298 (+    42us) write_op.cc:312] APPLY: finished
0709 13:02:37.210670 (+   372us) log.cc:844] Serialized 156 byte log entry
0709 13:02:37.211498 (+   828us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.211682 (+   184us) write_op.cc:454] Released schema lock
0709 13:02:37.211742 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.218442 (+  6700us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.218475 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":262511,"reported_tablets":49,"spinlock_wait_cycles":6409088,"child_traces":[["op",{"apply.queue_time_us":105,"apply.run_cpu_time_us":20455,"apply.run_wall_time_us":49303,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71026,"num_ops":17,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":4616,"prepare.run_wall_time_us":6993,"replication_time_us":3563,"spinlock_wait_cycles":2816}]]}
I20260709 13:02:37.401978  1442 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 12 to 14, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:37.403569  1442 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 20 to 21, leader changed from e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 21 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:37.405915  1442 catalog_manager.cc:5697] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.407840  1442 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:37.421201  1442 catalog_manager.cc:5697] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.423720  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:37.424321  1687 raft_consensus.cc:606] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:37.472325  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:37.472975  1687 raft_consensus.cc:606] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:37.481485  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:37.504060  1439 catalog_manager.cc:5697] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 15 to 16, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.507712  1439 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 16 to 18, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.482290  1695 raft_consensus.cc:606] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Received request to transfer leadership to TS c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:37.509294  1439 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 14 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.510191  1695 raft_consensus.cc:614] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:37.511128  1439 catalog_manager.cc:5697] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.519457  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:37.520406  1687 raft_consensus.cc:606] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:37.548312  1439 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 11 to 14, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
I20260709 13:02:37.561228  1439 catalog_manager.cc:5697] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 12 to 16, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.563416  1439 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 14 to 15, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.576902  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
new_leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:43144
I20260709 13:02:37.577667  1689 raft_consensus.cc:606] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Received request to transfer leadership to TS 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:37.577280  1439 catalog_manager.cc:5697] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 13 to 17, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.579298   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:37.579093  1439 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } }
W20260709 13:02:37.521576  1441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49636 (request call id 340) took 23493 ms (client timeout 15000 ms). Trace:
I20260709 13:02:37.581233   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:37.581347  1441 rpcz_store.cc:269] 0709 13:02:14.064505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.124657 (+ 60152us) service_pool.cc:224] Handling call
0709 13:02:37.521379 (+23396722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30555,"reported_tablets":49}
I20260709 13:02:37.616459  7412 raft_consensus.cc:993] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:37.617175  7181 raft_consensus.cc:1081] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:37.619123  7425 raft_consensus.cc:993] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:37.622902  7412 raft_consensus.cc:1081] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
W20260709 13:02:37.646554  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 195325us
W20260709 13:02:37.750813  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 45634us
I20260709 13:02:37.783959  1543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:02:37.783295  1546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:02:37.798717  1546 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.799226  1546 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.796468  1543 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.799948  1543 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.834403  1543 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:37.840914  1546 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:37.842589  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 58839.4us
W20260709 13:02:37.847110  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 64250.4us
I20260709 13:02:37.866735  1543 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:37.885407  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:37.886082  1618 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:37.894008  1618 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
W20260709 13:02:37.911362  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 57131.5us
I20260709 13:02:37.878590  1546 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:37.926230  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:37.927634  1511 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:37.928108  1618 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:37.954341  7351 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:37.954926  7351 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:37.955835  7351 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:37.960883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:38.002887  1689 raft_consensus.cc:3055] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:38.003443  1689 raft_consensus.cc:740] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:38.005826  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:38.007302  1687 raft_consensus.cc:3055] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:38.007606  1687 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:38.004539  1689 consensus_queue.cc:260] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:38.018437  1689 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:38.016717  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 56188.6us
I20260709 13:02:38.010469  1618 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:38.027206  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49628 (request call id 296) took 1607 ms. Trace:
I20260709 13:02:38.027673  1439 rpcz_store.cc:276] 0709 13:02:36.411850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.412057 (+   207us) service_pool.cc:224] Handling call
0709 13:02:38.018927 (+1606870us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:37.676446 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:37.711906 (+ 35460us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:37.711947 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:37.711966 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:37.712972 (+  1006us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:37.713038 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:37.713071 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:02:37.713880 (+   809us) tablet.cc:701] Row locks acquired
0709 13:02:37.713904 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:02:37.714072 (+   168us) write_op.cc:270] Start()
0709 13:02:37.714205 (+   133us) write_op.cc:276] Timestamp: P: 1783602157714019 usec, L: 0
0709 13:02:37.714234 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:02:37.725242 (+ 11008us) log.cc:844] Serialized 3642 byte log entry
0709 13:02:37.734660 (+  9418us) op_driver.cc:464] REPLICATION: finished
0709 13:02:37.735948 (+  1288us) write_op.cc:301] APPLY: starting
0709 13:02:37.736041 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:37.741933 (+  5892us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:37.742043 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:37.817991 (+ 75948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:37.818195 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:02:37.818239 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:37.818512 (+   273us) log.cc:844] Serialized 89 byte log entry
0709 13:02:37.839232 (+ 20720us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.846964 (+  7732us) write_op.cc:454] Released schema lock
0709 13:02:37.853746 (+  6782us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:37.867406 (+ 13660us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:37.867440 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144123,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":1024,"apply.run_cpu_time_us":12781,"apply.run_wall_time_us":130347,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37602,"num_ops":9,"prepare.queue_time_us":310,"prepare.run_cpu_time_us":5454,"prepare.run_wall_time_us":61198,"replication_time_us":20242}]]}
W20260709 13:02:38.031450  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 103900us
I20260709 13:02:38.015395  1687 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:38.150843  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 90980.2us
W20260709 13:02:38.192044  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 180648us
W20260709 13:02:38.200004  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 169287us
I20260709 13:02:38.212847  1689 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
W20260709 13:02:38.232076  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 50287.6us
I20260709 13:02:38.291692  7430 raft_consensus.cc:993] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:38.292335  7430 raft_consensus.cc:1081] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
W20260709 13:02:38.346755  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 111292us
W20260709 13:02:38.363132  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 346205us
W20260709 13:02:38.399185  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 257765us
W20260709 13:02:38.436088  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 161669us
I20260709 13:02:38.476754  1687 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:02:38.492179  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 80325.2us
I20260709 13:02:38.513160  1687 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 18.
W20260709 13:02:38.506745  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 57551.4us
W20260709 13:02:38.514685  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 76709.2us
I20260709 13:02:38.516135  7425 raft_consensus.cc:993] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:38.516635  7425 raft_consensus.cc:1081] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Signalling peer 9fbc4df0bb934bba941cfa20c0afead2 to start an election
I20260709 13:02:38.513471  1511 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:38.562867  7458 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.563606  7458 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:38.564528  7458 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:38.562925  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 49548us
I20260709 13:02:38.582386   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.583999  1618 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:38.626807  1687 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:02:38.634895  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:02:38.635469  1541 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.635800  1541 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.644178  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2"
dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
 from {username='slave'} at 127.0.0.1:35468
I20260709 13:02:38.645048  1538 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.645527  1538 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.642361  7441 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:02:38.671299  1541 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:38.677073  1539 raft_consensus.cc:1240] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Rejecting Update request from peer 2080b3bca2e64a1a953c17b506b668d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:38.673657  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 310) took 1932 ms. Trace:
I20260709 13:02:38.680606  1438 rpcz_store.cc:276] 0709 13:02:36.741445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.742149 (+   704us) service_pool.cc:224] Handling call
0709 13:02:36.766134 (+ 23985us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54003c8554. stack: 00007f7f177bb343 00007f7f177bb240 00007f7f1714a1d4 00007f7f20e88304 00007f7f20e88299 00007f7f1a844090 00007f7f1a8e2f3a 00007f7f206991cc 00007f7f2079737e 00007f7f1ec582a4 00007f7f1ec58232 00007f7f1ec58161 00007f7f1ec580dc 00007f7f1ec57392 00007f7f18c1548c 00007f7f18c148c6
0709 13:02:38.673580 (+1907446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4204,"reported_tablets":42,"spinlock_wait_cycles":39115136}
I20260709 13:02:38.688073  1541 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Requested vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:38.689103  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:38.689306  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:38.689781  2257 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.689872  1687 raft_consensus.cc:3055] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:38.690269  1687 raft_consensus.cc:740] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:38.691030  1687 consensus_queue.cc:260] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:38.692157  1687 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:38.699764  2257 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:38.700991  7441 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:02:38.717429  1538 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:38.717861  1687 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 15.
I20260709 13:02:38.727770  1538 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:38.727406  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:38.729818  1695 raft_consensus.cc:3055] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:38.730131  1695 raft_consensus.cc:740] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:38.728142  1510 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:38.731712  7458 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:38.732242  7458 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:38.733153  7458 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:38.741973  1438 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 17 to 18, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.744524  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:38.745289  1617 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.754984  1438 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 14 to 15, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.743057  1695 consensus_queue.cc:260] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:38.766883  1695 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:38.778976  1617 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
I20260709 13:02:38.780547  1511 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:38.781432  7441 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:38.781942  7441 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 LEADER]: Becoming Leader. State: Replica: 9fbc4df0bb934bba941cfa20c0afead2, State: Running, Role: LEADER
I20260709 13:02:38.782923  7441 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:38.807732  1538 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:38.832316  1695 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc4df0bb934bba941cfa20c0afead2 in term 17.
I20260709 13:02:38.868781  2257 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:38.869374  1615 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:02:38.870544  7351 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:38.882007  7351 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:02:38.962357  1695 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:38.964354  7427 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:38.964828  2262 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:38.961512  7429 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:39.065059  7472 log.cc:927] Time spent T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:39.100051  1441 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 8 to 10, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New cstate: current_term: 12 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:39.145782  1431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01e623ba813c4c3a8152a1de588cda91 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:39.152200  1439 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 14 to 15, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.167250  1439 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: term changed from 16 to 17, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "9fbc4df0bb934bba941cfa20c0afead2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.187346  1617 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:39.241526  1618 raft_consensus.cc:2955] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:39.252218  1689 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:02:39.253844  7429 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:39.260187  1680 tablet_service.cc:1558] Processing DeleteTablet for tablet 01e623ba813c4c3a8152a1de588cda91 with delete_type TABLET_DATA_TOMBSTONED (TS 2080b3bca2e64a1a953c17b506b668d2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48106
I20260709 13:02:39.273994  7480 tablet_replica.cc:333] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:02:39.275343  7480 raft_consensus.cc:2243] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.276160  2262 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:02:39.276365  7480 raft_consensus.cc:2272] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.278725  7427 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:02:39.279754  7480 ts_tablet_manager.cc:1916] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:39.290836  7429 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:39.296991  7480 ts_tablet_manager.cc:1929] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:02:39.297649  7480 log.cc:1199] T 01e623ba813c4c3a8152a1de588cda91 P 2080b3bca2e64a1a953c17b506b668d2: Deleting WAL directory at /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601954787209-431-0/minicluster-data/ts-2-root/wals/01e623ba813c4c3a8152a1de588cda91
I20260709 13:02:39.298377  1689 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:39.302551  1615 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 9fbc4df0bb934bba941cfa20c0afead2: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:02:39.303673  1431 catalog_manager.cc:5028] TS 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): tablet 01e623ba813c4c3a8152a1de588cda91 (table test-workload [id=2278984311854ca08e9bf2ced4e25fcd]) successfully deleted
I20260709 13:02:39.316322  7429 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:02:39.356910  7429 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:39.714243   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.993978  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:02:39.994786  1615 raft_consensus.cc:606] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:40.001706  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
mode: GRACEFUL
new_leader_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:54448
I20260709 13:02:40.002447  1615 raft_consensus.cc:606] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Received request to transfer leadership to TS 2080b3bca2e64a1a953c17b506b668d2
I20260709 13:02:40.003764   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:40.004998   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:40.320700  7456 raft_consensus.cc:993] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:02:40.321506  7456 raft_consensus.cc:1081] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:02:40.323792  1689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:02:40.324514  1689 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.324965  1689 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.355484  1689 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.355963  7446 raft_consensus.cc:993] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: : Instructing follower 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:02:40.362598  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:40.363286  1539 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.368110  7446 raft_consensus.cc:1081] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Signalling peer 2080b3bca2e64a1a953c17b506b668d2 to start an election
I20260709 13:02:40.372116  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
 from {username='slave'} at 127.0.0.1:51308
I20260709 13:02:40.372691  1690 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.373064  1690 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.383631  1690 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.389894  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:40.393754  1621 raft_consensus.cc:3055] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:40.395738  1621 raft_consensus.cc:740] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:40.396541  1621 consensus_queue.cc:260] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.395085  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "9fbc4df0bb934bba941cfa20c0afead2"
I20260709 13:02:40.387305  1539 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:40.410899  1541 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.407431  1690 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:40.417214  1661 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:40.419617  7425 raft_consensus.cc:2804] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.420178  7425 raft_consensus.cc:697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:40.421133  7425 consensus_queue.cc:237] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.438941  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:40.439596  1615 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:02:40.439924  1615 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:40.440666  1615 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.441879  1615 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:40.443452  1689 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:40.463343  1621 raft_consensus.cc:3060] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.512043  1541 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:40.521920  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2; no voters: 
I20260709 13:02:40.522877  7489 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:40.523412  7489 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:40.524327  7489 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:40.519040  1615 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 17.
I20260709 13:02:40.529480  1621 raft_consensus.cc:2468] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
I20260709 13:02:40.543272  1439 catalog_manager.cc:5697] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 13 to 14, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.651480  1615 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:40.677515  1689 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:02:40.678165  1585 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c6369221c274c789a9f8654d6ee9417. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.683944  1538 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:02:40.683943  7456 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:40.696226  7456 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:02:40.802956  1439 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 16 to 17, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:40.830919  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 102742us
I20260709 13:02:40.919173  7434 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:40.946305  1621 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:40.948144  7489 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:41.001590  1541 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:02:41.006444   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.011099  7425 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:41.030112  1541 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:40.996861  1621 raft_consensus.cc:1275] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:02:41.044878  7425 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:41.047628  7489 consensus_queue.cc:1048] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:41.066449  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 147866us
I20260709 13:02:41.110749  1689 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:41.174428  1541 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:41.191615  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 60723.8us
W20260709 13:02:41.337566  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62100.9us
I20260709 13:02:41.469218  7526 ts_tablet_manager.cc:933] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:41.464187   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:41.529160  1439 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 reported cstate change: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:41.594708  7526 tablet_copy_client.cc:323] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
W20260709 13:02:41.748044  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 67670us
W20260709 13:02:41.811059  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 59585.7us
W20260709 13:02:41.825596  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 87330.4us
W20260709 13:02:41.982095  1510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 167305us
W20260709 13:02:41.983670  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 158039us
I20260709 13:02:41.990828  1689 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:41.995599  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 5c6369221c274c789a9f8654d6ee9417 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:02:41.996258  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 5c6369221c274c789a9f8654d6ee9417 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-5c6369221c274c789a9f8654d6ee9417
W20260709 13:02:41.982769  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 147078us
I20260709 13:02:42.064011  1632 tablet_copy_source_session.cc:215] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:42.079804  1587 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
I20260709 13:02:42.046258  7537 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.103403  7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6369221c274c789a9f8654d6ee9417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:42.104373  7537 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.110329  7537 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.123298  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.134641  1621 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:02:42.140230  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 61713.1us
W20260709 13:02:42.132869  1659 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bb37620691446b2b3ac3e61e48ed81d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.140914  7514 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.142943  7542 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.145577  7514 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.146112  7542 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.147876  7514 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.142957  7537 raft_consensus.cc:493] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.148250  7542 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.148566  7537 raft_consensus.cc:515] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.150815  7537 leader_election.cc:290] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.151014  7429 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.151633  7429 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.146368  7533 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:42.158568  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.161721  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.162324  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.167338  7429 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.172781  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b77a1e7d2d64ba8b40eabf9b87292f3" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.175285  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.176792  7521 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.177393  7521 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:42.183254  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 105459us
I20260709 13:02:42.183192  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29466a5fdaaa4059bb44d95ca1ec63b8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.186569  1510 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.192322  1510 leader_election.cc:304] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.195971  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.189394  7429 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.204443  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:42.205348  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.211050  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06184411faf343c9939d453eeec59cae" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.198134  7351 raft_consensus.cc:2749] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.213282  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d91481bc55434187a86af0d9c4f9d149" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.204149  7533 raft_consensus.cc:2955] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:42.219975  1512 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.220922  7542 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.221716  1512 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.221649  7542 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.223881  7450 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.222282  7427 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.231709  7521 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.234051  7542 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.233727  1621 raft_consensus.cc:2955] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:42.241339  7450 raft_consensus.cc:493] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.241886  7528 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.242132  7427 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.242707  7427 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.242659  7528 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.245577  7427 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.245661  7528 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.241923  7450 raft_consensus.cc:515] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.247828  7521 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.248579  7450 leader_election.cc:290] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.248306  7521 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.251047  7521 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.251168  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.255198  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.256577  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.257553  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.259395  2257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.259660  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.259135  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.265951  7524 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.268213  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85ee981fb9947eb9c9c17aa40779ecc" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.270274  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49622 (request call id 323) took 1012 ms. Trace:
I20260709 13:02:42.270980  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a119b71a994fd1aeb21c6ba31e339b" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:42.272348  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 131746us
I20260709 13:02:42.272600  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.270818  1439 rpcz_store.cc:276] 0709 13:02:41.251492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.251806 (+   314us) service_pool.cc:224] Handling call
0709 13:02:42.264045 (+1012239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:41.616964 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:41.683462 (+ 66498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:41.683503 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:41.683521 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:41.683879 (+   358us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:41.683941 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:41.683970 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:41.684150 (+   180us) tablet.cc:701] Row locks acquired
0709 13:02:41.684165 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:02:41.684307 (+   142us) write_op.cc:270] Start()
0709 13:02:41.684419 (+   112us) write_op.cc:276] Timestamp: P: 1783602161684261 usec, L: 0
0709 13:02:41.684435 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:02:41.685129 (+   694us) log.cc:844] Serialized 599 byte log entry
0709 13:02:42.031666 (+346537us) op_driver.cc:464] REPLICATION: finished
0709 13:02:42.166539 (+134873us) write_op.cc:301] APPLY: starting
0709 13:02:42.168993 (+  2454us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:42.175218 (+  6225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:42.175323 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:42.176068 (+   745us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:42.176259 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:02:42.176309 (+    50us) write_op.cc:312] APPLY: finished
0709 13:02:42.183113 (+  6804us) log.cc:844] Serialized 25 byte log entry
0709 13:02:42.189343 (+  6230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.192186 (+  2843us) write_op.cc:454] Released schema lock
0709 13:02:42.194771 (+  2585us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:42.214757 (+ 19986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:42.215475 (+   718us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":128182,"apply.run_cpu_time_us":3577,"apply.run_wall_time_us":36031,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8305,"num_ops":1,"prepare.queue_time_us":65042,"prepare.run_cpu_time_us":2958,"prepare.run_wall_time_us":68485,"replication_time_us":346807,"thread_start_us":73628,"threads_started":2}]]}
I20260709 13:02:42.282116  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:42.282478  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.285308  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7316b60a2ea04a109142470c7a827717" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.288554  1512 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:42.285534  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.291034  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.294763  1512 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.303061  1512 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:42.292385  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.304350  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.285079  7427 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.291350  7521 raft_consensus.cc:493] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.306777  1512 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:42.304929  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.292804  7351 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:42.307385  7549 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:42.269524  7524 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.313124  1512 leader_election.cc:304] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.307165  7429 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.317484  1512 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.310458  7521 raft_consensus.cc:515] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.311208  7514 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:42.320281  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.308612  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.323242  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.317698  7549 raft_consensus.cc:2749] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:42.322535  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.331432  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.332245  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.320664  7429 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:42.332204  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.336385  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.337990  1587 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.337848  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.339526  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.343928  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.345207  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.346899  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c19c7246dc654e7c82b45abe1250e568" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.340507  7524 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.351347  1510 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:42.348546  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.359181  7514 raft_consensus.cc:493] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.359742  7514 raft_consensus.cc:515] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.361881  7514 leader_election.cc:290] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.364187  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.362388  7514 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.365623  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be3cc12e24cf42b1b289cee33b288dd9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.361708  1438 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 11, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:42.368216  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.353778  7528 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:42.369447  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:42.371775  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.373688  1512 leader_election.cc:304] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.374445  7549 raft_consensus.cc:493] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.374962  7549 raft_consensus.cc:515] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:42.372452  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.378419  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.377852  7429 raft_consensus.cc:2749] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:42.369091  7514 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:42.400341  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.402212  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.405799  7549 leader_election.cc:290] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.395134  7514 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.412971  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4f26e727a741fa8ca38a41fff1dc1d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.413331  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac3f2e6866214e3e89b342a804e31b9f" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.400007  7521 leader_election.cc:290] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.418974  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.424069  7521 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.424839  7521 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.428041  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ba8839a7d2844ab8f6a90a60af5556e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.415099  1511 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.431473  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.433449  7526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42592 (request call id 1183) took 1245 ms. Trace:
I20260709 13:02:42.433918  7526 rpcz_store.cc:276] 0709 13:02:41.188373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:41.188606 (+   233us) service_pool.cc:224] Handling call
0709 13:02:41.469612 (+281006us) ts_tablet_manager.cc:934] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
0709 13:02:42.082912 (+613300us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:42.305983 (+223071us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:42.309242 (+  3259us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:42.428534 (+119292us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:42.432931 (+  4397us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:42.433304 (+   373us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:42.433368 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":76339,"tablet-copy.queue_time_us":279957,"thread_start_us":294970,"threads_started":2}
I20260709 13:02:42.435664  7526 tablet_copy_client.cc:806] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:42.430239  7514 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.409365  7524 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.437783  7524 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.439551  7526 tablet_copy_client.cc:670] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:42.439877  7524 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:42.414897  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.450863  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.451062  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.456314  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.463471  7521 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.466749  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.471618  7549 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.472286  7549 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.477571  7549 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.480304  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.488938  7526 tablet_copy_client.cc:538] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:42.491984  1510 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.493970  7429 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:42.496804  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.497279  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 44936.3us
W20260709 13:02:42.497893  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.498469  1661 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.499048  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.506325  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.537535  1512 leader_election.cc:304] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.538592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af2df8228f514af5aee2481a5f153280" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.525635  7526 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:02:42.540588  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1012ad0f2cf49ff98a60ff466b6246d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.544409  1512 leader_election.cc:304] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.543066  7524 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.557118  7524 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.566118  7528 raft_consensus.cc:2749] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.569960  7528 raft_consensus.cc:493] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.552356  7429 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
W20260709 13:02:42.605429  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51328.8us
I20260709 13:02:42.553231  7514 raft_consensus.cc:2749] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.611907  1512 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.599705  7521 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.600137  7429 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.600873  7528 raft_consensus.cc:515] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.618180  7535 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.616806  7548 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.624571  7521 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.633474  7542 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.660126  7542 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.662236  7427 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.662784  7427 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.665520  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:42.666875  1512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 51497.5us
I20260709 13:02:42.667662  1512 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.668769  7427 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.670971  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.662446  7542 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.676470  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0c15f4fa7246faa2d54502e99a81ab" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.680110  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.637338  7548 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.678500  7514 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.679477  7427 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.716691  7514 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:42.719328  7514 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.715735  7542 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.722275  7542 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.723881  7528 leader_election.cc:290] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.724232  7542 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.726387  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.731602  7521 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.731904  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.732136  7524 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.732753  7566 ts_tablet_manager.cc:933] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.732967  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.736593  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:42.740513  1659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 45567.6us
I20260709 13:02:42.748250  7429 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.750576  7548 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.764658  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.767406  7429 raft_consensus.cc:493] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.768247  7429 raft_consensus.cc:515] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.769677  7566 tablet_copy_client.cc:323] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:02:42.769989  7524 raft_consensus.cc:493] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:42.770521  7524 raft_consensus.cc:515] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.773317  7524 leader_election.cc:290] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.766088  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.781193  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "459063895bc847b9a15dc71e10b36267" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.785676  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.787084  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 6bb37620691446b2b3ac3e61e48ed81d from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:02:42.787722  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 6bb37620691446b2b3ac3e61e48ed81d from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-6bb37620691446b2b3ac3e61e48ed81d
I20260709 13:02:42.785439  7542 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.788461  7542 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.791337  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ad53e26a3894902b237f56d0f92b47e" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.792963  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.795567  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c2bf53312944dfc854b092b66a8dce2" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.797184  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd5c95713f5c4cfbaf7d6d84b718b4a8" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.797060  7542 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.807310  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.813663  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.814743  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.816298  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fffa415884468d9ae844797cb87109" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.809005  7524 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:42.823947  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827a7a4d1cab4d8f8d8da6c119f4cce1" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.824162  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ad1e195a7c2407789e8c8a409b95740" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.820899  1512 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.815408  7537 raft_consensus.cc:493] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:42.829640  7535 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:42.828862  1512 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.830138  7537 raft_consensus.cc:515] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:42.842780  7548 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.844468  7537 leader_election.cc:290] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.846282  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.847298  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca134e523abd4f159806116930d9aece" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.851823  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a0c52190de849839b129a0fa6099693" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:42.852133  1512 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.853756  1512 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.854498  1511 leader_election.cc:304] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.854444  7427 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:42.859788  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 71f4d9d1d4d740309d74428e0797e9d8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.862998  1510 leader_election.cc:304] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.864578  1512 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:42.868921  1493 auto_rebalancer.cc:629] Failed to schedule move for tablet 70b9f3b50c6a495fa5b5b06dcfe6c2b2: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:42.869931  1512 leader_election.cc:304] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.869153  7537 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.875483  7535 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.878312  7450 raft_consensus.cc:2749] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:42.828739  7524 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:42.852490  7429 leader_election.cc:290] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:42.885097  7568 raft_consensus.cc:2749] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.886159  1512 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:42.865073  7514 raft_consensus.cc:2749] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:42.887425  1512 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.888617  7542 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.888696  7427 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:42.889895  7524 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:42.893173  1706 tablet_copy_source_session.cc:215] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:42.897776  1695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48106
I20260709 13:02:42.898411  1695 raft_consensus.cc:606] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:02:42.899612  7566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bb37620691446b2b3ac3e61e48ed81d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:42.903002  1512 leader_election.cc:304] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.904006  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:42.908886  1512 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.910758  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95c7b064bb5640149a09ee01f2a4e2f7" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.911011  7514 raft_consensus.cc:2749] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:42.911967  7427 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:42.912030  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:42.924417  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48106
I20260709 13:02:42.924975  1689 raft_consensus.cc:606] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:02:42.936610  1512 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.947233  1512 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:42.948215  7427 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.948897  7427 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:42.982918   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:42.994673   431 tablet_replica.cc:333] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:42.995792   431 raft_consensus.cc:2243] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.996479   431 raft_consensus.cc:2272] T 5c6369221c274c789a9f8654d6ee9417 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:42.998663  1431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 72273.7us
I20260709 13:02:43.000161  7566 tablet_copy_client.cc:806] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:43.011031  7566 tablet_copy_client.cc:670] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:43.003635  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48106
I20260709 13:02:43.012776  1689 raft_consensus.cc:606] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:02:43.013972   431 tablet_replica.cc:333] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.015278  7566 tablet_copy_client.cc:538] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:43.024523  1493 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:02:43.025013  1493 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 6bb37620691446b2b3ac3e61e48ed81d already in progress
W20260709 13:02:43.025318  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 6bb37620691446b2b3ac3e61e48ed81d already in progress
I20260709 13:02:43.023221   431 raft_consensus.cc:2243] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.057768   431 raft_consensus.cc:2272] T f1012ad0f2cf49ff98a60ff466b6246d P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.062042  7525 raft_consensus.cc:993] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: : Instructing follower c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:02:43.062551  7533 raft_consensus.cc:1081] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Signalling peer c5f349bdadfc40b9bff8e1682b5c271b to start an election
I20260709 13:02:43.064334  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d"
dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
 from {username='slave'} at 127.0.0.1:38818
I20260709 13:02:43.064980  1617 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.066268  1617 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.071478   431 tablet_replica.cc:333] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.072511   431 raft_consensus.cc:2243] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.073145   431 raft_consensus.cc:2272] T c19c7246dc654e7c82b45abe1250e568 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.084080  7566 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:02:43.096351   431 tablet_replica.cc:333] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.097312   431 raft_consensus.cc:2243] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.097198  1617 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.098358   431 raft_consensus.cc:2272] T f950ec06ccd64933a117a4c6e6114ed3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:43.104714  1587 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:43.113334  1617 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:43.114284  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:43.114925  1695 raft_consensus.cc:3055] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:02:43.115233  1695 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:43.116017  1695 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.117475  1695 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:43.126593  1695 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 18.
I20260709 13:02:43.127128   431 tablet_replica.cc:333] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.151414   431 raft_consensus.cc:2243] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.151737  1587 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:43.152137   431 raft_consensus.cc:2272] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.153439  7500 raft_consensus.cc:2804] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:43.153999  7500 raft_consensus.cc:697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:43.154877   431 tablet_replica.cc:333] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.155821   431 raft_consensus.cc:2243] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.156903   431 raft_consensus.cc:2272] T 10a7d9e12aa94413b57ebc59c8f15757 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.154886  7500 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.159447  7526 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:43.167467  7526 tablet_bootstrap.cc:492] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:43.173552  1438 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 17 to 18, leader changed from 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.176709   431 tablet_replica.cc:333] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.177655   431 raft_consensus.cc:2243] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.178099  7526 ts_tablet_manager.cc:1403] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.653s	user 0.035s	sys 0.020s
I20260709 13:02:43.178259   431 raft_consensus.cc:2272] T 95c7b064bb5640149a09ee01f2a4e2f7 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.195322   431 tablet_replica.cc:333] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.196478   431 raft_consensus.cc:2243] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.197379   431 raft_consensus.cc:2272] T d91481bc55434187a86af0d9c4f9d149 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.206166  7526 raft_consensus.cc:359] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.222256   431 tablet_replica.cc:333] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.228209   431 raft_consensus.cc:2243] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.230501   431 raft_consensus.cc:2272] T 29466a5fdaaa4059bb44d95ca1ec63b8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.222179  7526 raft_consensus.cc:740] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:43.236158  7526 consensus_queue.cc:260] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.237430   431 tablet_replica.cc:333] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.251662   431 raft_consensus.cc:2243] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.252816   431 raft_consensus.cc:2272] T f85ee981fb9947eb9c9c17aa40779ecc P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.252930  7526 ts_tablet_manager.cc:1434] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.001s
I20260709 13:02:43.269846   431 tablet_replica.cc:333] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.279538  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-5c6369221c274c789a9f8654d6ee9417 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:02:43.280131  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-5c6369221c274c789a9f8654d6ee9417 on tablet 5c6369221c274c789a9f8654d6ee9417 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:43.283628   431 raft_consensus.cc:2243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.285030   431 raft_consensus.cc:2272] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.288244   431 tablet_replica.cc:333] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.289184   431 raft_consensus.cc:2243] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.293216   431 raft_consensus.cc:2272] T ad9c8a969843427fb32b4afb149874ba P 9fbc4df0bb934bba941cfa20c0afead2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.306962  7566 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:43.326085  7566 tablet_bootstrap.cc:492] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:43.326866  7566 ts_tablet_manager.cc:1403] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.243s	user 0.028s	sys 0.024s
I20260709 13:02:43.329545   431 tablet_replica.cc:333] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.330528   431 raft_consensus.cc:2243] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.331326   431 raft_consensus.cc:2272] T 8ba8839a7d2844ab8f6a90a60af5556e P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.339064  7566 raft_consensus.cc:359] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.339973  7566 raft_consensus.cc:740] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:43.340669  7566 consensus_queue.cc:260] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:43.349515   431 tablet_replica.cc:333] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.351374   431 raft_consensus.cc:2243] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.359314   431 raft_consensus.cc:2272] T ca134e523abd4f159806116930d9aece P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.389470   431 tablet_replica.cc:333] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.394888   431 raft_consensus.cc:2243] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.404074   431 raft_consensus.cc:2272] T 7c2bf53312944dfc854b092b66a8dce2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.407303   431 tablet_replica.cc:333] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.408228   431 raft_consensus.cc:2243] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.409322   431 raft_consensus.cc:2272] T 71f4d9d1d4d740309d74428e0797e9d8 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.412410   431 tablet_replica.cc:333] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.413329   431 raft_consensus.cc:2243] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.413972  7566 ts_tablet_manager.cc:1434] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 13:02:43.414491   431 raft_consensus.cc:2272] T 20bfd12bbb914d07873fde52411d5fc6 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.446842  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-6bb37620691446b2b3ac3e61e48ed81d received from {username='slave'} at 127.0.0.1:43624
I20260709 13:02:43.448011  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-6bb37620691446b2b3ac3e61e48ed81d on tablet 6bb37620691446b2b3ac3e61e48ed81d with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:43.455803   431 tablet_replica.cc:333] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.460343   431 raft_consensus.cc:2243] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.476395   431 raft_consensus.cc:2272] T 06184411faf343c9939d453eeec59cae P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.492390   431 tablet_replica.cc:333] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.493322   431 raft_consensus.cc:2243] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.495743   431 raft_consensus.cc:2272] T 544a0a0b5c034de2956e73d089c51085 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.514886   431 tablet_replica.cc:333] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.518883   431 raft_consensus.cc:2243] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.522271   431 raft_consensus.cc:2272] T a0a119b71a994fd1aeb21c6ba31e339b P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.525138   431 tablet_replica.cc:333] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.543697   431 raft_consensus.cc:2243] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.544375   431 raft_consensus.cc:2272] T aa0c15f4fa7246faa2d54502e99a81ab P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.561084   431 tablet_replica.cc:333] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.568063  1689 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:43.570037  7551 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:43.609357   431 raft_consensus.cc:2243] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.631145   431 raft_consensus.cc:2272] T 1f9a39f263da4577833a605ef819b007 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.633882   431 tablet_replica.cc:333] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.663082   431 raft_consensus.cc:2243] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:43.667483   431 raft_consensus.cc:2272] T 831605a002324a04838f4fe562b13530 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.676792  2262 raft_consensus.cc:3060] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEARNER]: Advancing to term 18
I20260709 13:02:43.689280  2262 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:02:43.718066   431 tablet_replica.cc:333] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.721366   431 raft_consensus.cc:2243] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.723232   431 raft_consensus.cc:2272] T ac3f2e6866214e3e89b342a804e31b9f P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.799126  7434 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:43.849869   431 tablet_replica.cc:333] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.867544  2260 raft_consensus.cc:1217] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:02:43.913731  7427 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:43.914067   431 raft_consensus.cc:2243] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.914683  7427 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:43.920300  7427 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:43.920454  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:43.940775  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f43691e2c5a4cc2b9d09a0ebda430e5" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:43.915499   431 raft_consensus.cc:2272] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:43.977869  7586 raft_consensus.cc:1064] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:43.982029  7586 consensus_queue.cc:237] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:43.988077   431 tablet_replica.cc:333] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:43.988207  7552 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:43.989213  7552 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:43.989923   431 raft_consensus.cc:2243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:43.992093  7524 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:43.992959  7524 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:43.993808  7552 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.011271   431 raft_consensus.cc:2272] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.018996  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:44.021524  1511 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:44.022439  1511 raft_consensus.cc:2686] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 9fbc4df0bb934bba941cfa20c0afead2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:02:44.041184  7524 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:44.046427  1511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 71634.1us
I20260709 13:02:44.076023  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:44.125706  2231 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.126327  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.127332  7584 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.127622  2266 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:44.133255  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59f1e89f0b484c16a765a9cbf4b2de05" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:44.133565  7500 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.134829   431 tablet_replica.cc:333] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.135987   431 raft_consensus.cc:2243] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.141223  7427 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:02:44.142071  7427 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.145100  7427 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.146131  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:44.146442  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e6d6de7d5b64994853322d5806d6eb0" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:44.149139  1510 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:44.149606  1687 raft_consensus.cc:1275] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:02:44.150332  7427 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.163697  7500 consensus_queue.cc:1048] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.137306   431 raft_consensus.cc:2272] T 7316b60a2ea04a109142470c7a827717 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.169497   431 tablet_replica.cc:333] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.170482   431 raft_consensus.cc:2243] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.174077   431 raft_consensus.cc:2272] T 4a0c52190de849839b129a0fa6099693 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.175693  7582 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.176695  7582 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.180887  7582 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.181085  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:44.181814  2266 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:44.183246  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:44.183852  7587 raft_consensus.cc:2955] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.185994  7582 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:44.186496  7582 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.186918  7582 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.187920  1687 raft_consensus.cc:2955] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.200109   431 tablet_replica.cc:333] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.201274   431 raft_consensus.cc:2243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.202392   431 raft_consensus.cc:2272] T 0c4f26e727a741fa8ca38a41fff1dc1d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.204201  7582 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.217707   431 tablet_replica.cc:333] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.218885   431 raft_consensus.cc:2243] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.222273  7582 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.222514  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f950ec06ccd64933a117a4c6e6114ed3" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:44.223302  2266 raft_consensus.cc:3060] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.223630   431 raft_consensus.cc:2272] T 10cfcf5f778944b099b75d0b1a19afa0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.226845   431 tablet_replica.cc:333] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.227721   431 raft_consensus.cc:2243] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.228571   431 raft_consensus.cc:2272] T 459063895bc847b9a15dc71e10b36267 P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.232151  2266 raft_consensus.cc:2468] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:44.241163  1659 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:44.242051  7582 raft_consensus.cc:2804] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:44.240887  2262 raft_consensus.cc:2955] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.242518  7582 raft_consensus.cc:697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:44.243628  7582 consensus_queue.cc:237] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.249423  7427 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:44.250068  7427 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:44.250691  1444 catalog_manager.cc:5697] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 11 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.252133  7427 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.254891  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:44.261075   431 tablet_replica.cc:333] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.266566  7500 raft_consensus.cc:1064] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:44.262156   431 raft_consensus.cc:2243] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.268532   431 raft_consensus.cc:2272] T 51ca4c13fdd142269405c90e6382797c P 9fbc4df0bb934bba941cfa20c0afead2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.269618  7500 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.284730  7427 raft_consensus.cc:493] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e51b0b5dc04b4f5aaf6a3a870f291345)
I20260709 13:02:44.285498  7427 raft_consensus.cc:515] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.290709  7427 leader_election.cc:290] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.291429  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:44.284799  1511 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:44.299415  7427 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:44.306042   431 tablet_replica.cc:333] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.308324  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "412cc1b1dcd54096b1fbbc092bcfc7e4" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:44.310142  7551 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.310807   431 raft_consensus.cc:2243] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.310818  7551 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.312347  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854dc9ecb21b45069ab7661dc5c021c9" candidate_uuid: "9fbc4df0bb934bba941cfa20c0afead2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:44.318127   431 raft_consensus.cc:2272] T e4bd73d471194556a9ba093049d04790 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.320010  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:44.321952  2266 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:44.322438   431 tablet_replica.cc:333] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.323454   431 raft_consensus.cc:2243] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.324651  1695 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:02:44.325718   431 raft_consensus.cc:2272] T 6bb37620691446b2b3ac3e61e48ed81d P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.328414  7446 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:02:44.333563  1661 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.332708  7551 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.345329   431 tablet_replica.cc:333] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.345893  7500 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:02:44.355551   431 raft_consensus.cc:2243] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.366379   431 raft_consensus.cc:2272] T be3cc12e24cf42b1b289cee33b288dd9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.371690  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.373555  1439 catalog_manager.cc:5697] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 15 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.369438   431 tablet_replica.cc:333] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.385775   431 raft_consensus.cc:2243] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.387701   431 raft_consensus.cc:2272] T af2df8228f514af5aee2481a5f153280 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.388911  1511 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:44.390013  7592 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.391357  1511 leader_election.cc:304] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc4df0bb934bba941cfa20c0afead2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:44.392897  7592 raft_consensus.cc:2749] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:44.395233  1661 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.407132   431 tablet_replica.cc:333] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.408079   431 raft_consensus.cc:2243] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.409020   431 raft_consensus.cc:2272] T f5fffa415884468d9ae844797cb87109 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.409125  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.412415   431 tablet_replica.cc:333] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.413230   431 raft_consensus.cc:2243] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.413897   431 raft_consensus.cc:2272] T 854dc9ecb21b45069ab7661dc5c021c9 P 9fbc4df0bb934bba941cfa20c0afead2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.416893   431 tablet_replica.cc:333] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.416872  7552 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.418087   431 raft_consensus.cc:2243] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.417845  7552 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.418967   431 raft_consensus.cc:2272] T 5ad1e195a7c2407789e8c8a409b95740 P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.421490  7552 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:44.421952  7446 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.425443  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:44.426803  1622 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 19.
I20260709 13:02:44.428246  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:44.429746  7552 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:02:44.430238  7552 raft_consensus.cc:493] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.431291  7552 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:44.435845  2266 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:44.441067  2231 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.444250   431 tablet_replica.cc:333] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.449398   431 raft_consensus.cc:2243] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.450793   431 raft_consensus.cc:2272] T e9045b82a0ec40a69c0967a8f8188129 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.450695  1587 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.451474  1587 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:44.452386  7500 raft_consensus.cc:2749] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:44.452760  1587 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:44.453438  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.454746   431 tablet_replica.cc:333] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.455750   431 raft_consensus.cc:2243] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.456640   431 raft_consensus.cc:2272] T 59f1e89f0b484c16a765a9cbf4b2de05 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.459882  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.459983   431 tablet_replica.cc:333] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.460987   431 raft_consensus.cc:2243] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.462021   431 raft_consensus.cc:2272] T 8e6d6de7d5b64994853322d5806d6eb0 P 9fbc4df0bb934bba941cfa20c0afead2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.469367   431 tablet_replica.cc:333] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
W20260709 13:02:44.466408  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.470275   431 raft_consensus.cc:2243] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.471592   431 raft_consensus.cc:2272] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P 9fbc4df0bb934bba941cfa20c0afead2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.472476  7500 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.473140  7500 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:44.473739  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.490679  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.496481  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:44.507937  7552 raft_consensus.cc:515] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.512907  1687 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:44.516283  2231 leader_election.cc:336] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.517009  7583 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.517621  7583 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.477244  7500 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.485095  7490 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.528030  7490 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.530210  7490 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.531922  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:44.532680  2266 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:44.532985  7583 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.534245  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:44.536413  7582 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:44.536826  7582 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.537209  7582 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.536273  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:44.541100  2231 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:44.526206  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.474831   431 tablet_replica.cc:333] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.545233  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8a969843427fb32b4afb149874ba" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:44.545900  1622 raft_consensus.cc:3060] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:02:44.545636  7582 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.546875  1689 raft_consensus.cc:2393] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51b0b5dc04b4f5aaf6a3a870f291345 in current term 16: Already voted for candidate 2080b3bca2e64a1a953c17b506b668d2 in this term.
I20260709 13:02:44.550153  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.556030  7588 raft_consensus.cc:3060] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:44.550746  7552 leader_election.cc:290] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:44.551153   431 raft_consensus.cc:2243] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:44.563506  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.565819  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a7d9e12aa94413b57ebc59c8f15757" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:44.564803  7582 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.567160   431 raft_consensus.cc:2272] T 4ad53e26a3894902b237f56d0f92b47e P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.571156  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.573710  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.575976  1587 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.576408  1587 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.570581   431 tablet_replica.cc:333] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.577461  1622 raft_consensus.cc:2468] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 20.
W20260709 13:02:44.578893  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.579152  7586 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:44.581754  1661 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.583216   431 raft_consensus.cc:2243] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.587251   431 raft_consensus.cc:2272] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 9fbc4df0bb934bba941cfa20c0afead2 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.588145  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.590127  7588 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:44.602435  1661 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:44.602866  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.604105  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.599422  2230 leader_election.cc:304] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.606727  7588 raft_consensus.cc:2804] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:02:44.590464   431 tablet_replica.cc:333] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.607317  7588 raft_consensus.cc:697] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:44.608342   431 raft_consensus.cc:2243] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.608589  7588 consensus_queue.cc:237] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.609722   431 raft_consensus.cc:2272] T 9810b426aedc4eb89adfbd103150f39a P 9fbc4df0bb934bba941cfa20c0afead2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.605901  2266 raft_consensus.cc:2468] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 16.
I20260709 13:02:44.621236  1659 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.622103  7582 raft_consensus.cc:2804] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:44.622608  7582 raft_consensus.cc:697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:44.623908  7582 consensus_queue.cc:237] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.627602  7490 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.628551  7490 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:44.632339  7490 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:44.635531  1661 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.638062  7446 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.638741  7446 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.641147  7446 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:44.644528  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:44.648303  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.653615  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.655948  1587 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.656409  1587 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:44.657572  7446 raft_consensus.cc:2749] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:44.653515  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:44.658833  1622 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
I20260709 13:02:44.668776  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.669691  7582 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:44.671991  1438 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 11 to 12, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:44.678977  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.679389   431 tablet_replica.cc:333] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.680198   431 raft_consensus.cc:2243] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.681351   431 raft_consensus.cc:2272] T 01e623ba813c4c3a8152a1de588cda91 P 9fbc4df0bb934bba941cfa20c0afead2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.670099  7582 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.688989  7582 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:44.702862  7490 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.703522  7490 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:44.705673  7490 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:44.708842  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:44.716010  7603 log.cc:927] Time spent T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:02:44.716917  1661 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.718025  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:44.718116  1444 catalog_manager.cc:5697] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 19 to 20, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.721225  7490 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:44.724717  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.733132  2266 raft_consensus.cc:1275] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
W20260709 13:02:44.738638  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.739770   431 tablet_replica.cc:333] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2: stopping tablet replica
I20260709 13:02:44.739867  7525 consensus_queue.cc:1048] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:02:44.740720   431 raft_consensus.cc:2243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.742067   431 raft_consensus.cc:2272] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 9fbc4df0bb934bba941cfa20c0afead2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.747869  7582 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:44.748713  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.755511  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.765502  7582 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:44.771930  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f4d9d1d4d740309d74428e0797e9d8" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:44.774071  1618 raft_consensus.cc:3060] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:44.779317  1661 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:44.805920  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.806295  1439 catalog_manager.cc:5697] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 15 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:44.815537  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.831218  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.833500  1618 raft_consensus.cc:2468] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 19.
I20260709 13:02:44.836511  1660 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:44.837749  7490 raft_consensus.cc:2804] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:44.838255  7490 raft_consensus.cc:697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:44.841087  7490 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:44.842850  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.877844  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.884955  1618 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:44.899524  7500 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.900200  7500 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:44.902504  7500 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.907984  2266 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:44.911618  7434 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:44.912938  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:44.913659  1687 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:44.921320  7434 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.924284  2266 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.927629  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:44.928586  7586 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:44.929029  7586 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:44.929440  7586 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:44.932600  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:44.934660  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:44.948624  1687 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:02:44.954972  1587 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:44.968470  1444 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 12 to 13, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:44.977777  7586 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:44.982249  7586 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:44.985608  1430 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c6369221c274c789a9f8654d6ee9417 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:45.001678  7587 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:45.005093  7588 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.005802  7588 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.011209  7588 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.011417  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:45.015771  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.016295  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.017510  7584 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:45.028903  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:45.029623  1687 raft_consensus.cc:3060] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:45.031559  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:02:45.035190  7588 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.035812  7588 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.037900  7588 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.039361  1687 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:45.040640  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.041563  1622 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:45.043342  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:45.043045  1444 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 18 to 19, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.044847  7583 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.045220  7583 raft_consensus.cc:493] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.045588  7583 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.049232  1689 raft_consensus.cc:2955] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:45.067137  1587 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.068053  2231 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:45.071915  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.072664  7583 raft_consensus.cc:515] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.077411  7583 leader_election.cc:290] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:45.077864  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.078450  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f9a39f263da4577833a605ef819b007" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:45.079077  1618 raft_consensus.cc:3060] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:02:45.087061  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:45.089987  2231 leader_election.cc:336] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.090881  1587 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:45.091717  7587 raft_consensus.cc:2804] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.092218  7587 raft_consensus.cc:697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:45.093139  7587 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.109642  1618 raft_consensus.cc:2468] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:45.123682  2266 raft_consensus.cc:1275] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:02:45.135553  2230 leader_election.cc:304] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:45.136310  7583 raft_consensus.cc:2804] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:45.136489  7609 consensus_queue.cc:1048] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:45.137516  7583 raft_consensus.cc:697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:45.138538  7583 consensus_queue.cc:237] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.230263  7434 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.229691  1439 catalog_manager.cc:5697] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 15 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:45.231325  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.231007  7434 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.235324  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:45.236095  2266 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:45.237488  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:45.238605  7587 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.240476  7587 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.241010  7587 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.226264  1444 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 13 to 14, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.241428  7434 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:45.251184  1587 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:45.280905  1618 raft_consensus.cc:1275] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:02:45.284098  7552 consensus_queue.cc:1048] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:02:45.328496  7591 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.329071  7591 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.333973  7591 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.335641  1618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.344429  7591 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.345180  7591 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.368918  7587 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:45.393095  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.394774  7587 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:45.400696  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "831605a002324a04838f4fe562b13530" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:45.401532  2266 raft_consensus.cc:3060] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.409814  2266 raft_consensus.cc:2468] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:45.427898  1585 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:45.429168  7587 raft_consensus.cc:2804] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:45.429674  7587 raft_consensus.cc:697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:45.430549  7587 consensus_queue.cc:237] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.378225  7586 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.438586  1618 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:02:45.440501  7591 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.443245  7586 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.457372  7586 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:45.458714  7500 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.461810  7500 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:45.452127  1587 connection.cc:769] client connection to 127.0.107.193:34175 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:02:45.463995  7500 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:45.445506  7490 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:02:45.494825  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.522785  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:45.526994  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:45.528007  1695 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 13.
I20260709 13:02:45.546416  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:45.543219  7552 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.548126  7434 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:45.548575  7434 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.548399  7552 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.548975  7434 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.552620  7552 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.557166  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.554862  1622 raft_consensus.cc:1275] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:02:45.565485  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:45.588093  1661 connection.cc:769] client connection to 127.0.107.193:34175 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:02:45.584791  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:45.596498  1587 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.599453  7552 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:45.600481  7490 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.601009  7490 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.603044  7623 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.603248  7490 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.598439  7434 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.610014  7552 consensus_queue.cc:1048] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:45.613097  7434 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:45.615438  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:45.617658  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.603730  7623 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.623607  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:45.624228  2266 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 18.
I20260709 13:02:45.626030  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:45.625782  1444 catalog_manager.cc:5697] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 15 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.628242  7617 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.628674  7617 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.629038  7617 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.630959  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51ca4c13fdd142269405c90e6382797c" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:45.631632  1687 raft_consensus.cc:3060] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:45.639551  1687 raft_consensus.cc:2468] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
W20260709 13:02:45.641031  1587 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.641743  7617 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.645896  7623 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:45.641774  1587 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:45.655053  1587 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.656445  7623 raft_consensus.cc:2749] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:45.661998  1587 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:45.662842  7622 raft_consensus.cc:2804] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:45.663373  7622 raft_consensus.cc:697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:45.664310  7622 consensus_queue.cc:237] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.668787  7617 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:45.669241  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8d8fdfe5b4dd999061f7d92c12c5d" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
W20260709 13:02:45.669780  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:45.669883  2266 raft_consensus.cc:3060] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:02:45.680534  1661 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.682090  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.682933  7628 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:02:45.684015  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.700475  1661 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.701005  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.701752  7628 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:45.703123  1661 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.703565  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.704448  7628 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:45.708935  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 47020.7us
I20260709 13:02:45.711400  2266 raft_consensus.cc:2468] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 19.
I20260709 13:02:45.712570  1585 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:45.718452  7623 raft_consensus.cc:2804] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:45.719009  7623 raft_consensus.cc:697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 19 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:45.719942  7623 consensus_queue.cc:237] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:45.728134  1587 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.734040  1687 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:45.746017  7587 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:45.754673  1587 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:45.757799  1587 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:45.758885  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.782922  7434 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.783527  7434 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.785419  7434 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:45.787863  7588 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.788479  7588 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:45.796293  2231 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.796747  7588 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.798285  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.799568  1617 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
I20260709 13:02:45.807976  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:45.811947  7552 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:45.812376  7552 raft_consensus.cc:493] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.812922  7552 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.830163  7552 raft_consensus.cc:515] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.830461  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:45.831137  1690 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 18.
W20260709 13:02:45.837105  2231 leader_election.cc:336] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.844786  7620 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.845654  7628 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.846185  7552 leader_election.cc:290] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.847538  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4bd73d471194556a9ba093049d04790" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:45.849610  1617 raft_consensus.cc:3060] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:45.855619  1444 catalog_manager.cc:5697] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 13 to 14, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.845403  7620 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.843926  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:45.871141  1444 catalog_manager.cc:5697] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 18 to 19, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:45.846192  7628 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.877234  7620 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.878149  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
W20260709 13:02:45.880348  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:45.880975  1661 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.885426  7628 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:45.889014  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.890287  7434 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:02:45.890733  7434 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.891096  7434 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.896157  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:45.897204  7620 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:45.899718  7587 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.900322  7587 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.904328  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:45.905556  7620 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:45.902446  7587 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:45.916368  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:45.917027  1689 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
W20260709 13:02:45.935387  1587 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.937633  7434 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:45.947429  1617 raft_consensus.cc:2468] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:02:45.948721  2230 leader_election.cc:304] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:45.949790  7588 raft_consensus.cc:2804] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:45.950325  7588 raft_consensus.cc:697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:45.951279  7588 consensus_queue.cc:237] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.958405  7587 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.959115  7587 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:45.949798  7434 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:45.965217  7587 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:45.948722  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:45.973945  7587 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:02:45.974398  7587 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:45.974892  7587 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:45.981611  2262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
W20260709 13:02:45.984758  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.986662  1587 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:45.997100  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cfcf5f778944b099b75d0b1a19afa0" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:45.997663  1689 raft_consensus.cc:3060] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:02:45.999840  7552 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.003612  2262 raft_consensus.cc:1275] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:02:46.005079  1689 raft_consensus.cc:2468] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 19.
I20260709 13:02:46.006240  1587 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.007186  7434 raft_consensus.cc:2804] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:02:46.007632  7434 raft_consensus.cc:697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:46.012786  7623 consensus_queue.cc:1048] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:02:46.014780  1444 catalog_manager.cc:5697] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 14 to 15, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.000411  7552 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:46.019071  7552 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:46.020404  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" is_pre_election: true
I20260709 13:02:46.022414  1617 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 12.
I20260709 13:02:46.023029  7434 consensus_queue.cc:237] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.023717  2230 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:46.029539  7623 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.030121  7623 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.032218  7623 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:46.035671  7552 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.036217  7552 raft_consensus.cc:493] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.036717  7552 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:46.043625  1587 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:46.044549  1587 leader_election.cc:336] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.044941  1587 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b; no voters: 9fbc4df0bb934bba941cfa20c0afead2, e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:46.050662  2231 leader_election.cc:336] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.055140  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:46.055827  1689 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 17.
I20260709 13:02:46.050925  7623 raft_consensus.cc:2749] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.036198  7587 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.058034  7587 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:46.063323  7552 raft_consensus.cc:515] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:46.065541  7552 leader_election.cc:290] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:46.066710  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e623ba813c4c3a8152a1de588cda91" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5f349bdadfc40b9bff8e1682b5c271b"
I20260709 13:02:46.069975  1617 raft_consensus.cc:3060] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.070840  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9045b82a0ec40a69c0967a8f8188129" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:46.071440  1689 raft_consensus.cc:3060] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:02:46.072122  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.075768  7623 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:02:46.076128  7587 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.076207  7623 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.078166  7623 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:46.079778  7587 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.082067  7587 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:46.084311  1689 raft_consensus.cc:2468] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 16.
I20260709 13:02:46.085680  7623 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:46.090216  2231 leader_election.cc:336] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.093232  7623 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:46.077294  1587 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.094404  1617 raft_consensus.cc:2468] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 13.
I20260709 13:02:46.095551  2230 leader_election.cc:304] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:02:46.097258  7588 raft_consensus.cc:2804] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:46.097858  7588 raft_consensus.cc:697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:46.098832  7588 consensus_queue.cc:237] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:46.098357  1444 catalog_manager.cc:5697] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 18 to 19, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.110486  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:46.111485  1689 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 14.
I20260709 13:02:46.122684  1587 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.122674  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70b9f3b50c6a495fa5b5b06dcfe6c2b2" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:46.124063  1689 raft_consensus.cc:3060] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:02:46.135367  7617 raft_consensus.cc:2804] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:02:46.136070  7617 raft_consensus.cc:697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:46.137029  7617 consensus_queue.cc:237] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.146667  1689 raft_consensus.cc:2468] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 18.
I20260709 13:02:46.157547  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.172802  7617 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:46.173285  7617 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9fbc4df0bb934bba941cfa20c0afead2)
I20260709 13:02:46.173666  7617 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:46.177865  1587 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.180492  7587 raft_consensus.cc:2804] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:02:46.181131  7587 raft_consensus.cc:697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:46.182166  7587 consensus_queue.cc:237] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:46.219056  1587 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:46.239401  1587 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.232568  7617 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.237763  1444 catalog_manager.cc:5697] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 12 to 13, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:46.270330  1587 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:46.275040  7617 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Requested vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:46.297401  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9810b426aedc4eb89adfbd103150f39a" candidate_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:46.298075  1689 raft_consensus.cc:3060] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:46.300050  1444 catalog_manager.cc:5697] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 15 to 16, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.301673  1444 catalog_manager.cc:5697] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 17 to 18, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.307300  1689 raft_consensus.cc:2468] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f349bdadfc40b9bff8e1682b5c271b in term 15.
I20260709 13:02:46.311347  2262 raft_consensus.cc:1275] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:02:46.321382  7617 consensus_queue.cc:1048] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:02:46.362916  1687 raft_consensus.cc:1275] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:46.366994  1587 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b; no voters: 
I20260709 13:02:46.373167  7623 raft_consensus.cc:2804] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:02:46.373708  7623 raft_consensus.cc:697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Becoming Leader. State: Replica: c5f349bdadfc40b9bff8e1682b5c271b, State: Running, Role: LEADER
I20260709 13:02:46.374594  7623 consensus_queue.cc:237] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:46.388701  7434 consensus_queue.cc:1048] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:46.394340  1617 raft_consensus.cc:1275] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:46.396036  7588 consensus_queue.cc:1048] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:02:46.396958  1587 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.397505  1587 consensus_peers.cc:597] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.397905  1587 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:46.405817  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:46.421378  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.431685  1444 catalog_manager.cc:5697] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: term changed from 14 to 15, leader changed from 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193) to c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.469498  1622 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:02:46.484151  1585 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20bfd12bbb914d07873fde52411d5fc6. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.484691  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:46.495518  1687 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:02:46.501250  7623 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:46.511813  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.512293   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1568)
I20260709 13:02:46.539796  7622 raft_consensus.cc:2955] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.541314  1689 raft_consensus.cc:2955] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.564280  1689 raft_consensus.cc:1275] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:46.568804  7623 consensus_queue.cc:1048] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:46.573256  1689 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:46.577107  1439 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 10, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:46.582540  1659 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71f4d9d1d4d740309d74428e0797e9d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.582865  1622 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:02:46.584517  7628 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:02:46.592160  7490 raft_consensus.cc:2955] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:46.595047  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.597810  1587 consensus_peers.cc:597] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.606902  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.608314  1622 raft_consensus.cc:2955] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.624334  1690 raft_consensus.cc:1275] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:02:46.630028  1689 raft_consensus.cc:1275] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:46.631779  7617 consensus_queue.cc:1048] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:46.629020  1617 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:46.634981  7623 consensus_queue.cc:1048] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:46.670951  1585 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 544a0a0b5c034de2956e73d089c51085. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.675262  1690 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:02:46.694702  7622 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:46.702286  1439 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 12, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 19 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:46.704260  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:46.710354  1617 raft_consensus.cc:1275] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:02:46.714738  7588 consensus_queue.cc:1048] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:46.715890  1587 consensus_peers.cc:597] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.761088  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.780123  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:46.786716  1587 consensus_peers.cc:597] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.785552  7587 raft_consensus.cc:2955] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.794409  1687 raft_consensus.cc:2955] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:46.797060  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:46.819881  1444 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index -1 to 8, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.840760  1687 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:02:46.867974  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:46.874173  1622 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:02:46.876824  1659 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925): Couldn't send request to peer e51b0b5dc04b4f5aaf6a3a870f291345. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 827a7a4d1cab4d8f8d8da6c119f4cce1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:46.878895  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.879611  7628 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:46.891377  1687 raft_consensus.cc:1275] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:02:46.892516  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:46.896813  1587 consensus_peers.cc:597] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.897960  7587 consensus_queue.cc:1048] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:46.915812  7658 ts_tablet_manager.cc:933] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:46.923519  7628 raft_consensus.cc:2955] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:46.932832  1622 raft_consensus.cc:2955] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Committing config change with OpId 16.9: config changed from index -1 to 9, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
W20260709 13:02:46.940508  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:46.949793  7658 tablet_copy_client.cc:323] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:02:46.951990  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 20bfd12bbb914d07873fde52411d5fc6 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:02:46.952667  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 20bfd12bbb914d07873fde52411d5fc6 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-20bfd12bbb914d07873fde52411d5fc6
I20260709 13:02:46.966799  1632 tablet_copy_source_session.cc:215] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:46.971985  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20bfd12bbb914d07873fde52411d5fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.972486  1444 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index -1 to 9, NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } }
I20260709 13:02:47.033052  7658 tablet_copy_client.cc:806] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.033754  7658 tablet_copy_client.cc:670] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
W20260709 13:02:47.035678  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.053201  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.056632  7658 tablet_copy_client.cc:538] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:47.085260  7658 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
W20260709 13:02:47.086462  1587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111) [suppressed 427 similar messages]
W20260709 13:02:47.098011  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.126848  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.175235  7662 ts_tablet_manager.cc:933] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:47.176486  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.189885  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.203773  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:47.213369  7662 tablet_copy_client.cc:323] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:02:47.215595  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 71f4d9d1d4d740309d74428e0797e9d8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:02:47.216213  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 71f4d9d1d4d740309d74428e0797e9d8 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-71f4d9d1d4d740309d74428e0797e9d8
I20260709 13:02:47.231271  7663 ts_tablet_manager.cc:933] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:47.240386  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.248765  1706 tablet_copy_source_session.cc:215] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:02:47.252799  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.264264  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.266976  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.273928  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f4d9d1d4d740309d74428e0797e9d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.275591  7663 tablet_copy_client.cc:323] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:39685
I20260709 13:02:47.277396  1632 tablet_copy_service.cc:140] P c5f349bdadfc40b9bff8e1682b5c271b: Received BeginTabletCopySession request for tablet 544a0a0b5c034de2956e73d089c51085 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:47468)
I20260709 13:02:47.277938  1632 tablet_copy_service.cc:161] P c5f349bdadfc40b9bff8e1682b5c271b: Beginning new tablet copy session on tablet 544a0a0b5c034de2956e73d089c51085 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:47468: session id = e51b0b5dc04b4f5aaf6a3a870f291345-544a0a0b5c034de2956e73d089c51085
W20260709 13:02:47.280328  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.289855  1632 tablet_copy_source_session.cc:215] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:47.293156  7663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 544a0a0b5c034de2956e73d089c51085. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:47.293911  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.329007  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.332640  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.333281  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.360051  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.367561  7667 ts_tablet_manager.cc:933] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Initiating tablet copy from peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:47.368326  7658 log.cc:927] Time spent T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Append to log took a long time: real 0.058s	user 0.002s	sys 0.002s
I20260709 13:02:47.385723  7662 tablet_copy_client.cc:806] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.386474  7662 tablet_copy_client.cc:670] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
W20260709 13:02:47.386751  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.391710  7662 tablet_copy_client.cc:538] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:47.392925  7667 tablet_copy_client.cc:323] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45637
I20260709 13:02:47.394894  7663 tablet_copy_client.cc:806] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.395494  7663 tablet_copy_client.cc:670] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:47.396629  1706 tablet_copy_service.cc:140] P 2080b3bca2e64a1a953c17b506b668d2: Received BeginTabletCopySession request for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 from peer e51b0b5dc04b4f5aaf6a3a870f291345 ({username='slave'} at 127.0.0.1:43624)
I20260709 13:02:47.397192  1706 tablet_copy_service.cc:161] P 2080b3bca2e64a1a953c17b506b668d2: Beginning new tablet copy session on tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 from peer e51b0b5dc04b4f5aaf6a3a870f291345 at {username='slave'} at 127.0.0.1:43624: session id = e51b0b5dc04b4f5aaf6a3a870f291345-827a7a4d1cab4d8f8d8da6c119f4cce1
I20260709 13:02:47.403225  7658 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.406246  1706 tablet_copy_source_session.cc:215] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:47.410308  7658 tablet_bootstrap.cc:492] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:47.417526  7658 ts_tablet_manager.cc:1403] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.333s	user 0.029s	sys 0.021s
I20260709 13:02:47.402766  7663 tablet_copy_client.cc:538] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:47.424427  7662 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:02:47.427304  7658 raft_consensus.cc:359] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
W20260709 13:02:47.428539  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.431360  7667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827a7a4d1cab4d8f8d8da6c119f4cce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:47.434952  7658 raft_consensus.cc:740] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:47.448843  7658 consensus_queue.cc:260] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.451964  7658 ts_tablet_manager.cc:1434] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:02:47.463402  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-20bfd12bbb914d07873fde52411d5fc6 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:02:47.463920  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-20bfd12bbb914d07873fde52411d5fc6 on tablet 20bfd12bbb914d07873fde52411d5fc6 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:47.466301  7663 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
I20260709 13:02:47.480147  7667 tablet_copy_client.cc:806] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:47.480756  7667 tablet_copy_client.cc:670] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:47.485504  7667 tablet_copy_client.cc:538] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:02:47.489203  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.518703   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1568)
I20260709 13:02:47.520790  7667 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap starting.
W20260709 13:02:47.606235  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:47.627130  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.642693  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:47.651955  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:47.679205  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:47.694289  7663 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=3 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.703063  7663 tablet_bootstrap.cc:492] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:47.708246  2266 raft_consensus.cc:1217] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:02:47.708765  7663 ts_tablet_manager.cc:1403] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.244s	user 0.039s	sys 0.008s
I20260709 13:02:47.787699  7662 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=2 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.788820  7662 tablet_bootstrap.cc:492] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:47.789568  7662 ts_tablet_manager.cc:1403] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.365s	user 0.055s	sys 0.024s
W20260709 13:02:47.799011  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:47.828559  7667 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:47.829728  7667 tablet_bootstrap.cc:492] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Bootstrap complete.
I20260709 13:02:47.830654  7667 ts_tablet_manager.cc:1403] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent bootstrapping tablet: real 0.310s	user 0.033s	sys 0.015s
I20260709 13:02:47.839848  7663 raft_consensus.cc:359] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.842244  7662 raft_consensus.cc:359] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.850943  7663 raft_consensus.cc:740] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:47.855706  7663 consensus_queue.cc:260] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.851298  7662 raft_consensus.cc:740] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:47.857633  7662 consensus_queue.cc:260] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.862845  7663 ts_tablet_manager.cc:1434] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.124s	user 0.001s	sys 0.006s
I20260709 13:02:47.871937  7662 ts_tablet_manager.cc:1434] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.082s	user 0.010s	sys 0.000s
I20260709 13:02:47.854409  7667 raft_consensus.cc:359] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.879156  7667 raft_consensus.cc:740] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Initialized, Role: LEARNER
I20260709 13:02:47.879988  1632 tablet_copy_service.cc:342] P c5f349bdadfc40b9bff8e1682b5c271b: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-544a0a0b5c034de2956e73d089c51085 received from {username='slave'} at 127.0.0.1:47468
I20260709 13:02:47.880463  1632 tablet_copy_service.cc:434] P c5f349bdadfc40b9bff8e1682b5c271b: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-544a0a0b5c034de2956e73d089c51085 on tablet 544a0a0b5c034de2956e73d089c51085 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:47.880640  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-71f4d9d1d4d740309d74428e0797e9d8 received from {username='slave'} at 127.0.0.1:43624
I20260709 13:02:47.881170  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-71f4d9d1d4d740309d74428e0797e9d8 on tablet 71f4d9d1d4d740309d74428e0797e9d8 with peer e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:47.879989  7667 consensus_queue.cc:260] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } }
I20260709 13:02:47.887892  7667 ts_tablet_manager.cc:1434] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:02:47.896806  1706 tablet_copy_service.cc:342] P 2080b3bca2e64a1a953c17b506b668d2: Request end of tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-827a7a4d1cab4d8f8d8da6c119f4cce1 received from {username='slave'} at 127.0.0.1:43624
I20260709 13:02:47.897320  1706 tablet_copy_service.cc:434] P 2080b3bca2e64a1a953c17b506b668d2: ending tablet copy session e51b0b5dc04b4f5aaf6a3a870f291345-827a7a4d1cab4d8f8d8da6c119f4cce1 on tablet 827a7a4d1cab4d8f8d8da6c119f4cce1 with peer e51b0b5dc04b4f5aaf6a3a870f291345
W20260709 13:02:47.914407  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:48.098405  2266 raft_consensus.cc:1217] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:02:48.160573  2266 raft_consensus.cc:1217] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
W20260709 13:02:48.166915  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.355499  7622 raft_consensus.cc:1064] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:48.368758  7622 consensus_queue.cc:237] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:48.384078  2266 raft_consensus.cc:1217] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.8->[16.9-16.9]   Dedup: 16.9->[]
I20260709 13:02:48.399211  2266 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:02:48.400821  7622 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:02:48.455369  1687 raft_consensus.cc:1275] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:02:48.519487   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1568)
I20260709 13:02:48.520292  7434 consensus_queue.cc:1048] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:02:48.594825  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.609397  7678 raft_consensus.cc:1064] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:48.612294  7678 consensus_queue.cc:237] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:48.655398  7681 raft_consensus.cc:2955] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:48.657801  2266 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:48.661852  7676 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:48.689029  1618 raft_consensus.cc:1275] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:02:48.696394  7684 consensus_queue.cc:1048] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:02:48.715390  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.723476  7678 raft_consensus.cc:2955] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:48.746763  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 65356.4us
I20260709 13:02:48.748447  7623 raft_consensus.cc:1064] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
W20260709 13:02:48.746840  1585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:32925, user_credentials={real_user=slave}} blocked reactor thread for 51419.4us
I20260709 13:02:48.757184  1622 raft_consensus.cc:2955] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:48.764354  7623 consensus_queue.cc:237] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:48.795656  1689 raft_consensus.cc:2955] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:48.800422  2260 raft_consensus.cc:2955] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:48.815207  1444 catalog_manager.cc:5697] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: config changed from index 12 to 13, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.829602  2266 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEARNER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:02:48.829160  2260 raft_consensus.cc:2955] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:48.833210  7617 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:02:48.838518  1587 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:48.839107  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:48.866940  1689 raft_consensus.cc:1275] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Refusing update from remote peer c5f349bdadfc40b9bff8e1682b5c271b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:02:48.880739  1587 consensus_peers.cc:597] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:48.881423  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:48.911449  7622 consensus_queue.cc:1048] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:48.920437  7684 raft_consensus.cc:1064] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: attempting to promote NON_VOTER e51b0b5dc04b4f5aaf6a3a870f291345 to VOTER
I20260709 13:02:48.923302  7684 consensus_queue.cc:237] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 7, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:48.985893  7617 raft_consensus.cc:2955] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:49.004441  2266 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEARNER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:49.000864  1687 raft_consensus.cc:2955] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:49.006659  7676 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:49.012715  2266 raft_consensus.cc:2955] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:49.016458  1618 raft_consensus.cc:1275] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:02:49.030435  7676 consensus_queue.cc:1048] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:02:49.033056  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.069447  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:49.074702  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:49.091346  7696 log.cc:927] Time spent T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:02:49.093263  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.147965  1622 raft_consensus.cc:2955] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:49.146286  7678 raft_consensus.cc:2955] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:49.167806  1587 consensus_peers.cc:597] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:49.190701  2266 raft_consensus.cc:2955] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index 9 to 10, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:49.199795  1587 consensus_peers.cc:597] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.201315  1587 consensus_peers.cc:597] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.210567  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.238606  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:49.247648  1438 catalog_manager.cc:5697] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b reported cstate change: config changed from index 10 to 11, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.283226  1441 catalog_manager.cc:5697] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 8 to 9, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
I20260709 13:02:49.286793  1441 catalog_manager.cc:5697] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: config changed from index 9 to 10, e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } } }
W20260709 13:02:49.398801  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.429823  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.451946  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.475854  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.520004   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1568)
W20260709 13:02:49.563936  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.565706  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.581177  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.606017  1587 consensus_peers.cc:597] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:49.621497  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.623533  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.637465  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.641498  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.682291  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.708235  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.728765  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:49.737943  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.774996  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.855690  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.874650  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:49.877969  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.906250  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.908695  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.915680  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.946676  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:49.975195  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:49.982940  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.110797  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.187783  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:50.363294  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.416424  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.520503   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1568)
W20260709 13:02:50.543716  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.575250  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:50.679388  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:50.994123  1587 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.219691  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.230950  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.245508  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.329463  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.445304  1587 consensus_peers.cc:597] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.490700  1587 consensus_peers.cc:597] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.493788  1587 consensus_peers.cc:597] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.502513  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:51.521013   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1568)
W20260709 13:02:51.543467  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:51.609980  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.739188  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:51.767302  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:51.767791  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:51.885620  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:51.908952  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.010380  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.022945  1587 consensus_peers.cc:597] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.070253  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.077185  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.085063  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.104846  1587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111) [suppressed 461 similar messages]
W20260709 13:02:52.113566  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.141399  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.165135  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.172787  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.197888  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.211608  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.299890  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.299890  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.321072  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.367936  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.377879  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.424222  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:52.438845  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:52.442090  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.474829  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.518980  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.521528   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1568)
W20260709 13:02:52.549428  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.628297  1587 consensus_peers.cc:597] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:52.753053  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.755002  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:52.757375  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 62654.6us
W20260709 13:02:52.766279  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:52.824474  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 48738.3us
W20260709 13:02:52.959753  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:53.186844  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:53.195694  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:53.217847  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:53.331700  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:53.443550  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:53.488446  1587 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:53.762667  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.830945  1587 consensus_peers.cc:597] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:53.832203  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:53.981037  1587 consensus_peers.cc:597] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.048300  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.064105  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.096486  1431 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 100013us
W20260709 13:02:54.109292  1587 consensus_peers.cc:597] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.135244  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:54.151688  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:54.199443  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.209928  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:54.396973  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.401820  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.424715  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.485296  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.575781  1587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54982.3us
W20260709 13:02:54.608318  1587 consensus_peers.cc:597] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.613698  1587 consensus_peers.cc:597] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.620165  1587 consensus_peers.cc:597] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:54.624106  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.632256  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.651981  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.657908  1587 consensus_peers.cc:597] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.730654  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.745604  1587 consensus_peers.cc:597] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.757766  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.748003  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.780134  1587 consensus_peers.cc:597] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.842283  1587 consensus_peers.cc:597] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.888788  1587 consensus_peers.cc:597] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:54.929265  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:54.948226   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:54.996269  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.022704  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:55.030831  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.040439  1587 consensus_peers.cc:597] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.046909  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.054867  1587 consensus_peers.cc:597] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.157142  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.167313  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:55.205297  1587 consensus_peers.cc:597] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.210393  1587 consensus_peers.cc:597] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:55.836126  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:55.905331   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:55.950537  2230 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:55.960111  1587 consensus_peers.cc:597] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.960759  1587 consensus_peers.cc:597] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:55.995138  1587 consensus_peers.cc:597] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:55.996469  2230 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.027284  2230 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.036203  2230 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.037572  1660 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.056022  1660 consensus_peers.cc:597] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.057646  2230 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.064589  1660 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.065164  2230 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.070737  1660 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.101550  2230 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.103425  2230 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.136570  1660 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.172423  1660 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.220903  2230 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.226868  2230 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.229856  1587 consensus_peers.cc:597] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:02:56.235687  2230 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.262064  1660 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.276443  1660 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.280160  2230 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.296332  1587 consensus_peers.cc:597] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.299754  1587 consensus_peers.cc:597] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:56.321662  2230 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.331421   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:56.333822   431 tablet_replica.cc:333] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.335999   431 raft_consensus.cc:2243] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:02:56.360698  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:56.368010  2230 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.370561  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:56.370915  2230 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:56.381487  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:56.402864   431 raft_consensus.cc:2272] T f1012ad0f2cf49ff98a60ff466b6246d P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.452122  2230 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.452946   431 tablet_replica.cc:333] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.457899   431 raft_consensus.cc:2243] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.465983   431 raft_consensus.cc:2272] T 5c6369221c274c789a9f8654d6ee9417 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.466992  1587 consensus_peers.cc:597] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:56.500792   431 tablet_replica.cc:333] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.521960   431 raft_consensus.cc:2243] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.523316   431 raft_consensus.cc:2272] T 95c7b064bb5640149a09ee01f2a4e2f7 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.535449   431 tablet_replica.cc:333] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.536407   431 raft_consensus.cc:2243] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.537631   431 raft_consensus.cc:2272] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.566012   431 tablet_replica.cc:333] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.567081   431 raft_consensus.cc:2243] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.568784   431 raft_consensus.cc:2272] T e9045b82a0ec40a69c0967a8f8188129 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.582821   431 tablet_replica.cc:333] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.583844   431 raft_consensus.cc:2243] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.584519   431 raft_consensus.cc:2272] T 5ad1e195a7c2407789e8c8a409b95740 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.591521  1587 consensus_peers.cc:597] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:56.595193   431 tablet_replica.cc:333] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.596135   431 raft_consensus.cc:2243] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.597002   431 raft_consensus.cc:2272] T 5be703fc2dd046c1b14909b95d460cd8 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.608551   431 tablet_replica.cc:333] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.610155   431 raft_consensus.cc:2243] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.611649   431 raft_consensus.cc:2272] T 4a0c52190de849839b129a0fa6099693 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.628031   431 tablet_replica.cc:333] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.629879   431 raft_consensus.cc:2243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.632628   431 raft_consensus.cc:2272] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.645920   431 tablet_replica.cc:333] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.646879   431 raft_consensus.cc:2243] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.647565   431 raft_consensus.cc:2272] T ad9c8a969843427fb32b4afb149874ba P c5f349bdadfc40b9bff8e1682b5c271b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.657182   431 tablet_replica.cc:333] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.658093   431 raft_consensus.cc:2243] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.659399   431 raft_consensus.cc:2272] T 29466a5fdaaa4059bb44d95ca1ec63b8 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.662179   431 tablet_replica.cc:333] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.671277   431 raft_consensus.cc:2243] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.671892   431 raft_consensus.cc:2272] T 73951993cbd34d1cbe7ed6fe93812a5f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.674871   431 tablet_replica.cc:333] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
W20260709 13:02:56.675756  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:56.686947   431 raft_consensus.cc:2243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.688052   431 raft_consensus.cc:2272] T 7c6ce8e6dbe04fc3bb43288095f2de7b P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.691463   431 tablet_replica.cc:333] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.692427   431 raft_consensus.cc:2243] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.695657   431 raft_consensus.cc:2272] T 20bfd12bbb914d07873fde52411d5fc6 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.699080   431 tablet_replica.cc:333] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.699958   431 raft_consensus.cc:2243] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.701098   431 raft_consensus.cc:2272] T 71f4d9d1d4d740309d74428e0797e9d8 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.716022   431 tablet_replica.cc:333] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.716843   431 raft_consensus.cc:2243] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.717743   431 raft_consensus.cc:2272] T 8ba8839a7d2844ab8f6a90a60af5556e P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.720741   431 tablet_replica.cc:333] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.728219   431 raft_consensus.cc:2243] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.728977   431 raft_consensus.cc:2272] T bb5d38534bcc45e19c58dcc3139a4ee6 P c5f349bdadfc40b9bff8e1682b5c271b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.732033   431 tablet_replica.cc:333] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.756914   431 raft_consensus.cc:2243] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.759358   431 raft_consensus.cc:2272] T 6548704b45e547b6ab8bc4081d8b3ad7 P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.769490   431 tablet_replica.cc:333] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.770428   431 raft_consensus.cc:2243] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.771646   431 raft_consensus.cc:2272] T 06184411faf343c9939d453eeec59cae P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.774418   431 tablet_replica.cc:333] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.782786   431 raft_consensus.cc:2243] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.784335   431 raft_consensus.cc:2272] T 544a0a0b5c034de2956e73d089c51085 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.787320   431 tablet_replica.cc:333] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.788154   431 raft_consensus.cc:2243] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.789479   431 raft_consensus.cc:2272] T 01e623ba813c4c3a8152a1de588cda91 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.778223  1587 consensus_peers.cc:597] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:56.806793  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:56.818953   431 tablet_replica.cc:333] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.823709   431 raft_consensus.cc:2243] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.827054   431 raft_consensus.cc:2272] T ca134e523abd4f159806116930d9aece P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.829995   431 tablet_replica.cc:333] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.840961   431 raft_consensus.cc:2243] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.841914   431 raft_consensus.cc:2272] T 78df79e3d5044daa8ed98fe19b18d0fe P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.855240   431 tablet_replica.cc:333] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.856099   431 raft_consensus.cc:2243] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.863328   431 raft_consensus.cc:2272] T aa0c15f4fa7246faa2d54502e99a81ab P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.866178   431 tablet_replica.cc:333] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.867003   431 raft_consensus.cc:2243] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.867966   431 raft_consensus.cc:2272] T be3cc12e24cf42b1b289cee33b288dd9 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.871578  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:02:56.879029   431 tablet_replica.cc:333] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.879971   431 raft_consensus.cc:2243] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.880736   431 raft_consensus.cc:2272] T e3c2089bb9c240cc97c2b79e1d4c648f P c5f349bdadfc40b9bff8e1682b5c271b [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.884629  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:56.890225   431 tablet_replica.cc:333] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.891162   431 raft_consensus.cc:2243] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.892354   431 raft_consensus.cc:2272] T 10cfcf5f778944b099b75d0b1a19afa0 P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.895072   431 tablet_replica.cc:333] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.895826   431 raft_consensus.cc:2243] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.896958   431 raft_consensus.cc:2272] T 459063895bc847b9a15dc71e10b36267 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.911613   431 tablet_replica.cc:333] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.912648   431 raft_consensus.cc:2243] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.913767   431 raft_consensus.cc:2272] T 0c4f26e727a741fa8ca38a41fff1dc1d P c5f349bdadfc40b9bff8e1682b5c271b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.919842   431 tablet_replica.cc:333] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.920609   431 raft_consensus.cc:2243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.938694   431 raft_consensus.cc:2272] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.939811  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:02:56.941574   431 tablet_replica.cc:333] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.943357   431 raft_consensus.cc:2243] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.944289   431 raft_consensus.cc:2272] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.946978   431 tablet_replica.cc:333] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.947721   431 raft_consensus.cc:2243] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.948869   431 raft_consensus.cc:2272] T 51ca4c13fdd142269405c90e6382797c P c5f349bdadfc40b9bff8e1682b5c271b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.951392  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:56.952194   431 tablet_replica.cc:333] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.953039   431 raft_consensus.cc:2243] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.953625   431 raft_consensus.cc:2272] T e4bd73d471194556a9ba093049d04790 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.964561   431 tablet_replica.cc:333] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.975342   431 raft_consensus.cc:2243] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.977051   431 raft_consensus.cc:2272] T 6bb37620691446b2b3ac3e61e48ed81d P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.979336   431 tablet_replica.cc:333] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.980113   431 raft_consensus.cc:2243] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.980720   431 raft_consensus.cc:2272] T ac3f2e6866214e3e89b342a804e31b9f P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.983439   431 tablet_replica.cc:333] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.984148   431 raft_consensus.cc:2243] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.985049   431 raft_consensus.cc:2272] T 1f9a39f263da4577833a605ef819b007 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.987792   431 tablet_replica.cc:333] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.988494   431 raft_consensus.cc:2243] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.989881   431 raft_consensus.cc:2272] T 831605a002324a04838f4fe562b13530 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.992728   431 tablet_replica.cc:333] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.993449   431 raft_consensus.cc:2243] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.994550   431 raft_consensus.cc:2272] T af2df8228f514af5aee2481a5f153280 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.997100   431 tablet_replica.cc:333] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:56.997884   431 raft_consensus.cc:2243] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.999095   431 raft_consensus.cc:2272] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P c5f349bdadfc40b9bff8e1682b5c271b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.001731   431 tablet_replica.cc:333] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.002435   431 raft_consensus.cc:2243] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.003119   431 raft_consensus.cc:2272] T aa0547666b41440ebc195aa8cd34bc9d P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.005841   431 tablet_replica.cc:333] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.006549   431 raft_consensus.cc:2243] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.007608   431 raft_consensus.cc:2272] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.010221   431 tablet_replica.cc:333] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.011210   431 raft_consensus.cc:2243] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.012501   431 raft_consensus.cc:2272] T 9810b426aedc4eb89adfbd103150f39a P c5f349bdadfc40b9bff8e1682b5c271b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.015595   431 tablet_replica.cc:333] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.016696   431 raft_consensus.cc:2243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.018146   431 raft_consensus.cc:2272] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P c5f349bdadfc40b9bff8e1682b5c271b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.021168   431 tablet_replica.cc:333] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.021883   431 raft_consensus.cc:2243] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.023026   431 raft_consensus.cc:2272] T dae379e1020a47aea6053cd31adaf4a0 P c5f349bdadfc40b9bff8e1682b5c271b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.025885   431 tablet_replica.cc:333] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.026571   431 raft_consensus.cc:2243] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.027745   431 raft_consensus.cc:2272] T 854dc9ecb21b45069ab7661dc5c021c9 P c5f349bdadfc40b9bff8e1682b5c271b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.046458   431 tablet_replica.cc:333] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.047176   431 raft_consensus.cc:2243] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.047968   431 raft_consensus.cc:2272] T d5f6768c02504c9cb4195745e3f1970e P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.050659   431 tablet_replica.cc:333] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.052660   431 raft_consensus.cc:2243] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.053922   431 raft_consensus.cc:2272] T 59f1e89f0b484c16a765a9cbf4b2de05 P c5f349bdadfc40b9bff8e1682b5c271b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.057075   431 tablet_replica.cc:333] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b: stopping tablet replica
I20260709 13:02:57.057698   431 raft_consensus.cc:2243] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.058390   431 raft_consensus.cc:2272] T ab05924031f84a848a47260864c78193 P c5f349bdadfc40b9bff8e1682b5c271b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:57.077464  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:57.109338  2230 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 489 similar messages]
W20260709 13:02:57.204147  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:57.292398  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:57.319473  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:57.386762  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:57.538079  7743 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.538844  7743 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:57.556216  1661 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:57.576521  1660 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.577075  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.584046  7742 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:57.585021  7743 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:57.625686  7743 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.626338  7743 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:57.634020  1660 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.637923  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:57.640373  1659 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: c5f349bdadfc40b9bff8e1682b5c271b, e51b0b5dc04b4f5aaf6a3a870f291345
I20260709 13:02:57.641520  7742 raft_consensus.cc:2749] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:57.648838  7743 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:57.652004  7742 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.652673  7742 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:57.655306  7742 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:57.679875  1660 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:57.692543  1661 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:57.693128  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.694802  7743 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:02:57.703701  7746 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.704478  7746 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:57.712492  2231 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:57.718791  7746 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:57.720784  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:57.723045  2231 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
W20260709 13:02:57.725710  2230 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.727011  7746 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:57.757226  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:57.769415  7746 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
W20260709 13:02:57.769745  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:57.770133  7746 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:57.775827  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:57.776561  1695 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 16.
I20260709 13:02:57.779999  2231 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:57.781908  7735 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:02:57.782356  7735 raft_consensus.cc:493] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.782791  7735 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:02:57.785773  2230 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.788528  7746 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:02:57.796643  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:57.797391  7741 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.797860  7743 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.798014  7741 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:57.798453  7743 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:57.801383  7741 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:57.805516  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:57.812186  1660 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:57.814738  2230 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.819018  2231 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.822072  7743 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:57.822362  7741 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:57.823559  2231 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:57.847553  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:57.848856  1661 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:57.849583  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.833477  7735 raft_consensus.cc:515] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:57.851985  7743 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:57.856793  7735 leader_election.cc:290] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:57.859874  7743 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.861016  7743 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:57.866902  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6369221c274c789a9f8654d6ee9417" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2"
I20260709 13:02:57.868350  1695 raft_consensus.cc:3060] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:02:57.878497  7742 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.879212  7742 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:57.880498  1660 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.881584  7742 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:57.886792  1660 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.888803  7743 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:57.894483  1695 raft_consensus.cc:2468] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 17.
W20260709 13:02:57.899756  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:57.922704  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:57.923193  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.923949  7743 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:57.925091  1661 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:57.925549  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.926285  7743 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:57.917714  2230 leader_election.cc:336] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.938938  2231 leader_election.cc:304] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:57.939889  7735 raft_consensus.cc:2804] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:02:57.940603  7735 raft_consensus.cc:697] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Becoming Leader. State: Replica: e51b0b5dc04b4f5aaf6a3a870f291345, State: Running, Role: LEADER
I20260709 13:02:57.941885  7735 consensus_queue.cc:237] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:57.976934  7746 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:57.977559  7746 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:57.979843  7746 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:57.986174  2230 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:57.992308  1441 catalog_manager.cc:5697] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 reported cstate change: term changed from 16 to 17, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:58.003461  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.004014  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.004786  7746 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:58.032428  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:58.065002  7735 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.065765  7735 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.069538  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:58.075838  7746 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.076577  7746 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:58.077114  2230 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.077647  2230 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.078325  7735 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:58.079079  7748 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:02:58.088425  2230 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.095403  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:58.096321  7743 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.096860  7743 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.103277  7743 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.104501  7742 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.105142  7742 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.108351  7742 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:58.110448  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:58.111292  2266 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
W20260709 13:02:58.116986  1660 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.079097  7746 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.129136  1660 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.137550  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.139822  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.179172  7735 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:58.176705  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 47611.2us
I20260709 13:02:58.184255  7742 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.184847  7742 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.214247  7742 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.218101   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1643)
I20260709 13:02:58.223280  7730 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.224000  7730 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.226184  7730 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.212602  1661 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.226548  7754 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.227072  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.227214  7754 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.229297  7754 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.254462  7746 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.255167  7746 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.258101  7746 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:58.258859  7754 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:58.259011  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 46477.8us
W20260709 13:02:58.259531  1661 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.259920  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:58.260957  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:02:58.263249  7743 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:58.274559  1660 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.280850  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:02:58.307404  2230 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.307930  2230 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.308836  7735 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:58.314694  1660 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.316205  1660 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.318984  7730 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.349797  7730 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.352173  7730 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.353681  2230 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.354918  2231 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.356920  7730 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.361886  7730 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.362892  7742 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.363459  7742 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.364472  7730 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.360292  7754 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.365549  7742 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.365353  7754 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.368309  7754 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:58.371999  7748 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.373230  7748 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.375480  7748 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.370993  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:58.376682  2266 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
W20260709 13:02:58.403329  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:58.418337  7754 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.419004  7754 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.421504  7754 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.431533  1661 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.433445  1661 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:58.413440  1660 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.440986  7754 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:58.443889  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:58.448688  1661 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.454602  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.462586  7754 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.464744  7754 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.465413  7754 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.470588  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:58.471397  2266 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 21.
I20260709 13:02:58.472870  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
I20260709 13:02:58.473899  7742 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:02:58.474311  7742 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.474869  7742 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:02:58.482828  7754 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:58.487797  1661 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.507303  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.515771  7754 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:02:58.493167  7742 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:58.497905  1660 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.459329  2230 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.521001  2230 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39685, user_credentials={real_user=slave}} blocked reactor thread for 61706.6us
W20260709 13:02:58.521765  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:58.525568  2230 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:58.530596  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:58.521088  1660 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.531572  2230 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:58.531869  1660 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.532750  7746 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:58.538560  1660 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:58.551429  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dae379e1020a47aea6053cd31adaf4a0" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345"
I20260709 13:02:58.552155  2266 raft_consensus.cc:3060] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:02:58.563637  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:58.566169  2266 raft_consensus.cc:2468] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 22.
I20260709 13:02:58.567042  7742 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 election: Requested vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:02:58.575860  1660 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.583232  7730 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.583856  7730 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:58.585457  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.585865  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.582844  7754 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.586571  7743 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.586575  7730 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:02:58.587008  7754 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.593930  1659 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 
W20260709 13:02:58.594225  1660 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.595662  1660 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.597350  1660 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.596217  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:02:58.601157  2266 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
I20260709 13:02:58.609210  7742 raft_consensus.cc:2804] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:02:58.609835  7742 raft_consensus.cc:697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 22 LEADER]: Becoming Leader. State: Replica: 2080b3bca2e64a1a953c17b506b668d2, State: Running, Role: LEADER
I20260709 13:02:58.610816  7742 consensus_queue.cc:237] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:58.596704  7743 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.614645  7743 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:58.616364  7754 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.616760  7743 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:58.596884  7730 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:58.619241  7730 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:58.619887  1660 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.625567  1660 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.626379  1660 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.626945  1660 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:02:58.637081  1660 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:58.625259  7730 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:58.640072  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.640568  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:58.641431  1661 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.641820  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.645968  1695 raft_consensus.cc:1275] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Refusing update from remote peer e51b0b5dc04b4f5aaf6a3a870f291345: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:02:58.647511  7757 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:58.648254  7757 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:02:58.657748  7755 consensus_queue.cc:1048] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:02:58.660405  2230 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.660981  2230 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.661386  2230 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.664426  2230 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.703256  1660 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.707415  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 65984.7us
W20260709 13:02:58.708447  1661 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.709076  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:02:58.710225  1661 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.710716  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.713703  7760 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:02:58.714349  2230 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:58.731060  7756 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:58.738281  1660 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.743726  1661 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.744338  1661 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.746057  7759 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:02:58.747917  1661 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.748570  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.749956  1441 catalog_manager.cc:5697] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 reported cstate change: term changed from 21 to 22, leader changed from c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194) to 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195). New cstate: current_term: 22 leader_uuid: "2080b3bca2e64a1a953c17b506b668d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:58.765738  1661 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.767539  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.765769  7760 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.775187  7760 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:58.775452  1661 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:58.779780  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:58.783161  7760 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:02:58.802670  2230 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.805660  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:58.806279  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:02:58.808811  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:58.813989  2230 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.849632  1660 consensus_peers.cc:597] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.862406  2230 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.903367  2230 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.903864  2230 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.945746  2230 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:58.946476  2230 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:59.021196  2260 raft_consensus.cc:1275] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Refusing update from remote peer 2080b3bca2e64a1a953c17b506b668d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:02:59.024464  7760 consensus_queue.cc:1048] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:02:59.028671  1660 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.034832  1660 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.090242  1660 consensus_peers.cc:597] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.152232  2230 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.163115  2230 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.218650   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1643)
I20260709 13:02:59.284013  7756 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.284689  7756 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:59.286808  7756 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:59.292899  1661 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:59.294322  1660 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.294823  1660 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.295989  7756 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:59.338104  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:02:59.351651  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:59.386037  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:59.407269  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:59.413774  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:02:59.527566  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:59.645951  7756 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.646569  7756 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:59.665089  1661 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:59.667641  7756 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:59.670842  1660 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.671515  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.672711  7756 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:02:59.676918  7748 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.677551  7748 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:02:59.680539  7748 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:02:59.682907  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:02:59.683632  1695 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
W20260709 13:02:59.689553  2231 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:59.693734  2230 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.694279  2230 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.695143  7746 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:02:59.742267  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:02:59.746569  7769 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.747300  7769 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:02:59.760571  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:59.761415  1660 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.761839  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.762553  7769 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:02:59.763095  7756 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:02:59.777433  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:02:59.797909  7769 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.798645  7769 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:02:59.800945  7769 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:59.818113  1661 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:02:59.824440  1660 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.825078  1660 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.828675  7769 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:02:59.889187  7748 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:02:59.890515  7748 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:02:59.904289  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:59.907456  2230 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:02:59.915556  7748 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:02:59.935708  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:02:59.940816  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:02:59.943526  7748 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:02:59.968490  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:02:59.977981  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:00.023973  7760 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.024605  7760 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.043222  1661 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.044214  7760 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.050252  1660 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.050951  1660 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.052333  7760 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.058513  7760 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.059122  7760 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.061585  7760 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.071014  1661 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.077428  1660 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.078018  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.079308  7760 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:00.128240  7760 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.128850  7760 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.138293  1660 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.140112  7760 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.155771  1661 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.156435  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.157846  7760 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.158389  7746 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.164115  7746 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:00.166535  7746 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.177219  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.178598  2230 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.179069  2230 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.182101  7746 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.183931  7756 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.194087  7756 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.197608  7756 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.202915  1661 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.203480  1660 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.203913  1660 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.205670  7756 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:00.219193   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1643)
I20260709 13:03:00.255541  7756 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.256145  7756 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.260275  7760 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.260828  7760 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.262815  7760 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.277067  1661 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.281665  1660 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.282164  1660 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.283960  7760 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:00.258352  7756 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.298982  1661 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.303785  7746 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.304455  7746 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:00.305154  1660 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.305650  1660 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.306785  7769 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:00.306860  7746 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.318241  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.319144  2230 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.319706  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.321004  7746 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:00.353405  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.356829  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.377648  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:00.391891  7769 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.392653  7769 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.405881  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:00.407042  1660 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.407503  1660 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.411010  7769 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:00.411716  7756 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.418645  7756 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.419178  7756 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.427855  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:00.434734  7756 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:00.440815  7760 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.460480  7760 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.462858  7760 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.469599  1660 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:00.472930  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.474164  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.484869  7756 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:00.498006  1660 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.512517  7760 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.513230  7760 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:00.515973  7760 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:00.522480  7748 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.523187  7748 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:00.535625  1661 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.538710  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.538803  7746 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.543027  7746 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:00.543707  7760 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:00.540176  2230 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:00.546480  2231 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.547154  7746 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:03:00.547410  2231 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:03:00.537361  1660 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.549983  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:03:00.550658  1689 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 18.
I20260709 13:03:00.554066  7748 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:00.559448  2230 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.559954  7746 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:00.561408  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
W20260709 13:03:00.566926  2231 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.562944  1689 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:03:00.571136  2231 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.573412  7746 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:00.562599  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.576193  1661 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.576737  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.579315  7760 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:00.580431  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.594256  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:00.682065  7756 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.682678  7756 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.700125  1660 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.703434  7756 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.704259  1661 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.704870  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.706213  7756 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:00.739337  2230 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:00.773392  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.839820  2230 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:00.871766  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:03:00.872737  7756 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:00.873268  7756 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:00.882042  1660 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:00.887163  7756 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:00.890003  1661 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:00.893515  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:00.896775  7756 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:00.895627  1660 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:00.914799  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:00.943732  1660 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:00.958181  2230 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.025691  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:01.062088  1660 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.067626  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:01.092653  2230 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:01.103241  2230 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.139271  2230 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.164456  1660 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.172677  2230 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.196264  2230 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.219759   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1643)
W20260709 13:03:01.262662  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:01.273473  2230 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.277045  2230 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.279681  2230 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.295459  2230 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.351779  2230 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.379980  2230 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:01.402485  7773 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:01.403560  7773 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:01.407212  7773 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:01.436520  2230 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:01.455729  7771 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:01.456707  7771 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:01.463783  7771 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:03:01.467612  1660 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:01.468561  1660 consensus_peers.cc:597] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:01.469815  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:03:01.470474  2266 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 14.
W20260709 13:03:01.471760  1660 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.474978  1660 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:01.474396  1661 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:01.476873  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:01.478029  7771 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:01.481201  1661 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:01.485975  1661 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:01.486904  7756 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:01.535548  1660 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.566604  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:01.589908  1660 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.631250  1660 consensus_peers.cc:597] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.764379  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:01.767234  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:01.765554  2230 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.883234  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:01.906038  2230 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:01.945119  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:02.021781  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:02.107921  7748 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.108572  7748 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:02.109691  2231 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111) [suppressed 596 similar messages]
I20260709 13:03:02.112135  7748 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:02.117619  2230 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.118436  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:02.133513  2231 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.134196  2231 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.142057  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:03:02.142767  1695 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 15.
I20260709 13:03:02.141278  7748 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.174966  7756 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.175666  7756 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.179780  7756 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.183475  1660 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.190096  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.190733  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:02.191907  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.192471  1661 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.193665  7777 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:02.202296  7777 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.202907  7777 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.207156  7777 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:02.211175  7777 raft_consensus.cc:493] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.211799  7777 raft_consensus.cc:515] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.214872  7777 leader_election.cc:290] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.220371   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1643)
I20260709 13:03:02.300578  7777 raft_consensus.cc:493] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.302259  7777 raft_consensus.cc:515] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.341269  7777 leader_election.cc:290] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.401239  1660 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.402029  1660 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.403685  1660 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.402848  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.404842  1661 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.405689  7756 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:02.409351  1661 leader_election.cc:336] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.409896  1661 leader_election.cc:304] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.410804  7756 raft_consensus.cc:2749] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:02.412046  1661 leader_election.cc:336] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:02.414192  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.419637  1661 leader_election.cc:304] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.421113  7771 raft_consensus.cc:2749] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:02.414659  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:02.440109  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:02.449399  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:02.569530  7784 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.570168  7784 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:02.586705  1661 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:02.587812  1660 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:02.588266  1660 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.589569  7784 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:02.590649  7777 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:02.614944  7781 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.615535  7781 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:02.617918  7781 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.628319  2230 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.629225  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.629724  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.630592  7781 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:02.640303  7784 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.640926  7784 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:02.650529  1660 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.652509  1661 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.653577  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.653040  7784 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:02.654714  7777 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:02.753536  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:02.778831  7784 raft_consensus.cc:493] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.779516  7784 raft_consensus.cc:515] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.782661  7784 leader_election.cc:290] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.791483  1661 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:02.792323  1660 leader_election.cc:336] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:02.792824  1660 leader_election.cc:304] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.794516  7777 raft_consensus.cc:2749] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:02.809429  7784 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.811897  7784 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.814281  7784 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.829618  1660 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.832347  1661 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:02.832844  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:02.833763  7771 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:02.871997  1661 consensus_peers.cc:597] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:02.935094  7748 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.935758  7748 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:02.938191  7748 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:02.975585  7771 raft_consensus.cc:493] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:02.976295  7771 raft_consensus.cc:515] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:02.978725  7771 leader_election.cc:290] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:02.988925  1660 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:02.990095  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:02.993299  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:03.005247  7782 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.006047  7782 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:03.008797  7782 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:03.025316  7784 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.026069  7784 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:03.028528  7784 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:03.033726  2230 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.055476  2230 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.038021  7771 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.057415  7771 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:03.061931  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bb37620691446b2b3ac3e61e48ed81d" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:03:03.062664  2260 raft_consensus.cc:2468] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 18.
I20260709 13:03:03.064345  7771 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
W20260709 13:03:03.036303  1661 consensus_peers.cc:597] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.071667  1661 leader_election.cc:336] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.072604  7748 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:03.076378  1660 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.084517  1661 leader_election.cc:304] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:03:03.080173  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:03.091063  2230 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.092582  7771 raft_consensus.cc:2749] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:03.099815  1660 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.104082  2230 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.115139  7782 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:03.122169  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.135713  1661 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.138706  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.142210  7771 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:03.143496  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.146188  1661 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.148562  1661 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.151229  7771 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:03.176874  7784 raft_consensus.cc:493] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.177459  7784 raft_consensus.cc:515] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:03.179672  7784 leader_election.cc:290] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:03.191183  1660 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:03.199792  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800241a40 after lost signal to thread 434
W20260709 13:03:03.201002  1717 debug-util.cc:398] Leaking SignalData structure 0x7b08003832e0 after lost signal to thread 1479
W20260709 13:03:03.202322  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800087b80 after lost signal to thread 1720
W20260709 13:03:03.203549  1717 debug-util.cc:398] Leaking SignalData structure 0x7b0800107b00 after lost signal to thread 2290
I20260709 13:03:03.205044  7771 raft_consensus.cc:493] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.205649  7771 raft_consensus.cc:515] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:03.207957  7771 leader_election.cc:290] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:03.214987  1660 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:03.220952   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1643)
W20260709 13:03:03.223557  1661 leader_election.cc:336] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.224211  1661 leader_election.cc:304] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.225071  7771 raft_consensus.cc:2749] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:03.226164  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.253242  1661 leader_election.cc:336] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.253859  1661 leader_election.cc:304] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.254976  7771 raft_consensus.cc:2749] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:03.287691  1660 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.384660  2231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45637, user_credentials={real_user=slave}} blocked reactor thread for 54029.5us
W20260709 13:03:03.400838  2230 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:03.405100  7784 raft_consensus.cc:493] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.405776  7784 raft_consensus.cc:515] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:03.413569  1660 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.414445  7784 leader_election.cc:290] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:03.422858  1661 leader_election.cc:336] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.423568  1661 leader_election.cc:304] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.424960  7784 raft_consensus.cc:2749] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:03.495255  1661 consensus_peers.cc:597] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:03.496582  2230 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.519008  1660 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.520864  1661 consensus_peers.cc:597] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.533717  1661 consensus_peers.cc:597] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.536960  2230 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.549417  2230 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.527535  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:03:03.561851  7777 raft_consensus.cc:493] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.565542  7777 raft_consensus.cc:515] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:03.567996  7777 leader_election.cc:290] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:03.579176  7777 raft_consensus.cc:493] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.579851  7777 raft_consensus.cc:515] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:03.582144  7777 leader_election.cc:290] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:03.590435  1660 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:03.591153  1660 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.601611  7748 raft_consensus.cc:493] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.602272  7748 raft_consensus.cc:515] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:03.605763  7748 leader_election.cc:290] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:03:03.619450  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20bfd12bbb914d07873fde52411d5fc6" candidate_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2080b3bca2e64a1a953c17b506b668d2" is_pre_election: true
I20260709 13:03:03.620182  1695 raft_consensus.cc:2468] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51b0b5dc04b4f5aaf6a3a870f291345 in term 14.
W20260709 13:03:03.626645  2230 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:03.629593  1661 leader_election.cc:336] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.641228  1661 leader_election.cc:304] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.642748  7777 raft_consensus.cc:2749] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:03.655280  1661 leader_election.cc:336] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:03.656100  2231 leader_election.cc:336] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.665514  2231 leader_election.cc:304] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2, e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.664899  1661 leader_election.cc:304] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.668597  7777 raft_consensus.cc:2749] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:03.671840  7748 raft_consensus.cc:2749] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:03.681654  2230 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.712169  2230 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:03.723232  7771 raft_consensus.cc:493] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:03.723934  7771 raft_consensus.cc:515] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:03.755093  1661 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:03.758484  7771 leader_election.cc:290] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), e51b0b5dc04b4f5aaf6a3a870f291345 (127.0.107.196:32925)
I20260709 13:03:03.762158  2260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "544a0a0b5c034de2956e73d089c51085" candidate_uuid: "2080b3bca2e64a1a953c17b506b668d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" is_pre_election: true
I20260709 13:03:03.766871  2260 raft_consensus.cc:2468] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2080b3bca2e64a1a953c17b506b668d2 in term 15.
W20260709 13:03:03.768784  1660 leader_election.cc:336] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:03.772380  1660 leader_election.cc:304] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:03.774657  7771 raft_consensus.cc:2749] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:03.771450  2230 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.779562  1660 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.819984  1661 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.824007  1661 consensus_peers.cc:597] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:03.826388  2230 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.842061  1660 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.874490  2230 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.894652  1660 consensus_peers.cc:597] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:03.928665  2230 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.972986  2230 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.977936  2230 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:03.981462  2230 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:03:04.098948  7777 raft_consensus.cc:493] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:04.100454  7777 raft_consensus.cc:515] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:04.119303  7777 leader_election.cc:290] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:04.142553  1661 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:04.143076  2230 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:04.146227  1660 leader_election.cc:336] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:04.146826  1660 leader_election.cc:304] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:04.148502  7784 raft_consensus.cc:2749] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:04.156610  1660 consensus_peers.cc:597] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.177403  1660 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.209025  1660 consensus_peers.cc:597] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.212702  2230 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.232146  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:04.233171  2230 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.299866  1661 consensus_peers.cc:597] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:04.307860  2230 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.316021  1661 consensus_peers.cc:597] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:04.320395  1660 consensus_peers.cc:597] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:04.391584  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:04.563686  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:04.565539  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:04.595599  7784 raft_consensus.cc:493] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:04.596355  7784 raft_consensus.cc:515] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:04.615847  7784 leader_election.cc:290] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:04.665462  1661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34175, user_credentials={real_user=slave}} blocked reactor thread for 71193.4us
I20260709 13:03:04.678196  7791 raft_consensus.cc:493] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:04.683423  7791 raft_consensus.cc:515] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:04.693975  7791 leader_election.cc:290] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:04.767848  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:04.773844  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:04.787113  7789 raft_consensus.cc:493] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:04.788010  7789 raft_consensus.cc:515] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:04.801309  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:04.808995  1660 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:04.809592  1660 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:04.819569  7784 raft_consensus.cc:493] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:04.819795  7789 leader_election.cc:290] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:04.831485  1661 leader_election.cc:336] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:04.836545  1661 leader_election.cc:304] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
W20260709 13:03:04.837560  1661 leader_election.cc:336] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:04.838563  1661 leader_election.cc:304] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:04.836290  7784 raft_consensus.cc:515] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:04.841069  7784 leader_election.cc:290] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:04.838057  7789 raft_consensus.cc:2749] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:04.847025  7790 raft_consensus.cc:2749] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:04.855654  1660 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:04.861016  1661 leader_election.cc:336] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:04.861809  1661 leader_election.cc:304] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:04.863137  7784 raft_consensus.cc:2749] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:04.868450  1660 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:04.869544  1661 leader_election.cc:336] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:04.869916   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:03:04.870014  1661 leader_election.cc:304] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:04.872540  7784 raft_consensus.cc:2749] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:04.983640  1661 consensus_peers.cc:597] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:05.060432  2231 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:05.154438  7790 raft_consensus.cc:493] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:05.155184  7790 raft_consensus.cc:515] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
W20260709 13:03:05.167197  1660 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:05.168090  1661 leader_election.cc:336] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:05.168525  1661 leader_election.cc:304] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:05.169364  7784 raft_consensus.cc:2749] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:05.170509  7790 leader_election.cc:290] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:05.173977   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:05.190923  2231 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.206787  2231 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.225144  2231 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:05.290714   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:05.291884   431 tablet_replica.cc:333] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.296401   431 raft_consensus.cc:2243] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:05.297394  2231 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.297683   431 raft_consensus.cc:2272] T f1012ad0f2cf49ff98a60ff466b6246d P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.299280  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.305883   431 tablet_replica.cc:333] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.307077   431 raft_consensus.cc:2243] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.307857   431 raft_consensus.cc:2272] T 95c7b064bb5640149a09ee01f2a4e2f7 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.311062   431 tablet_replica.cc:333] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.312042   431 raft_consensus.cc:2243] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.313437   431 raft_consensus.cc:2272] T f950ec06ccd64933a117a4c6e6114ed3 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.316486   431 tablet_replica.cc:333] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.317464   431 raft_consensus.cc:2243] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.318909   431 raft_consensus.cc:2272] T d91481bc55434187a86af0d9c4f9d149 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.319527  7784 raft_consensus.cc:493] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:05.320182  7784 raft_consensus.cc:515] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } }
I20260709 13:03:05.322484  7784 leader_election.cc:290] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:05.331179  1661 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:05.333797  1660 leader_election.cc:336] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:05.334324  1660 leader_election.cc:304] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2080b3bca2e64a1a953c17b506b668d2; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:05.335958  7791 raft_consensus.cc:2749] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:05.337023  1661 consensus_peers.cc:597] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:05.338961   431 tablet_replica.cc:333] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.340348   431 raft_consensus.cc:2243] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.344864   431 raft_consensus.cc:2272] T 5c6369221c274c789a9f8654d6ee9417 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.363698  1661 consensus_peers.cc:597] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:05.366899   431 tablet_replica.cc:333] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.367900   431 raft_consensus.cc:2243] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.369240   431 raft_consensus.cc:2272] T 10a7d9e12aa94413b57ebc59c8f15757 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.370728  1661 consensus_peers.cc:597] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:05.371325  1661 consensus_peers.cc:597] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:05.372285   431 tablet_replica.cc:333] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.373200   431 raft_consensus.cc:2243] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.374486   431 raft_consensus.cc:2272] T c19c7246dc654e7c82b45abe1250e568 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.378005   431 tablet_replica.cc:333] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.378788   431 raft_consensus.cc:2243] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.379467   431 raft_consensus.cc:2272] T cd5c95713f5c4cfbaf7d6d84b718b4a8 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.382377   431 tablet_replica.cc:333] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.383996   431 raft_consensus.cc:2243] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:05.385316  2231 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.385672   431 raft_consensus.cc:2272] T 20bfd12bbb914d07873fde52411d5fc6 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.388777   431 tablet_replica.cc:333] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.389565   431 raft_consensus.cc:2243] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.391724   431 raft_consensus.cc:2272] T 71f4d9d1d4d740309d74428e0797e9d8 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.394850   431 tablet_replica.cc:333] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.395821   431 raft_consensus.cc:2243] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.397663   431 raft_consensus.cc:2272] T 5be703fc2dd046c1b14909b95d460cd8 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.402169   431 tablet_replica.cc:333] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.403028   431 raft_consensus.cc:2243] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.404357   431 raft_consensus.cc:2272] T 7316b60a2ea04a109142470c7a827717 P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.407582   431 tablet_replica.cc:333] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.408434   431 raft_consensus.cc:2243] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.409825   431 raft_consensus.cc:2272] T f85ee981fb9947eb9c9c17aa40779ecc P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.412907   431 tablet_replica.cc:333] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.413785   431 raft_consensus.cc:2243] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.415699   431 raft_consensus.cc:2272] T 8ba8839a7d2844ab8f6a90a60af5556e P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.420281   431 tablet_replica.cc:333] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.422173   431 raft_consensus.cc:2243] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.423744   431 raft_consensus.cc:2272] T 73951993cbd34d1cbe7ed6fe93812a5f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.425931  1661 consensus_peers.cc:597] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:05.429454   431 tablet_replica.cc:333] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.431649   431 raft_consensus.cc:2243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.433130   431 raft_consensus.cc:2272] T 7c6ce8e6dbe04fc3bb43288095f2de7b P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.440737   431 tablet_replica.cc:333] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.442559   431 raft_consensus.cc:2243] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:05.444545  2231 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.445648   431 raft_consensus.cc:2272] T 7c2bf53312944dfc854b092b66a8dce2 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.451819   431 tablet_replica.cc:333] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.452701   431 raft_consensus.cc:2243] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.453418   431 raft_consensus.cc:2272] T 06184411faf343c9939d453eeec59cae P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.456359   431 tablet_replica.cc:333] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.457219   431 raft_consensus.cc:2243] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.458729   431 raft_consensus.cc:2272] T 544a0a0b5c034de2956e73d089c51085 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.461467   431 tablet_replica.cc:333] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.462951   431 raft_consensus.cc:2243] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.463694   431 raft_consensus.cc:2272] T a0a119b71a994fd1aeb21c6ba31e339b P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.467195   431 tablet_replica.cc:333] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.468062   431 raft_consensus.cc:2243] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.469022   431 raft_consensus.cc:2272] T 0c4f26e727a741fa8ca38a41fff1dc1d P 2080b3bca2e64a1a953c17b506b668d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.472237   431 tablet_replica.cc:333] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.473214   431 raft_consensus.cc:2243] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.474073   431 raft_consensus.cc:2272] T bb5d38534bcc45e19c58dcc3139a4ee6 P 2080b3bca2e64a1a953c17b506b668d2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.477444   431 tablet_replica.cc:333] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.478382   431 raft_consensus.cc:2243] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.479159   431 raft_consensus.cc:2272] T 6548704b45e547b6ab8bc4081d8b3ad7 P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.482542   431 tablet_replica.cc:333] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.483974   431 raft_consensus.cc:2243] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.484746   431 raft_consensus.cc:2272] T ab05924031f84a848a47260864c78193 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.487969   431 tablet_replica.cc:333] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
W20260709 13:03:05.488713  2231 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.488936   431 raft_consensus.cc:2243] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.489914   431 raft_consensus.cc:2272] T 59f1e89f0b484c16a765a9cbf4b2de05 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.492985   431 tablet_replica.cc:333] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.493932   431 raft_consensus.cc:2243] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.495085   431 raft_consensus.cc:2272] T f5fffa415884468d9ae844797cb87109 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.498658   431 tablet_replica.cc:333] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.499518   431 raft_consensus.cc:2243] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.500489   431 raft_consensus.cc:2272] T af2df8228f514af5aee2481a5f153280 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.504110   431 tablet_replica.cc:333] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.505039   431 raft_consensus.cc:2243] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.506384   431 raft_consensus.cc:2272] T 8e6d6de7d5b64994853322d5806d6eb0 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.509788   431 tablet_replica.cc:333] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.510697   431 raft_consensus.cc:2243] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.511564   431 raft_consensus.cc:2272] T e3c2089bb9c240cc97c2b79e1d4c648f P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.515021   431 tablet_replica.cc:333] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.515894   431 raft_consensus.cc:2243] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.516618   431 raft_consensus.cc:2272] T 10cfcf5f778944b099b75d0b1a19afa0 P 2080b3bca2e64a1a953c17b506b668d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.519804   431 tablet_replica.cc:333] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.520758   431 raft_consensus.cc:2243] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.521498   431 raft_consensus.cc:2272] T 459063895bc847b9a15dc71e10b36267 P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.524477   431 tablet_replica.cc:333] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.525581   431 raft_consensus.cc:2243] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.526955   431 raft_consensus.cc:2272] T be3cc12e24cf42b1b289cee33b288dd9 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.529790   431 tablet_replica.cc:333] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.530671   431 raft_consensus.cc:2243] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.531539   431 raft_consensus.cc:2272] T 78df79e3d5044daa8ed98fe19b18d0fe P 2080b3bca2e64a1a953c17b506b668d2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.534480   431 tablet_replica.cc:333] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.535380   431 raft_consensus.cc:2243] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.536304   431 raft_consensus.cc:2272] T aa0c15f4fa7246faa2d54502e99a81ab P 2080b3bca2e64a1a953c17b506b668d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.539386   431 tablet_replica.cc:333] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.540349   431 raft_consensus.cc:2243] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.541682   431 raft_consensus.cc:2272] T 6bb37620691446b2b3ac3e61e48ed81d P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.544603   431 tablet_replica.cc:333] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.545441   431 raft_consensus.cc:2243] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.546804   431 raft_consensus.cc:2272] T ac3f2e6866214e3e89b342a804e31b9f P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.549935   431 tablet_replica.cc:333] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.550881   431 raft_consensus.cc:2243] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.552124   431 raft_consensus.cc:2272] T aa0547666b41440ebc195aa8cd34bc9d P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.555027   431 tablet_replica.cc:333] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.555850   431 raft_consensus.cc:2243] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.556669   431 raft_consensus.cc:2272] T 412cc1b1dcd54096b1fbbc092bcfc7e4 P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.559554   431 tablet_replica.cc:333] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.560377   431 raft_consensus.cc:2243] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.561216   431 raft_consensus.cc:2272] T 9810b426aedc4eb89adfbd103150f39a P 2080b3bca2e64a1a953c17b506b668d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.564216   431 tablet_replica.cc:333] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.565080   431 raft_consensus.cc:2243] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.566726   431 raft_consensus.cc:2272] T 5ad1e195a7c2407789e8c8a409b95740 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.569387   431 tablet_replica.cc:333] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.570202   431 raft_consensus.cc:2243] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.570987   431 raft_consensus.cc:2272] T e9045b82a0ec40a69c0967a8f8188129 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.573875   431 tablet_replica.cc:333] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.574700   431 raft_consensus.cc:2243] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.575353   431 raft_consensus.cc:2272] T 70b9f3b50c6a495fa5b5b06dcfe6c2b2 P 2080b3bca2e64a1a953c17b506b668d2 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.577545  2231 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:05.578087   431 tablet_replica.cc:333] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.579530   431 raft_consensus.cc:2243] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.580871   431 raft_consensus.cc:2272] T dae379e1020a47aea6053cd31adaf4a0 P 2080b3bca2e64a1a953c17b506b668d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.583793   431 tablet_replica.cc:333] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.584545   431 raft_consensus.cc:2243] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.585325   431 raft_consensus.cc:2272] T d5f6768c02504c9cb4195745e3f1970e P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.587991   431 tablet_replica.cc:333] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.588819   431 raft_consensus.cc:2243] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.589560   431 raft_consensus.cc:2272] T 1f43691e2c5a4cc2b9d09a0ebda430e5 P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.592691   431 tablet_replica.cc:333] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.593487   431 raft_consensus.cc:2243] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.595533   431 raft_consensus.cc:2272] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P 2080b3bca2e64a1a953c17b506b668d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.598503   431 tablet_replica.cc:333] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.599334   431 raft_consensus.cc:2243] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.600243   431 raft_consensus.cc:2272] T 51ca4c13fdd142269405c90e6382797c P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.603406   431 tablet_replica.cc:333] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2: stopping tablet replica
I20260709 13:03:05.604199   431 raft_consensus.cc:2243] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:05.605603   431 raft_consensus.cc:2272] T 4ad53e26a3894902b237f56d0f92b47e P 2080b3bca2e64a1a953c17b506b668d2 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:05.629269  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.636669  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800175460 after lost signal to thread 434
W20260709 13:03:05.637907  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08003ccdc0 after lost signal to thread 1479
W20260709 13:03:05.639293  1476 debug-util.cc:398] Leaking SignalData structure 0x7b0800309280 after lost signal to thread 1720
W20260709 13:03:05.640627  1476 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0d80 after lost signal to thread 2290
W20260709 13:03:05.660233  2231 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.685951  2231 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Couldn't send request to peer 2080b3bca2e64a1a953c17b506b668d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:05.687126  2230 consensus_peers.cc:597] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:05.690318  2230 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:05.897369  2230 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:05.984104  2231 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:06.028637  7794 raft_consensus.cc:493] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:06.029331  7794 raft_consensus.cc:515] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:06.040956  2230 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.041766  2231 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.042148  2231 leader_election.cc:304] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.043051  7795 raft_consensus.cc:2749] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:06.044477  7794 leader_election.cc:290] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.049347  2231 leader_election.cc:336] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.068488  7794 raft_consensus.cc:493] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:06.069150  7794 raft_consensus.cc:515] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.071455  7794 leader_election.cc:290] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:06.082341  2230 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.083256  2231 leader_election.cc:336] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.083678  2231 leader_election.cc:304] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.084414  7795 raft_consensus.cc:493] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:06.084982  7795 raft_consensus.cc:515] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.087163  7795 leader_election.cc:290] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
I20260709 13:03:06.087643  7795 raft_consensus.cc:2749] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:03:06.098912  2230 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.101683  2231 leader_election.cc:336] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.104151  2231 leader_election.cc:304] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.105333  7794 raft_consensus.cc:2749] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:06.117949  2230 consensus_peers.cc:597] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.118664  2230 consensus_peers.cc:597] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.218196  2230 consensus_peers.cc:597] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.262342  2230 consensus_peers.cc:597] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.282207  7782 raft_consensus.cc:493] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c5f349bdadfc40b9bff8e1682b5c271b)
I20260709 13:03:06.282801  7782 raft_consensus.cc:515] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:06.291246  2230 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:06.301440  7782 leader_election.cc:290] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685)
W20260709 13:03:06.307376  2231 leader_election.cc:336] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.308531  2231 leader_election.cc:304] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.310721  7782 raft_consensus.cc:2749] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:06.416932  7782 raft_consensus.cc:493] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.417448  7782 raft_consensus.cc:515] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.419559  7782 leader_election.cc:290] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.428696  2231 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:06.434054  2231 leader_election.cc:336] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.434532  2231 leader_election.cc:304] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.435679  7782 raft_consensus.cc:2749] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.478499  7782 raft_consensus.cc:493] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.479043  7782 raft_consensus.cc:515] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.481140  7782 leader_election.cc:290] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.481832  2230 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.497368  2231 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:06.502009  2231 leader_election.cc:336] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.504014  2231 leader_election.cc:304] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.505661  7782 raft_consensus.cc:2749] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:06.504583  2230 consensus_peers.cc:597] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.517303  2230 consensus_peers.cc:597] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.554641  7782 raft_consensus.cc:493] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.555194  7782 raft_consensus.cc:515] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.557189  7782 leader_election.cc:290] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.571144  2231 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
W20260709 13:03:06.572124  2231 leader_election.cc:336] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.572570  2231 leader_election.cc:304] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.574087  7782 raft_consensus.cc:2749] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:06.581483  7782 raft_consensus.cc:493] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.582144  7782 raft_consensus.cc:515] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.584589  7782 leader_election.cc:290] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.618137  2230 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.619463  2231 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:06.620203  2231 leader_election.cc:336] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.620611  2231 leader_election.cc:304] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.621312  7782 raft_consensus.cc:2749] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:06.633652  7782 raft_consensus.cc:493] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.634181  7782 raft_consensus.cc:515] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.636251  7782 leader_election.cc:290] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.637814  2230 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.642057  7782 raft_consensus.cc:493] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.643666  7782 raft_consensus.cc:515] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:06.650118  2231 leader_election.cc:336] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.652129  7782 leader_election.cc:290] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.657378  2230 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.659369  2231 leader_election.cc:336] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.665190  2231 leader_election.cc:304] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.667353  7782 raft_consensus.cc:2749] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:03:06.684947  2231 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.685596  2231 leader_election.cc:304] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.686340  7782 raft_consensus.cc:2749] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:03:06.687311  2231 leader_election.cc:336] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
W20260709 13:03:06.702256  2231 consensus_peers.cc:597] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:06.703353  7782 raft_consensus.cc:493] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.703908  7782 raft_consensus.cc:515] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:06.715863  2230 consensus_peers.cc:597] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.717108  7782 leader_election.cc:290] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.726783  2230 consensus_peers.cc:597] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.732158  7782 raft_consensus.cc:493] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.733259  7782 raft_consensus.cc:515] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.737066  7782 leader_election.cc:290] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.737589  2230 consensus_peers.cc:597] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:03:06.743646  7782 raft_consensus.cc:493] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.744295  7782 raft_consensus.cc:515] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.746399  7782 leader_election.cc:290] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.752631  2230 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:06.767200  7795 raft_consensus.cc:493] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.767809  7795 raft_consensus.cc:515] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
W20260709 13:03:06.769132  2231 leader_election.cc:336] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:06.771294  2231 leader_election.cc:336] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.769935  7795 leader_election.cc:290] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:03:06.773073  2231 leader_election.cc:304] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.773801  7795 raft_consensus.cc:2749] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:06.779966  2231 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
W20260709 13:03:06.781872  2231 leader_election.cc:336] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.782343  2231 leader_election.cc:304] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.783108  7795 raft_consensus.cc:2749] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:03:06.784905  2231 leader_election.cc:336] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.795051  2231 leader_election.cc:304] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.796746  7795 raft_consensus.cc:2749] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:06.799010  2231 consensus_peers.cc:597] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:06.808771  2231 leader_election.cc:336] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
W20260709 13:03:06.821310  2231 leader_election.cc:336] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.822441  2231 leader_election.cc:304] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.824280  7795 raft_consensus.cc:2749] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.864975  7795 raft_consensus.cc:493] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.865551  7795 raft_consensus.cc:515] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.867609  7795 leader_election.cc:290] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
I20260709 13:03:06.869333  7782 raft_consensus.cc:493] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.869813  7782 raft_consensus.cc:515] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.871830  7782 leader_election.cc:290] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.877285  2230 leader_election.cc:336] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.887483  2231 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
W20260709 13:03:06.888185  2231 leader_election.cc:336] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.890784  2231 leader_election.cc:304] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.893424  7782 raft_consensus.cc:2749] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:06.894805  2231 leader_election.cc:336] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.895272  2231 leader_election.cc:304] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, 9fbc4df0bb934bba941cfa20c0afead2
I20260709 13:03:06.895983  7782 raft_consensus.cc:2749] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:06.902638  7782 raft_consensus.cc:493] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.903195  7782 raft_consensus.cc:515] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } attrs { replace: true } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.909694  7782 leader_election.cc:290] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175), c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.913043  2230 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
W20260709 13:03:06.915756  2230 consensus_peers.cc:597] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:06.927865  2230 consensus_peers.cc:597] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Couldn't send request to peer c5f349bdadfc40b9bff8e1682b5c271b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:06.930400  2231 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:06.931526  2231 leader_election.cc:304] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 9fbc4df0bb934bba941cfa20c0afead2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.944571  7782 raft_consensus.cc:2749] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:06.945576  2231 consensus_peers.cc:597] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:06.946204  2231 leader_election.cc:336] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
I20260709 13:03:06.973591  7782 raft_consensus.cc:493] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2080b3bca2e64a1a953c17b506b668d2)
I20260709 13:03:06.974097  7782 raft_consensus.cc:515] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: false } }
I20260709 13:03:06.976020  7782 leader_election.cc:290] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685), 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637)
W20260709 13:03:06.984042  2231 leader_election.cc:336] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2080b3bca2e64a1a953c17b506b668d2 (127.0.107.195:45637): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45637: connect: Connection refused (error 111)
W20260709 13:03:06.984869  2230 leader_election.cc:336] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5f349bdadfc40b9bff8e1682b5c271b (127.0.107.194:39685): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39685: connect: Connection refused (error 111)
I20260709 13:03:06.985276  2230 leader_election.cc:304] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51b0b5dc04b4f5aaf6a3a870f291345; no voters: 2080b3bca2e64a1a953c17b506b668d2, c5f349bdadfc40b9bff8e1682b5c271b
I20260709 13:03:06.986627  7782 raft_consensus.cc:2749] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:03:07.111879  2231 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111) [suppressed 564 similar messages]
W20260709 13:03:07.114671  2231 consensus_peers.cc:597] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:07.152415   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:07.180891  2231 consensus_peers.cc:597] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:07.186021  2231 consensus_peers.cc:597] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:07.341903   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:03:07.379771  2231 consensus_peers.cc:597] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 -> Peer 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): Couldn't send request to peer 9fbc4df0bb934bba941cfa20c0afead2. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:07.440547   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:07.441502   431 tablet_replica.cc:333] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.442402   431 raft_consensus.cc:2243] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.443204   431 raft_consensus.cc:2272] T 827a7a4d1cab4d8f8d8da6c119f4cce1 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.446458   431 tablet_replica.cc:333] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.447572   431 raft_consensus.cc:2243] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.448364   431 raft_consensus.cc:2272] T 71f4d9d1d4d740309d74428e0797e9d8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.452157   431 tablet_replica.cc:333] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.452932   431 raft_consensus.cc:2243] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.454382   431 raft_consensus.cc:2272] T 5c6369221c274c789a9f8654d6ee9417 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.457872   431 tablet_replica.cc:333] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.458659   431 raft_consensus.cc:2243] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Raft consensus shutting down.
I20260709 13:03:07.459120   431 pending_rounds.cc:70] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Trying to abort 1 pending ops.
I20260709 13:03:07.459379   431 pending_rounds.cc:77] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305633904344928256 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "459063895bc847b9a15dc71e10b36267" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "9fbc4df0bb934bba941cfa20c0afead2" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34175 } } peers { permanent_uuid: "c5f349bdadfc40b9bff8e1682b5c271b" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39685 } } peers { permanent_uuid: "2080b3bca2e64a1a953c17b506b668d2" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45637 } attrs { replace: true } } peers { permanent_uuid: "e51b0b5dc04b4f5aaf6a3a870f291345" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 32925 } attrs { promote: true } } } }
I20260709 13:03:07.460498   431 raft_consensus.cc:2917] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:03:07.460898   431 raft_consensus.cc:2889] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:07.461191   431 raft_consensus.cc:2272] T 459063895bc847b9a15dc71e10b36267 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:03:07.463963   431 tablet_replica.cc:333] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.464727   431 raft_consensus.cc:2243] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.481812   431 raft_consensus.cc:2272] T 01e623ba813c4c3a8152a1de588cda91 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.485090   431 tablet_replica.cc:333] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.491564   431 raft_consensus.cc:2243] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.492681   431 raft_consensus.cc:2272] T 6548704b45e547b6ab8bc4081d8b3ad7 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.495801   431 tablet_replica.cc:333] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.496745   431 raft_consensus.cc:2243] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.497641   431 raft_consensus.cc:2272] T 6bb37620691446b2b3ac3e61e48ed81d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.500993   431 tablet_replica.cc:333] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.501777   431 raft_consensus.cc:2243] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.502408   431 raft_consensus.cc:2272] T f85ee981fb9947eb9c9c17aa40779ecc P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.505366   431 tablet_replica.cc:333] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.506310   431 raft_consensus.cc:2243] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.507409   431 raft_consensus.cc:2272] T 78df79e3d5044daa8ed98fe19b18d0fe P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.510329   431 tablet_replica.cc:333] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.511140   431 raft_consensus.cc:2243] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.512249   431 raft_consensus.cc:2272] T a0a119b71a994fd1aeb21c6ba31e339b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.514972   431 tablet_replica.cc:333] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.515718   431 raft_consensus.cc:2243] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.516808   431 raft_consensus.cc:2272] T ab05924031f84a848a47260864c78193 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.519605   431 tablet_replica.cc:333] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.520428   431 raft_consensus.cc:2243] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.521445   431 raft_consensus.cc:2272] T e3c2089bb9c240cc97c2b79e1d4c648f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.535820   431 tablet_replica.cc:333] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.536661   431 raft_consensus.cc:2243] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.537380   431 raft_consensus.cc:2272] T 7316b60a2ea04a109142470c7a827717 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.540553   431 tablet_replica.cc:333] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.547320   431 raft_consensus.cc:2243] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.548082   431 raft_consensus.cc:2272] T 10a7d9e12aa94413b57ebc59c8f15757 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.551196   431 tablet_replica.cc:333] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.551956   431 raft_consensus.cc:2243] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.553025   431 raft_consensus.cc:2272] T bb5d38534bcc45e19c58dcc3139a4ee6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.555853   431 tablet_replica.cc:333] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.556715   431 raft_consensus.cc:2243] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.557804   431 raft_consensus.cc:2272] T ad9c8a969843427fb32b4afb149874ba P e51b0b5dc04b4f5aaf6a3a870f291345 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.560510   431 tablet_replica.cc:333] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.561266   431 raft_consensus.cc:2243] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.562646   431 raft_consensus.cc:2272] T ca134e523abd4f159806116930d9aece P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.565445   431 tablet_replica.cc:333] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.566252   431 raft_consensus.cc:2243] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.566862   431 raft_consensus.cc:2272] T d91481bc55434187a86af0d9c4f9d149 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.569736   431 tablet_replica.cc:333] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.570523   431 raft_consensus.cc:2243] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.571136   431 raft_consensus.cc:2272] T 8e6d6de7d5b64994853322d5806d6eb0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.573863   431 tablet_replica.cc:333] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.574709   431 raft_consensus.cc:2243] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.575343   431 raft_consensus.cc:2272] T 4ad53e26a3894902b237f56d0f92b47e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.577953   431 tablet_replica.cc:333] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.578770   431 raft_consensus.cc:2243] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.579365   431 raft_consensus.cc:2272] T 5be703fc2dd046c1b14909b95d460cd8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.582145   431 tablet_replica.cc:333] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.582980   431 raft_consensus.cc:2243] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.583768   431 raft_consensus.cc:2272] T 544a0a0b5c034de2956e73d089c51085 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.587196   431 tablet_replica.cc:333] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.588027   431 raft_consensus.cc:2243] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.588811   431 raft_consensus.cc:2272] T c19c7246dc654e7c82b45abe1250e568 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.592934   431 tablet_replica.cc:333] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.593746   431 raft_consensus.cc:2243] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.595431   431 raft_consensus.cc:2272] T 7c6ce8e6dbe04fc3bb43288095f2de7b P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.598312   431 tablet_replica.cc:333] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.599143   431 raft_consensus.cc:2243] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.599776   431 raft_consensus.cc:2272] T f5fffa415884468d9ae844797cb87109 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.602421   431 tablet_replica.cc:333] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.603189   431 raft_consensus.cc:2243] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.604240   431 raft_consensus.cc:2272] T 854dc9ecb21b45069ab7661dc5c021c9 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.607841   431 tablet_replica.cc:333] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.608636   431 raft_consensus.cc:2243] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.609907   431 raft_consensus.cc:2272] T e4bd73d471194556a9ba093049d04790 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.612820   431 tablet_replica.cc:333] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.613562   431 raft_consensus.cc:2243] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.614125   431 raft_consensus.cc:2272] T dae379e1020a47aea6053cd31adaf4a0 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.616824   431 tablet_replica.cc:333] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.617671   431 raft_consensus.cc:2243] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.618455   431 raft_consensus.cc:2272] T 1b77a1e7d2d64ba8b40eabf9b87292f3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.621060   431 tablet_replica.cc:333] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.621874   431 raft_consensus.cc:2243] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.622759   431 raft_consensus.cc:2272] T 20bfd12bbb914d07873fde52411d5fc6 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.625604   431 tablet_replica.cc:333] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.626379   431 raft_consensus.cc:2243] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.627516   431 raft_consensus.cc:2272] T 7c2bf53312944dfc854b092b66a8dce2 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.630311   431 tablet_replica.cc:333] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.631074   431 raft_consensus.cc:2243] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.631650   431 raft_consensus.cc:2272] T f950ec06ccd64933a117a4c6e6114ed3 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.634436   431 tablet_replica.cc:333] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.635190   431 raft_consensus.cc:2243] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.635870   431 raft_consensus.cc:2272] T 831605a002324a04838f4fe562b13530 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.638422   431 tablet_replica.cc:333] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.639145   431 raft_consensus.cc:2243] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.640187   431 raft_consensus.cc:2272] T 73951993cbd34d1cbe7ed6fe93812a5f P e51b0b5dc04b4f5aaf6a3a870f291345 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.642863   431 tablet_replica.cc:333] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.643594   431 raft_consensus.cc:2243] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.644744   431 raft_consensus.cc:2272] T 4a0c52190de849839b129a0fa6099693 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.647150   431 tablet_replica.cc:333] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.647846   431 raft_consensus.cc:2243] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.648447   431 raft_consensus.cc:2272] T 0ff8d8fdfe5b4dd999061f7d92c12c5d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.651183   431 tablet_replica.cc:333] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.651858   431 raft_consensus.cc:2243] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.652956   431 raft_consensus.cc:2272] T 29466a5fdaaa4059bb44d95ca1ec63b8 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.655869   431 tablet_replica.cc:333] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.656574   431 raft_consensus.cc:2243] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.657682   431 raft_consensus.cc:2272] T 1f9a39f263da4577833a605ef819b007 P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.660153   431 tablet_replica.cc:333] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.660779   431 raft_consensus.cc:2243] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:07.661382   431 raft_consensus.cc:2272] T aa0547666b41440ebc195aa8cd34bc9d P e51b0b5dc04b4f5aaf6a3a870f291345 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:07.663769   431 tablet_replica.cc:333] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345: stopping tablet replica
I20260709 13:03:07.664407   431 raft_consensus.cc:2243] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:07.665503   431 raft_consensus.cc:2272] T d5f6768c02504c9cb4195745e3f1970e P e51b0b5dc04b4f5aaf6a3a870f291345 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:08.419147   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:08.487648   431 master.cc:562] Master@127.0.107.254:35005 shutting down...
W20260709 13:03:08.528672  1493 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:03:08.528965  1493 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:08.529215  1493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:03:18.856161  1431 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111) [suppressed 36 similar messages]
W20260709 13:03:18.859855  1431 catalog_manager.cc:4755] TS 9fbc4df0bb934bba941cfa20c0afead2 (127.0.107.193:34175): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5c6369221c274c789a9f8654d6ee9417: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34175: connect: Connection refused (error 111)
I20260709 13:03:19.442374   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:19.443544   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.443966   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6082291f52654c5a8f0456b9ee951915: stopping tablet replica
I20260709 13:03:19.651038   431 master.cc:584] Master@127.0.107.254:35005 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (220695 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:03:19.770388   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37283
I20260709 13:03:19.771575   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.777679  7801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.778096  7803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.778365  7800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.779524   431 server_base.cc:1061] running on GCE node
I20260709 13:03:19.782402   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.782581   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.782804   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199782787 us; error 0 us; skew 500 ppm
I20260709 13:03:19.783422   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:19.785858   431 webserver.cc:533] Webserver started at http://127.0.107.254:42915/ using document root <none> and password file <none>
I20260709 13:03:19.786296   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:19.786464   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:19.786764   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:19.788009   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "f1ea50d70e5c40de9bfc737438605bf0"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-n5kz"
I20260709 13:03:19.792557   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:03:19.795950  7808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:19.796729   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:03:19.797034   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "f1ea50d70e5c40de9bfc737438605bf0"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-n5kz"
I20260709 13:03:19.797348   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:19.816269   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:19.817618   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:19.856902   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37283
I20260709 13:03:19.857000  7859 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37283 every 8 connection(s)
I20260709 13:03:19.861055  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.872777  7860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0: Bootstrap starting.
I20260709 13:03:19.877857  7860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.882083  7860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0: No bootstrap required, opened a new log
I20260709 13:03:19.884419  7860 raft_consensus.cc:359] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER }
I20260709 13:03:19.884865  7860 raft_consensus.cc:385] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.885151  7860 raft_consensus.cc:740] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1ea50d70e5c40de9bfc737438605bf0, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.885746  7860 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER }
I20260709 13:03:19.886224  7860 raft_consensus.cc:399] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:19.886471  7860 raft_consensus.cc:493] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:19.886791  7860 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.891607  7860 raft_consensus.cc:515] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER }
I20260709 13:03:19.892316  7860 leader_election.cc:304] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1ea50d70e5c40de9bfc737438605bf0; no voters: 
I20260709 13:03:19.893625  7860 leader_election.cc:290] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:19.894009  7863 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.895453  7863 raft_consensus.cc:697] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 1 LEADER]: Becoming Leader. State: Replica: f1ea50d70e5c40de9bfc737438605bf0, State: Running, Role: LEADER
I20260709 13:03:19.896106  7863 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER }
I20260709 13:03:19.896657  7860 sys_catalog.cc:565] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:19.904278  7864 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1ea50d70e5c40de9bfc737438605bf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER } }
I20260709 13:03:19.904840  7864 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:19.904595  7865 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1ea50d70e5c40de9bfc737438605bf0. Latest consensus state: current_term: 1 leader_uuid: "f1ea50d70e5c40de9bfc737438605bf0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1ea50d70e5c40de9bfc737438605bf0" member_type: VOTER } }
I20260709 13:03:19.905429  7865 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:19.907433  7872 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:19.916036  7872 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:19.917183   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:19.925680  7872 catalog_manager.cc:1383] Generated new cluster ID: 84dce10a6dd5493f9f871f121f9fbab8
I20260709 13:03:19.925989  7872 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:19.941920  7872 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:19.943321  7872 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:19.957231  7872 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0: Generated new TSK 0
I20260709 13:03:19.957856  7872 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:19.983906   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:19.990815  7881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.992405  7882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:19.994087  7884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:19.995575   431 server_base.cc:1061] running on GCE node
I20260709 13:03:19.997390   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:19.997583   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:19.997771   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602199997755 us; error 0 us; skew 500 ppm
I20260709 13:03:19.998445   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:20.000900   431 webserver.cc:533] Webserver started at http://127.0.107.193:38429/ using document root <none> and password file <none>
I20260709 13:03:20.001346   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:20.001504   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:20.001808   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:20.003213   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "2bb658b087424b87887d5bfef62d8084"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-n5kz"
I20260709 13:03:20.007879   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:03:20.011598  7889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.012475   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:03:20.012811   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "2bb658b087424b87887d5bfef62d8084"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-n5kz"
I20260709 13:03:20.013106   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:20.026417   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:20.027849   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:20.029476   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:20.032053   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:20.032289   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.032601   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:20.032793   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.077479   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38449
I20260709 13:03:20.077575  7951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38449 every 8 connection(s)
I20260709 13:03:20.082868   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:20.091411  7956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.092846  7957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.096185  7959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:20.097385   431 server_base.cc:1061] running on GCE node
I20260709 13:03:20.099709   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:20.099959   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:20.100133   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602200100113 us; error 0 us; skew 500 ppm
I20260709 13:03:20.100692   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:20.103163   431 webserver.cc:533] Webserver started at http://127.0.107.194:42979/ using document root <none> and password file <none>
I20260709 13:03:20.103648   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:20.103858   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:20.104113   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:20.105294   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.110337   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:03:20.112716  7952 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37283
I20260709 13:03:20.113135  7952 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.113885  7952 heartbeater.cc:507] Master 127.0.107.254:37283 requested a full tablet report, sending...
I20260709 13:03:20.115624  7964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.116231  7825 ts_manager.cc:194] Registered new tserver with Master: 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:20.116719   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:20.117095   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.117398   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:20.118319  7825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44196
I20260709 13:03:20.158576   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:20.160669   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:20.162245   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:20.164609   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:20.164832   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.165102   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:20.165274   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.209197   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43691
I20260709 13:03:20.209295  8026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43691 every 8 connection(s)
I20260709 13:03:20.214274   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:20.222416  8030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.224313  8031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.225382  8033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:20.225613   431 server_base.cc:1061] running on GCE node
I20260709 13:03:20.227650  8027 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37283
I20260709 13:03:20.227653   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:20.228292   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:20.228355  8027 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.228513   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602200228497 us; error 0 us; skew 500 ppm
I20260709 13:03:20.229305   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:20.229419  8027 heartbeater.cc:507] Master 127.0.107.254:37283 requested a full tablet report, sending...
I20260709 13:03:20.231923  7825 ts_manager.cc:194] Registered new tserver with Master: d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:20.232121   431 webserver.cc:533] Webserver started at http://127.0.107.195:42477/ using document root <none> and password file <none>
I20260709 13:03:20.232765   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:20.232980   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:20.233260   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:20.233688  7825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44206
I20260709 13:03:20.234519   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "8e7be6d583414e048a2528f06bc9bb4f"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.239799   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:20.243285  8038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.244160   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:03:20.244505   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "8e7be6d583414e048a2528f06bc9bb4f"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.244807   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:20.259085   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:20.260332   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:20.261799   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:20.264055   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:20.264288   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.264546   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:20.264719   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.305774   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45223
I20260709 13:03:20.305869  8100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45223 every 8 connection(s)
I20260709 13:03:20.310880   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:20.318444  8104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.319743  8105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.322554  8107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:20.324003   431 server_base.cc:1061] running on GCE node
I20260709 13:03:20.324205  8101 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37283
I20260709 13:03:20.324733  8101 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.325062   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:20.325316   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:20.325522   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602200325503 us; error 0 us; skew 500 ppm
I20260709 13:03:20.325644  8101 heartbeater.cc:507] Master 127.0.107.254:37283 requested a full tablet report, sending...
I20260709 13:03:20.326165   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:20.328027  7825 ts_manager.cc:194] Registered new tserver with Master: 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:20.329370  7825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44218
I20260709 13:03:20.330519   431 webserver.cc:533] Webserver started at http://127.0.107.196:43097/ using document root <none> and password file <none>
I20260709 13:03:20.331148   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:20.331386   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:20.331663   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:20.332887   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-3-root/instance:
uuid: "ae54318e37b24e6085239e7e480d5d66"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.337380   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:03:20.340847  8112 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.341609   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:20.341921   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-3-root
uuid: "ae54318e37b24e6085239e7e480d5d66"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-n5kz"
I20260709 13:03:20.342216   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:20.359109   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:20.360340   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:20.361785   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:20.364120   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:20.364344   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.364588   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:20.364763   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.407058   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:39687
I20260709 13:03:20.407140  8174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:39687 every 8 connection(s)
I20260709 13:03:20.421386  8175 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37283
I20260709 13:03:20.421844  8175 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.422787  8175 heartbeater.cc:507] Master 127.0.107.254:37283 requested a full tablet report, sending...
I20260709 13:03:20.426719  7825 ts_manager.cc:194] Registered new tserver with Master: ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:20.427443   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017079644s
I20260709 13:03:20.428159  7825 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44232
I20260709 13:03:20.454391  7825 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44238:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:03:20.714079  8066 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd0103deb344096a33481aeda5d1d70 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:20.715684  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd0103deb344096a33481aeda5d1d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.718024  7992 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd0103deb344096a33481aeda5d1d70 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:20.719619  7992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd0103deb344096a33481aeda5d1d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.719455  7987 tablet_service.cc:1511] Processing CreateTablet for tablet ec19762f6a5e40eea7215e9981f34f9f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:20.720876  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec19762f6a5e40eea7215e9981f34f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.722033  7991 tablet_service.cc:1511] Processing CreateTablet for tablet c5d6403dabb047e1a41b15afba4737d8 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:20.724095  7990 tablet_service.cc:1511] Processing CreateTablet for tablet c65f361d07e44b12ae649ea71e589a3e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:20.725605  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65f361d07e44b12ae649ea71e589a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.725303  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 377aa62f193a4388a82ea786f25ba033 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:20.726686  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377aa62f193a4388a82ea786f25ba033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.728963  8065 tablet_service.cc:1511] Processing CreateTablet for tablet 0d38630e1dc34ceb9665dd2a25e61ddb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:20.729465  8064 tablet_service.cc:1511] Processing CreateTablet for tablet c65f361d07e44b12ae649ea71e589a3e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:20.724097  7988 tablet_service.cc:1511] Processing CreateTablet for tablet a88bacd650e3448a85930d7b4d92ee0d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:20.730389  8065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d38630e1dc34ceb9665dd2a25e61ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.731254  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65f361d07e44b12ae649ea71e589a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.731276  7991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d6403dabb047e1a41b15afba4737d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.734459  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88bacd650e3448a85930d7b4d92ee0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.736297  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 377aa62f193a4388a82ea786f25ba033 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:20.736136  7986 tablet_service.cc:1511] Processing CreateTablet for tablet 0da0d5e0a15447eb99c08ec304ba960f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:20.737692  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377aa62f193a4388a82ea786f25ba033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.737692  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da0d5e0a15447eb99c08ec304ba960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.745637  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 507f378c61374021afd81f65ffe484b2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:20.747273  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f378c61374021afd81f65ffe484b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.761339  7985 tablet_service.cc:1511] Processing CreateTablet for tablet 1879a702e0ba41b7b0d96b56a99217de (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:20.762955  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1879a702e0ba41b7b0d96b56a99217de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.777524  7984 tablet_service.cc:1511] Processing CreateTablet for tablet baaa499575414a72af0bd4560d1504c2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:20.780719  7984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baaa499575414a72af0bd4560d1504c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.792411  8061 tablet_service.cc:1511] Processing CreateTablet for tablet ec19762f6a5e40eea7215e9981f34f9f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:20.793982  8061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec19762f6a5e40eea7215e9981f34f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.793804  7990 tablet_service.cc:1511] Processing CreateTablet for tablet a34bc926b47b4f1d886de1ccee78479a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:20.795866  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 0da0d5e0a15447eb99c08ec304ba960f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:20.797338  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da0d5e0a15447eb99c08ec304ba960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.797092  8063 tablet_service.cc:1511] Processing CreateTablet for tablet baaa499575414a72af0bd4560d1504c2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:20.802876  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 0d38630e1dc34ceb9665dd2a25e61ddb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:20.802977  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 0da0d5e0a15447eb99c08ec304ba960f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:20.803433  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34bc926b47b4f1d886de1ccee78479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.804522  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d38630e1dc34ceb9665dd2a25e61ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.804792  7916 tablet_service.cc:1511] Processing CreateTablet for tablet c5d6403dabb047e1a41b15afba4737d8 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:20.805491  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 4988500e3bc44817a1bd87f1c4979cca (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:20.806870  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 377aa62f193a4388a82ea786f25ba033 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:20.807301  7913 tablet_service.cc:1511] Processing CreateTablet for tablet a88bacd650e3448a85930d7b4d92ee0d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:20.808957  7910 tablet_service.cc:1511] Processing CreateTablet for tablet 1879a702e0ba41b7b0d96b56a99217de (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:20.809370  8140 tablet_service.cc:1511] Processing CreateTablet for tablet c5d6403dabb047e1a41b15afba4737d8 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:20.799079  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd0103deb344096a33481aeda5d1d70 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:20.799700  8065 tablet_service.cc:1511] Processing CreateTablet for tablet 4988500e3bc44817a1bd87f1c4979cca (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:20.813062  8194 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:20.812688  7908 tablet_service.cc:1511] Processing CreateTablet for tablet a34bc926b47b4f1d886de1ccee78479a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:20.803480  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 507f378c61374021afd81f65ffe484b2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:20.815191  8139 tablet_service.cc:1511] Processing CreateTablet for tablet 0d38630e1dc34ceb9665dd2a25e61ddb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:20.827912  8137 tablet_service.cc:1511] Processing CreateTablet for tablet a88bacd650e3448a85930d7b4d92ee0d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:20.828205  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 507f378c61374021afd81f65ffe484b2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:20.828750  8135 tablet_service.cc:1511] Processing CreateTablet for tablet ec19762f6a5e40eea7215e9981f34f9f (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:20.815565  8138 tablet_service.cc:1511] Processing CreateTablet for tablet c65f361d07e44b12ae649ea71e589a3e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:20.815580  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d6403dabb047e1a41b15afba4737d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.818967  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d6403dabb047e1a41b15afba4737d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.835345  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65f361d07e44b12ae649ea71e589a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.839396  7988 tablet_service.cc:1511] Processing CreateTablet for tablet cf19d48029f343a1aa509c8e4ef726a6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:20.841223  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da0d5e0a15447eb99c08ec304ba960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.841867  8194 tablet_bootstrap.cc:654] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:20.842516  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34bc926b47b4f1d886de1ccee78479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.843732  8195 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:20.846133  8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d38630e1dc34ceb9665dd2a25e61ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.825326  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baaa499575414a72af0bd4560d1504c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.851030  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88bacd650e3448a85930d7b4d92ee0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.853435  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec19762f6a5e40eea7215e9981f34f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.859918  7983 tablet_service.cc:1511] Processing CreateTablet for tablet e18529f21b404d6ea36647e7f98c61e5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:20.861419  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18529f21b404d6ea36647e7f98c61e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.867595  7992 tablet_service.cc:1511] Processing CreateTablet for tablet 74089dee1ade40d0a51a6bcb238fb462 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:20.869025  7992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74089dee1ade40d0a51a6bcb238fb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.870157  7989 tablet_service.cc:1511] Processing CreateTablet for tablet f8e6273fa02f47668768e36dda283b31 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:20.871032  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f378c61374021afd81f65ffe484b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.871593  8065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988500e3bc44817a1bd87f1c4979cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.874468  8064 tablet_service.cc:1511] Processing CreateTablet for tablet a34bc926b47b4f1d886de1ccee78479a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:20.891669  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a34bc926b47b4f1d886de1ccee78479a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.893056  7991 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0b2a413d084182b0f28a502f04dff2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:20.875782  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf19d48029f343a1aa509c8e4ef726a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.877750  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 1879a702e0ba41b7b0d96b56a99217de (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:20.896812  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1879a702e0ba41b7b0d96b56a99217de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.879638  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 4988500e3bc44817a1bd87f1c4979cca (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:20.899467  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988500e3bc44817a1bd87f1c4979cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.881500  8132 tablet_service.cc:1511] Processing CreateTablet for tablet baaa499575414a72af0bd4560d1504c2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:20.902947  7991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0b2a413d084182b0f28a502f04dff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.903606  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baaa499575414a72af0bd4560d1504c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.850545  7986 tablet_service.cc:1511] Processing CreateTablet for tablet e0b04470e6e2425e851b3269445fa374 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:20.885313  7985 tablet_service.cc:1511] Processing CreateTablet for tablet 12cd5d1261c74e43bd9d09e591a5b6cd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:20.907558  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b04470e6e2425e851b3269445fa374. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:20.909436  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:20.846133  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 507f378c61374021afd81f65ffe484b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.909504  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 01c49d9b38fd47608c90fc8e709332dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:20.911863  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c49d9b38fd47608c90fc8e709332dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.915022  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4988500e3bc44817a1bd87f1c4979cca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.930795  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cd5d1261c74e43bd9d09e591a5b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.937656  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e6273fa02f47668768e36dda283b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.943596  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 443d2e75298341fb8ac3a2a79d5bec05 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:20.945298  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443d2e75298341fb8ac3a2a79d5bec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.951874  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd0103deb344096a33481aeda5d1d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.953452  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1879a702e0ba41b7b0d96b56a99217de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.955672  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88bacd650e3448a85930d7b4d92ee0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.957300  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377aa62f193a4388a82ea786f25ba033. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.964579  8066 tablet_service.cc:1511] Processing CreateTablet for tablet 74089dee1ade40d0a51a6bcb238fb462 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:20.966495  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74089dee1ade40d0a51a6bcb238fb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.987337  8059 tablet_service.cc:1511] Processing CreateTablet for tablet e0b04470e6e2425e851b3269445fa374 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:20.989275  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b04470e6e2425e851b3269445fa374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.996984  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2a47fe4a344828901bc5fdf6d45db (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:20.999243  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2a47fe4a344828901bc5fdf6d45db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.041814  8194 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:21.044742  8195 tablet_bootstrap.cc:654] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.052398  8131 tablet_service.cc:1511] Processing CreateTablet for tablet cf19d48029f343a1aa509c8e4ef726a6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:21.053891  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf19d48029f343a1aa509c8e4ef726a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.057965  8061 tablet_service.cc:1511] Processing CreateTablet for tablet f8e6273fa02f47668768e36dda283b31 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:21.059441  8061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e6273fa02f47668768e36dda283b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.042483  8194 ts_tablet_manager.cc:1403] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.014s
I20260709 13:03:21.065898  8194 raft_consensus.cc:359] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.066689  8194 raft_consensus.cc:385] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.067058  8194 raft_consensus.cc:740] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.068058  8194 consensus_queue.cc:260] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.077015  7908 tablet_service.cc:1511] Processing CreateTablet for tablet cf19d48029f343a1aa509c8e4ef726a6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:21.079704  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 12cd5d1261c74e43bd9d09e591a5b6cd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:21.082168  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef14152466f47d692cf3b31d7045bf7 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:21.121279  7952 heartbeater.cc:499] Master 127.0.107.254:37283 was elected leader, sending a full tablet report...
I20260709 13:03:21.156154  7916 tablet_service.cc:1511] Processing CreateTablet for tablet e18529f21b404d6ea36647e7f98c61e5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:21.158200  7915 tablet_service.cc:1511] Processing CreateTablet for tablet e0b04470e6e2425e851b3269445fa374 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:21.150946  8140 tablet_service.cc:1511] Processing CreateTablet for tablet ec88e145d9a940c9a732315fdcc27c53 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:21.169797  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec88e145d9a940c9a732315fdcc27c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.161062  8136 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2a47fe4a344828901bc5fdf6d45db (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:21.162112  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 74089dee1ade40d0a51a6bcb238fb462 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:21.127971  8135 tablet_service.cc:1511] Processing CreateTablet for tablet e18529f21b404d6ea36647e7f98c61e5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:21.163452  8198 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:21.165297  8139 tablet_service.cc:1511] Processing CreateTablet for tablet f8e6273fa02f47668768e36dda283b31 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:21.167109  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf19d48029f343a1aa509c8e4ef726a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.168159  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef14152466f47d692cf3b31d7045bf7 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:21.149277  8132 tablet_service.cc:1511] Processing CreateTablet for tablet 443d2e75298341fb8ac3a2a79d5bec05 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:21.098248  7990 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfbafc5e75431faaf8534237b14a40 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:21.097008  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 443d2e75298341fb8ac3a2a79d5bec05 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:21.171379  8197 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:21.179175  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfbafc5e75431faaf8534237b14a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.180495  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 79f06a693fd84cf3b2eda8e179fd85dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:21.180765  8065 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfbafc5e75431faaf8534237b14a40 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:21.193637  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 79b2a47fe4a344828901bc5fdf6d45db (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:21.121162  7991 tablet_service.cc:1511] Processing CreateTablet for tablet ec88e145d9a940c9a732315fdcc27c53 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:21.202322  7991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec88e145d9a940c9a732315fdcc27c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.206807  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cd5d1261c74e43bd9d09e591a5b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.207244  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 01c49d9b38fd47608c90fc8e709332dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:21.216291  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef14152466f47d692cf3b31d7045bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.210513  7986 tablet_service.cc:1511] Processing CreateTablet for tablet 52fb0d48a61c4f3696f07f0e9f953dfa (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:21.223927  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fb0d48a61c4f3696f07f0e9f953dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.231487  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18529f21b404d6ea36647e7f98c61e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.231909  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3212e0a78a41fdb90d232921d72ea1 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:21.233821  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2a47fe4a344828901bc5fdf6d45db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.235222  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0b2a413d084182b0f28a502f04dff2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:21.236703  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0b2a413d084182b0f28a502f04dff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.236847  8027 heartbeater.cc:499] Master 127.0.107.254:37283 was elected leader, sending a full tablet report...
I20260709 13:03:21.239130  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b04470e6e2425e851b3269445fa374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.241230  7914 tablet_service.cc:1511] Processing CreateTablet for tablet 12cd5d1261c74e43bd9d09e591a5b6cd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:21.243016  8065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfbafc5e75431faaf8534237b14a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.243016  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74089dee1ade40d0a51a6bcb238fb462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.247462  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443d2e75298341fb8ac3a2a79d5bec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.249946  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 9ef14152466f47d692cf3b31d7045bf7 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:21.250764  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18529f21b404d6ea36647e7f98c61e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.245720  7910 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0b2a413d084182b0f28a502f04dff2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:21.233824  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3212e0a78a41fdb90d232921d72ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.242571  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cd5d1261c74e43bd9d09e591a5b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.260593  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f06a693fd84cf3b2eda8e179fd85dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.268662  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef14152466f47d692cf3b31d7045bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.275549  8136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79b2a47fe4a344828901bc5fdf6d45db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.276191  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c49d9b38fd47608c90fc8e709332dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.277005  8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e6273fa02f47668768e36dda283b31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.277702  8194 ts_tablet_manager.cc:1434] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.215s	user 0.029s	sys 0.050s
I20260709 13:03:21.278889  8194 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:21.284837  8197 tablet_bootstrap.cc:654] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.285259  8199 raft_consensus.cc:493] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.291229  8199 raft_consensus.cc:515] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.287094  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 01c49d9b38fd47608c90fc8e709332dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:21.295024  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c49d9b38fd47608c90fc8e709332dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.290215  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 254ebe75a90346379724aca3aad860e2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:21.303133  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 443d2e75298341fb8ac3a2a79d5bec05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.309305  8199 leader_election.cc:290] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:21.327195  8195 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:21.326980  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 83dfbafc5e75431faaf8534237b14a40 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:21.327749  8195 ts_tablet_manager.cc:1403] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.485s	user 0.012s	sys 0.024s
I20260709 13:03:21.330886  8195 raft_consensus.cc:359] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.331579  8195 raft_consensus.cc:385] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.331858  8195 raft_consensus.cc:740] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.332154  8101 heartbeater.cc:499] Master 127.0.107.254:37283 was elected leader, sending a full tablet report...
I20260709 13:03:21.339775  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ebe75a90346379724aca3aad860e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.340899  8194 tablet_bootstrap.cc:654] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.341938  8195 consensus_queue.cc:260] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.377038  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 79f06a693fd84cf3b2eda8e179fd85dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:21.379112  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f06a693fd84cf3b2eda8e179fd85dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.381086  7913 tablet_service.cc:1511] Processing CreateTablet for tablet ec88e145d9a940c9a732315fdcc27c53 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:21.403923  7910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0b2a413d084182b0f28a502f04dff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.409904  8195 ts_tablet_manager.cc:1434] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.082s	user 0.012s	sys 0.000s
I20260709 13:03:21.425437  8197 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:21.431084  8175 heartbeater.cc:499] Master 127.0.107.254:37283 was elected leader, sending a full tablet report...
I20260709 13:03:21.436663  8194 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:21.430936  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83dfbafc5e75431faaf8534237b14a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.458904  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ef14152466f47d692cf3b31d7045bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.466657  8195 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
W20260709 13:03:21.469653  8028 tablet.cc:2406] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:21.445271  8197 ts_tablet_manager.cc:1403] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.274s	user 0.021s	sys 0.025s
I20260709 13:03:21.482784  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec88e145d9a940c9a732315fdcc27c53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.497937  8140 tablet_service.cc:1511] Processing CreateTablet for tablet 52fb0d48a61c4f3696f07f0e9f953dfa (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:21.503739  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 52fb0d48a61c4f3696f07f0e9f953dfa (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:21.503989  7908 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3212e0a78a41fdb90d232921d72ea1 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:21.505362  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fb0d48a61c4f3696f07f0e9f953dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.484239  8194 ts_tablet_manager.cc:1403] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.206s	user 0.016s	sys 0.004s
I20260709 13:03:21.509886  8194 raft_consensus.cc:359] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.505333  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3212e0a78a41fdb90d232921d72ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.482784  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 79f06a693fd84cf3b2eda8e179fd85dc (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:21.513209  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f06a693fd84cf3b2eda8e179fd85dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.517514  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52fb0d48a61c4f3696f07f0e9f953dfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.523717  8195 tablet_bootstrap.cc:654] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.529114  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 254ebe75a90346379724aca3aad860e2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:21.530478  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ebe75a90346379724aca3aad860e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.533710  8198 tablet_bootstrap.cc:654] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.506078  8197 raft_consensus.cc:359] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:21.541424  8065 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3212e0a78a41fdb90d232921d72ea1 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:21.542891  8065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3212e0a78a41fdb90d232921d72ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.545389  8138 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1af1b402194d8c90df94542ed85d63 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:21.546814  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1af1b402194d8c90df94542ed85d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.547003  8060 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1af1b402194d8c90df94542ed85d63 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:21.548192  8060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1af1b402194d8c90df94542ed85d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.555101  8204 raft_consensus.cc:493] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.555827  8204 raft_consensus.cc:515] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.536651  8194 raft_consensus.cc:385] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.559423  8204 leader_election.cc:290] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:21.539710  8197 raft_consensus.cc:385] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.576640  7916 tablet_service.cc:1511] Processing CreateTablet for tablet c94e6f3b32be489795228057469a99d6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:21.577976  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94e6f3b32be489795228057469a99d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.578271  7917 tablet_service.cc:1511] Processing CreateTablet for tablet c8ade0a1743d454eb241e68ef253f4e6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:21.578395  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab7e0f3150e480ea34f7b131978b028 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:21.579032  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab7e0f3150e480ea34f7b131978b028 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:21.579660  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ade0a1743d454eb241e68ef253f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.579785  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab7e0f3150e480ea34f7b131978b028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.581076  8132 tablet_service.cc:1511] Processing CreateTablet for tablet c94e6f3b32be489795228057469a99d6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:21.582299  8132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94e6f3b32be489795228057469a99d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.563235  8194 raft_consensus.cc:740] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.589560  8194 consensus_queue.cc:260] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.592164  8194 ts_tablet_manager.cc:1434] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.001s
I20260709 13:03:21.593204  8194 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:21.570393  8197 raft_consensus.cc:740] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.594769  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab7e0f3150e480ea34f7b131978b028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.595332  8197 consensus_queue.cc:260] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:21.619848  8197 ts_tablet_manager.cc:1434] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.120s	user 0.013s	sys 0.000s
I20260709 13:03:21.626667  7915 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1af1b402194d8c90df94542ed85d63 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:21.629249  8064 tablet_service.cc:1511] Processing CreateTablet for tablet 162410dd39f9414d830b658dbc8e7197 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:21.632149  8064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162410dd39f9414d830b658dbc8e7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.632862  8197 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:21.640949  8197 tablet_bootstrap.cc:654] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.640844  8199 raft_consensus.cc:493] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.641558  8199 raft_consensus.cc:515] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.643322  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1af1b402194d8c90df94542ed85d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.644152  8199 leader_election.cc:290] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:21.644709  8057 tablet_service.cc:1511] Processing CreateTablet for tablet c94e6f3b32be489795228057469a99d6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:21.569593  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 254ebe75a90346379724aca3aad860e2 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:21.650072  8195 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:21.650349  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94e6f3b32be489795228057469a99d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.650743  8195 ts_tablet_manager.cc:1403] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.184s	user 0.008s	sys 0.012s
I20260709 13:03:21.655875  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 162410dd39f9414d830b658dbc8e7197 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:21.657274  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162410dd39f9414d830b658dbc8e7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.656924  7991 tablet_service.cc:1511] Processing CreateTablet for tablet c8ade0a1743d454eb241e68ef253f4e6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:21.658902  7990 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab7e0f3150e480ea34f7b131978b028 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:21.661806  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 95f1cdc967ed405b9586552899bd23fb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:21.663190  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f1cdc967ed405b9586552899bd23fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.663870  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 95f1cdc967ed405b9586552899bd23fb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:21.665103  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f1cdc967ed405b9586552899bd23fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.667717  7986 tablet_service.cc:1511] Processing CreateTablet for tablet 95f1cdc967ed405b9586552899bd23fb (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:21.670274  7989 tablet_service.cc:1511] Processing CreateTablet for tablet 1c57f47c624d4610b8a17b50701ede64 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:21.670979  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab7e0f3150e480ea34f7b131978b028. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.671629  7989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c57f47c624d4610b8a17b50701ede64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.654084  8195 raft_consensus.cc:359] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:21.675539  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf568fbc40f4c588f6a1e5802c3fb35 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:21.676002  7983 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd7f48731264748981e15dd47fb7bb6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:21.679049  7991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ade0a1743d454eb241e68ef253f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.700551  8059 tablet_service.cc:1511] Processing CreateTablet for tablet 1c57f47c624d4610b8a17b50701ede64 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:21.701930  8059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c57f47c624d4610b8a17b50701ede64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.702741  8133 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd45f8f674163bc3489db86c80c66 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:21.703740  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f1cdc967ed405b9586552899bd23fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.704139  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd45f8f674163bc3489db86c80c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.706210  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf568fbc40f4c588f6a1e5802c3fb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.705991  7908 tablet_service.cc:1511] Processing CreateTablet for tablet 1c57f47c624d4610b8a17b50701ede64 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:21.707587  8061 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd45f8f674163bc3489db86c80c66 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:21.655875  8131 tablet_service.cc:1511] Processing CreateTablet for tablet 162410dd39f9414d830b658dbc8e7197 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:21.708870  8061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd45f8f674163bc3489db86c80c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.709471  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162410dd39f9414d830b658dbc8e7197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.712639  7914 tablet_service.cc:1511] Processing CreateTablet for tablet b72bd45f8f674163bc3489db86c80c66 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:21.713379  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd7f48731264748981e15dd47fb7bb6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:21.714211  8063 tablet_service.cc:1511] Processing CreateTablet for tablet c8ade0a1743d454eb241e68ef253f4e6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:21.714673  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd7f48731264748981e15dd47fb7bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.715449  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ade0a1743d454eb241e68ef253f4e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.715698  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf568fbc40f4c588f6a1e5802c3fb35 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:21.718839  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ebe75a90346379724aca3aad860e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.722976  7914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b72bd45f8f674163bc3489db86c80c66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.729875  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf568fbc40f4c588f6a1e5802c3fb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.730924  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd7f48731264748981e15dd47fb7bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.736217  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:21.736340  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:21.737237  8076 raft_consensus.cc:2468] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:21.738096  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:21.738867  7967 leader_election.cc:304] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:21.739782  8199 raft_consensus.cc:2804] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:21.739916  7967 leader_election.cc:343] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:21.740207  8199 raft_consensus.cc:493] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.740715  8199 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:21.681485  8195 raft_consensus.cc:385] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.742738  8195 raft_consensus.cc:740] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.743597  8195 consensus_queue.cc:260] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:21.745954  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:21.746253  8195 ts_tablet_manager.cc:1434] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
W20260709 13:03:21.749594  8041 leader_election.cc:343] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:21.755635  8139 tablet_service.cc:1511] Processing CreateTablet for tablet 1dd7f48731264748981e15dd47fb7bb6 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:21.757128  8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd7f48731264748981e15dd47fb7bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.770905  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:21.781596  8197 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:21.782194  8197 ts_tablet_manager.cc:1403] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.150s	user 0.020s	sys 0.008s
I20260709 13:03:21.782991  8195 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:21.767979  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c57f47c624d4610b8a17b50701ede64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.788411  7917 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa58a98b8994582a9cd95d99596f4ea (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:21.792956  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa58a98b8994582a9cd95d99596f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.792099  8194 tablet_bootstrap.cc:654] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.796272  8198 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:21.796834  8198 ts_tablet_manager.cc:1403] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.634s	user 0.021s	sys 0.028s
I20260709 13:03:21.797549  8197 raft_consensus.cc:359] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:21.800103  8198 raft_consensus.cc:359] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.800973  8198 raft_consensus.cc:385] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.801275  8198 raft_consensus.cc:740] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.801403  8057 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa58a98b8994582a9cd95d99596f4ea (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:21.802500  8066 tablet_service.cc:1511] Processing CreateTablet for tablet b05fd148ee7149088d25a5342739c87e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:21.803108  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa58a98b8994582a9cd95d99596f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.804333  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05fd148ee7149088d25a5342739c87e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.807204  8212 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:21.807955  7967 leader_election.cc:343] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:21.807794  8212 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:21.811038  8212 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:21.813120  7913 tablet_service.cc:1511] Processing CreateTablet for tablet ab4114d662304b8293dc9591163d2125 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:21.818660  7984 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa58a98b8994582a9cd95d99596f4ea (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:21.819878  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4114d662304b8293dc9591163d2125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.819967  7984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa58a98b8994582a9cd95d99596f4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.798348  8197 raft_consensus.cc:385] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.786298  8199 raft_consensus.cc:515] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.802155  8198 consensus_queue.cc:260] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:21.835641  8137 tablet_service.cc:1511] Processing CreateTablet for tablet b05fd148ee7149088d25a5342739c87e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:21.892931  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05fd148ee7149088d25a5342739c87e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.844550  8134 tablet_service.cc:1511] Processing CreateTablet for tablet ab4114d662304b8293dc9591163d2125 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:21.895375  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4114d662304b8293dc9591163d2125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.847455  8199 leader_election.cc:290] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:21.850677  8002 raft_consensus.cc:2393] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:21.749586  8140 tablet_service.cc:1511] Processing CreateTablet for tablet 6cf568fbc40f4c588f6a1e5802c3fb35 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:21.854218  7916 tablet_service.cc:1511] Processing CreateTablet for tablet b05fd148ee7149088d25a5342739c87e (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:21.861608  8066 tablet_service.cc:1511] Processing CreateTablet for tablet 9445e4d228e048d79a4dc7e65bf17ce4 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:21.912734  8039 leader_election.cc:304] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:21.913867  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445e4d228e048d79a4dc7e65bf17ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.872344  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:21.914345  8076 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:21.873515  7992 tablet_service.cc:1511] Processing CreateTablet for tablet 9445e4d228e048d79a4dc7e65bf17ce4 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:21.874001  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:21.829597  8197 raft_consensus.cc:740] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.918409  7992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445e4d228e048d79a4dc7e65bf17ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.919595  8194 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:21.919283  8197 consensus_queue.cc:260] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:21.912149  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b05fd148ee7149088d25a5342739c87e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.920162  8194 ts_tablet_manager.cc:1403] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.327s	user 0.032s	sys 0.034s
I20260709 13:03:21.912910  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cf568fbc40f4c588f6a1e5802c3fb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.871943  7985 tablet_service.cc:1511] Processing CreateTablet for tablet ab4114d662304b8293dc9591163d2125 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:21.924192  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4114d662304b8293dc9591163d2125. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.925781  8194 raft_consensus.cc:359] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:21.926575  8194 raft_consensus.cc:385] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:21.926882  8194 raft_consensus.cc:740] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:21.927659  8194 consensus_queue.cc:260] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:21.929837  8194 ts_tablet_manager.cc:1434] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:21.930872  8194 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:21.909157  8195 tablet_bootstrap.cc:654] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:21.958798  8199 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.959401  8199 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:21.961361  8199 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
W20260709 13:03:21.967473  7967 leader_election.cc:343] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:21.977069  8197 ts_tablet_manager.cc:1434] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.195s	user 0.003s	sys 0.007s
I20260709 13:03:21.988821  8076 raft_consensus.cc:2468] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:21.989514  8204 raft_consensus.cc:2749] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:21.989702  8135 tablet_service.cc:1511] Processing CreateTablet for tablet 9445e4d228e048d79a4dc7e65bf17ce4 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:03:21.990808  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:21.991194  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445e4d228e048d79a4dc7e65bf17ce4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:21.992865  7967 leader_election.cc:304] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:21.996688  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:21.997459  8199 raft_consensus.cc:2804] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:21.998476  7967 leader_election.cc:343] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:21.998986  7967 leader_election.cc:304] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:22.004062  8198 ts_tablet_manager.cc:1434] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.207s	user 0.021s	sys 0.024s
I20260709 13:03:22.004205  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 07c8df4352104870bd7c48c69566d909 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:22.013959  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 07c8df4352104870bd7c48c69566d909 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:22.017457  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c8df4352104870bd7c48c69566d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.034168  8212 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.034890  8218 raft_consensus.cc:493] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.011958  8198 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.034797  8212 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:22.043390  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 44923.3us
I20260709 13:03:22.036985  8197 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.038529  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c8df4352104870bd7c48c69566d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.048864  8199 raft_consensus.cc:697] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:22.051810  8219 raft_consensus.cc:2749] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.045989  8063 tablet_service.cc:1511] Processing CreateTablet for tablet 07c8df4352104870bd7c48c69566d909 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:22.055104  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07c8df4352104870bd7c48c69566d909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.059195  8137 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361579718846d08eb4509a5caeeb3c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:22.064327  8212 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.039697  8218 raft_consensus.cc:515] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.077224  8218 leader_election.cc:290] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:22.085568  8194 tablet_bootstrap.cc:654] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.093168  7909 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361579718846d08eb4509a5caeeb3c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:22.094224  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.094619  7909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361579718846d08eb4509a5caeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.095090  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.091578  8137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361579718846d08eb4509a5caeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.101119  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:22.101752  8115 leader_election.cc:343] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.103057  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.104213  8198 tablet_bootstrap.cc:654] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.052280  8199 consensus_queue.cc:237] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:22.109043  8115 leader_election.cc:343] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.107911  8204 raft_consensus.cc:493] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.123306  8204 raft_consensus.cc:515] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.124002  8057 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3eb748fc547daa3c67446a34670fd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:22.125295  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3eb748fc547daa3c67446a34670fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.125406  8204 leader_election.cc:290] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:22.109522  8150 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:22.128062  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.124035  8135 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3eb748fc547daa3c67446a34670fd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:22.130592  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3eb748fc547daa3c67446a34670fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.131289  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:22.131577  8115 leader_election.cc:343] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.132068  8115 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:22.132856  8212 raft_consensus.cc:2749] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:22.134009  8039 leader_election.cc:343] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.134982  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.128280  8195 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.137979  8195 ts_tablet_manager.cc:1403] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.355s	user 0.015s	sys 0.011s
I20260709 13:03:22.138988  8140 tablet_service.cc:1511] Processing CreateTablet for tablet d0b865da0fa54a2f80b832869c24f96d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:22.139745  7917 tablet_service.cc:1511] Processing CreateTablet for tablet fa189f7d78b742b79515eedbc3d2514d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:22.140302  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b865da0fa54a2f80b832869c24f96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.140955  7917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa189f7d78b742b79515eedbc3d2514d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:22.136485  8041 leader_election.cc:343] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.136749  8131 tablet_service.cc:1511] Processing CreateTablet for tablet cc77641f1caf4b5aa4ad012540fbb5a5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:03:22.118978  7967 leader_election.cc:343] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.137132  8063 tablet_service.cc:1511] Processing CreateTablet for tablet cc77641f1caf4b5aa4ad012540fbb5a5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:22.146378  8131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc77641f1caf4b5aa4ad012540fbb5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.147682  8063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc77641f1caf4b5aa4ad012540fbb5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.141131  8195 raft_consensus.cc:359] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.166050  8195 raft_consensus.cc:385] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.166337  8195 raft_consensus.cc:740] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.167122  8195 consensus_queue.cc:260] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.169256  8195 ts_tablet_manager.cc:1434] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.003s
I20260709 13:03:22.149959  7983 tablet_service.cc:1511] Processing CreateTablet for tablet fa189f7d78b742b79515eedbc3d2514d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:22.143669  7908 tablet_service.cc:1511] Processing CreateTablet for tablet f1d3eb748fc547daa3c67446a34670fd (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:22.171881  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa189f7d78b742b79515eedbc3d2514d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.172281  7908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1d3eb748fc547daa3c67446a34670fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.146922  8139 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3427f9a3804e8786b0e837c3187403 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:22.142066  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 117d9367cf76482abd217a33615ad4ef (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:22.145602  8133 tablet_service.cc:1511] Processing CreateTablet for tablet 117d9367cf76482abd217a33615ad4ef (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:22.150386  7986 tablet_service.cc:1511] Processing CreateTablet for tablet d0b865da0fa54a2f80b832869c24f96d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:22.146029  7915 tablet_service.cc:1511] Processing CreateTablet for tablet ef50729a4ad94bf1b63e925aeb1f763b (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:22.176164  7986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b865da0fa54a2f80b832869c24f96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.142251  8041 leader_election.cc:304] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.148653  7985 tablet_service.cc:1511] Processing CreateTablet for tablet cc77641f1caf4b5aa4ad012540fbb5a5 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:22.144641  7916 tablet_service.cc:1511] Processing CreateTablet for tablet d0b865da0fa54a2f80b832869c24f96d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:22.183316  7988 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3427f9a3804e8786b0e837c3187403 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:22.184648  8204 raft_consensus.cc:2749] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.175426  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117d9367cf76482abd217a33615ad4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.189064  7916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0b865da0fa54a2f80b832869c24f96d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.191864  8139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3427f9a3804e8786b0e837c3187403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.193885  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.194665  8002 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:22.194957  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc77641f1caf4b5aa4ad012540fbb5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.196255  8113 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:22.197496  8212 raft_consensus.cc:2804] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.197851  8212 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.198203  8212 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.198434  7988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3427f9a3804e8786b0e837c3187403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.200467  8195 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.202971  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117d9367cf76482abd217a33615ad4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.206475  8212 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.207002  7915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef50729a4ad94bf1b63e925aeb1f763b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.214722  7967 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:22.215772  8220 raft_consensus.cc:2804] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.216202  8220 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:22.223548  8041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 87037.3us
I20260709 13:03:22.226557  8058 tablet_service.cc:1511] Processing CreateTablet for tablet 117d9367cf76482abd217a33615ad4ef (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:22.226763  8062 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3427f9a3804e8786b0e837c3187403 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:22.216548  8220 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.229784  8058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117d9367cf76482abd217a33615ad4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.231312  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3427f9a3804e8786b0e837c3187403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.226763  8061 tablet_service.cc:1511] Processing CreateTablet for tablet fa189f7d78b742b79515eedbc3d2514d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:22.236763  8061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa189f7d78b742b79515eedbc3d2514d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.239789  8134 tablet_service.cc:1511] Processing CreateTablet for tablet 55e6c27d5c454418af17931d298c320a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:22.241199  8134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e6c27d5c454418af17931d298c320a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.243777  8197 tablet_bootstrap.cc:654] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:22.244275  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 64896.8us
I20260709 13:03:22.246495  7990 tablet_service.cc:1511] Processing CreateTablet for tablet ef50729a4ad94bf1b63e925aeb1f763b (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:22.252843  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.253129  7992 tablet_service.cc:1511] Processing CreateTablet for tablet 3e361579718846d08eb4509a5caeeb3c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:03:22.255749  7892 leader_election.cc:343] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.252867  7990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef50729a4ad94bf1b63e925aeb1f763b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.269819  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 55e6c27d5c454418af17931d298c320a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:22.267897  7992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e361579718846d08eb4509a5caeeb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.274987  7913 tablet_service.cc:1511] Processing CreateTablet for tablet f05e192005fb424591cc4763fbafb9af (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:22.275985  7987 tablet_service.cc:1511] Processing CreateTablet for tablet 55e6c27d5c454418af17931d298c320a (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:22.277305  7987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e6c27d5c454418af17931d298c320a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.273159  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e6c27d5c454418af17931d298c320a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.274987  8138 tablet_service.cc:1511] Processing CreateTablet for tablet f05e192005fb424591cc4763fbafb9af (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:22.279141  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e192005fb424591cc4763fbafb9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.279702  8138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e192005fb424591cc4763fbafb9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.280606  8220 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.284572  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:22.285346  8150 raft_consensus.cc:2393] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:22.286163  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
W20260709 13:03:22.297529  7967 leader_election.cc:343] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.298458  7967 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:22.299304  8219 raft_consensus.cc:2749] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.300247  8194 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.300756  8194 ts_tablet_manager.cc:1403] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.370s	user 0.016s	sys 0.035s
I20260709 13:03:22.291285  8220 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:22.304304  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:22.305197  8002 raft_consensus.cc:2393] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:22.307296  8195 tablet_bootstrap.cc:654] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.309450  8212 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.309876  8057 tablet_service.cc:1511] Processing CreateTablet for tablet ef50729a4ad94bf1b63e925aeb1f763b (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:22.309873  8066 tablet_service.cc:1511] Processing CreateTablet for tablet f05e192005fb424591cc4763fbafb9af (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:22.310972  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:22.337724  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef50729a4ad94bf1b63e925aeb1f763b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:22.338228  8115 leader_election.cc:343] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.338749  8115 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.340262  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05e192005fb424591cc4763fbafb9af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.315665  8229 raft_consensus.cc:493] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.342862  7983 tablet_service.cc:1511] Processing CreateTablet for tablet fbab94a274f84b2e954e7921a8ac73b3 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:22.342895  8229 raft_consensus.cc:515] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.342958  8212 raft_consensus.cc:2749] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.344364  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab94a274f84b2e954e7921a8ac73b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.347079  8229 leader_election.cc:290] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:22.320775  8198 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:22.321144  8194 raft_consensus.cc:359] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.322609  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.355630  8198 ts_tablet_manager.cc:1403] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.351s	user 0.016s	sys 0.012s
I20260709 13:03:22.356411  8194 raft_consensus.cc:385] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:22.359787  7890 leader_election.cc:343] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.360289  7890 leader_election.cc:304] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.361106  8218 raft_consensus.cc:2749] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.359804  8194 raft_consensus.cc:740] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.362788  8194 consensus_queue.cc:260] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.363162  8133 tablet_service.cc:1511] Processing CreateTablet for tablet fbab94a274f84b2e954e7921a8ac73b3 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:22.364650  8133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab94a274f84b2e954e7921a8ac73b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.365095  8198 raft_consensus.cc:359] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.365850  8198 raft_consensus.cc:385] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.366143  8198 raft_consensus.cc:740] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.370376  8194 ts_tablet_manager.cc:1434] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:03:22.371528  8194 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.376758  8198 consensus_queue.cc:260] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.393343  8198 ts_tablet_manager.cc:1434] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:03:22.400702  7912 tablet_service.cc:1511] Processing CreateTablet for tablet 26d79363387a421ab0dd5c8ee4a99a9c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:22.402189  7912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d79363387a421ab0dd5c8ee4a99a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.406762  8220 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.407537  8220 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.413101  7985 tablet_service.cc:1511] Processing CreateTablet for tablet 26d79363387a421ab0dd5c8ee4a99a9c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:22.415082  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.417727  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:22.421073  7967 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:22.422398  7967 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.423058  7967 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:22.424109  8219 raft_consensus.cc:2749] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.426844  8218 raft_consensus.cc:493] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.427554  8218 raft_consensus.cc:515] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.429226  8197 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.429757  8197 ts_tablet_manager.cc:1403] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.422s	user 0.021s	sys 0.003s
I20260709 13:03:22.430120  8218 leader_election.cc:290] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.433688  8197 raft_consensus.cc:359] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.435216  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:22.436638  7890 leader_election.cc:343] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.437479  8197 raft_consensus.cc:385] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.437866  8197 raft_consensus.cc:740] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.438848  8197 consensus_queue.cc:260] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.410461  8220 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.443624  8197 ts_tablet_manager.cc:1434] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:22.445559  8197 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.443797  7823 catalog_manager.cc:5697] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.444211  7985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d79363387a421ab0dd5c8ee4a99a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.453038  8197 tablet_bootstrap.cc:654] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.457620  8195 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.458200  8195 ts_tablet_manager.cc:1403] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.258s	user 0.010s	sys 0.002s
I20260709 13:03:22.461237  8195 raft_consensus.cc:359] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.461596  7911 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706220a9864dedb5c4b4b2039b744d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:22.462338  8195 raft_consensus.cc:385] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.462872  8195 raft_consensus.cc:740] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.463279  7911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706220a9864dedb5c4b4b2039b744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.464254  8195 consensus_queue.cc:260] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.468364  8195 ts_tablet_manager.cc:1434] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:22.471988  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:22.476639  8115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45223, user_credentials={real_user=slave}} blocked reactor thread for 138363us
W20260709 13:03:22.486930  7892 leader_election.cc:343] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.487087  7983 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706220a9864dedb5c4b4b2039b744d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:22.487504  7892 leader_election.cc:304] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.488515  7983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706220a9864dedb5c4b4b2039b744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.489343  8135 tablet_service.cc:1511] Processing CreateTablet for tablet ea00da638b4f45eea1984895448e1d37 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:22.490698  8135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea00da638b4f45eea1984895448e1d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.491210  7913 tablet_service.cc:1511] Processing CreateTablet for tablet ea00da638b4f45eea1984895448e1d37 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:22.492426  7913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea00da638b4f45eea1984895448e1d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.496171  8218 raft_consensus.cc:2749] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.503523  8140 tablet_service.cc:1511] Processing CreateTablet for tablet 3f706220a9864dedb5c4b4b2039b744d (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:22.504943  8140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f706220a9864dedb5c4b4b2039b744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.508025  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.509898  8057 tablet_service.cc:1511] Processing CreateTablet for tablet ea00da638b4f45eea1984895448e1d37 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:22.510175  8062 tablet_service.cc:1511] Processing CreateTablet for tablet fbab94a274f84b2e954e7921a8ac73b3 (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:22.511301  8057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea00da638b4f45eea1984895448e1d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.512236  8066 tablet_service.cc:1511] Processing CreateTablet for tablet 26d79363387a421ab0dd5c8ee4a99a9c (DEFAULT_TABLE table=test-workload [id=c09bfc5084cc4381b15519944a939978]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:22.513990  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.516084  8066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26d79363387a421ab0dd5c8ee4a99a9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:22.519098  8041 leader_election.cc:343] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.520095  8062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbab94a274f84b2e954e7921a8ac73b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:22.520074  8041 leader_election.cc:343] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.520803  8041 leader_election.cc:304] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:22.521848  8229 raft_consensus.cc:2749] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.523799  8195 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.531415  8198 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.538353  8194 tablet_bootstrap.cc:654] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.546676  8197 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.547370  8197 ts_tablet_manager.cc:1403] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.018s
I20260709 13:03:22.550774  8197 raft_consensus.cc:359] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.554837  8197 raft_consensus.cc:385] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.555263  8197 raft_consensus.cc:740] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.556280  8197 consensus_queue.cc:260] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.560662  8197 ts_tablet_manager.cc:1434] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:03:22.569161  8198 tablet_bootstrap.cc:654] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.552066  8195 tablet_bootstrap.cc:654] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.577611  8197 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.579082  8194 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.579864  8194 ts_tablet_manager.cc:1403] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.209s	user 0.014s	sys 0.002s
I20260709 13:03:22.581554  8195 tablet_bootstrap.cc:492] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.582194  8195 ts_tablet_manager.cc:1403] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.003s
I20260709 13:03:22.583701  8194 raft_consensus.cc:359] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.584348  8194 raft_consensus.cc:385] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.584686  8194 raft_consensus.cc:740] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.585497  8195 raft_consensus.cc:359] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.586289  8195 raft_consensus.cc:385] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.586597  8195 raft_consensus.cc:740] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.587864  8197 tablet_bootstrap.cc:654] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.589236  8194 consensus_queue.cc:260] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.587451  8195 consensus_queue.cc:260] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.592206  8194 ts_tablet_manager.cc:1434] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:22.595093  8194 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.600410  8232 raft_consensus.cc:493] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.601017  8232 raft_consensus.cc:515] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.602762  8198 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:22.603329  8198 ts_tablet_manager.cc:1403] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.118s	user 0.008s	sys 0.011s
I20260709 13:03:22.604573  8194 tablet_bootstrap.cc:654] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.605047  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.606320  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.606974  8229 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.607502  8229 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:22.608022  8113 leader_election.cc:343] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.608520  8195 ts_tablet_manager.cc:1434] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.004s
W20260709 13:03:22.609373  8115 leader_election.cc:343] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.609643  8195 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.609871  8115 leader_election.cc:304] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.611212  8212 raft_consensus.cc:2749] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.612171  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.612895  8150 raft_consensus.cc:2468] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:22.615096  8041 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:22.616359  8229 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:22.616562  8204 raft_consensus.cc:2804] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.617043  8204 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.617372  8204 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.617636  8195 tablet_bootstrap.cc:654] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.620393  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.622524  8232 leader_election.cc:290] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.633862  8204 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.635293  8220 consensus_queue.cc:1048] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:22.637687  8197 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.645030  8197 ts_tablet_manager.cc:1403] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.006s
W20260709 13:03:22.646421  8041 leader_election.cc:343] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.648784  8229 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.649652  8229 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.653579  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.654742  8002 raft_consensus.cc:2393] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:22.658802  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.659945  8150 raft_consensus.cc:2393] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:22.660456  8198 raft_consensus.cc:359] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.661552  8198 raft_consensus.cc:385] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.661887  8041 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.663177  8198 raft_consensus.cc:740] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.663952  8229 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:22.664250  8247 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.664157  8198 consensus_queue.cc:260] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.669723  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:22.670325  8150 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.679563  8198 ts_tablet_manager.cc:1434] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:03:22.674505  8247 raft_consensus.cc:2749] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.680940  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
W20260709 13:03:22.683068  8041 leader_election.cc:343] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.684626  8204 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:22.691336  8198 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.686342  8150 raft_consensus.cc:2468] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:22.695930  8041 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:22.698364  8204 raft_consensus.cc:2804] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:22.699164  8204 raft_consensus.cc:697] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:22.700424  8204 consensus_queue.cc:237] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.688647  8197 raft_consensus.cc:359] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.705420  8197 raft_consensus.cc:385] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.705691  8195 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.705753  8197 raft_consensus.cc:740] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.706455  8195 ts_tablet_manager.cc:1403] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.050s
I20260709 13:03:22.704250  8218 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.706858  8197 consensus_queue.cc:260] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.707211  8218 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.709273  8197 ts_tablet_manager.cc:1434] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 13:03:22.709352  8218 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.710582  8197 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.709717  8195 raft_consensus.cc:359] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.711272  8195 raft_consensus.cc:385] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.711585  8195 raft_consensus.cc:740] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.712577  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.713230  8002 raft_consensus.cc:2468] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:22.704908  8194 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.714166  8194 ts_tablet_manager.cc:1403] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.119s	user 0.052s	sys 0.048s
I20260709 13:03:22.716554  7890 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.717504  8218 raft_consensus.cc:2804] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:22.716774  7967 consensus_peers.cc:597] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.717438  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.718072  8218 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.718494  8218 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.717813  8197 tablet_bootstrap.cc:654] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:22.719491  7892 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.721061  8195 consensus_queue.cc:260] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.723721  8195 ts_tablet_manager.cc:1434] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:03:22.724761  8195 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.728598  8194 raft_consensus.cc:359] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.729413  8194 raft_consensus.cc:385] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.729761  8194 raft_consensus.cc:740] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.732534  8194 consensus_queue.cc:260] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.733449  8218 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.736362  8198 tablet_bootstrap.cc:654] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.736658  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:22.737270  8002 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.737380  8194 ts_tablet_manager.cc:1434] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:03:22.738642  8194 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.740149  8218 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:22.739656  8195 tablet_bootstrap.cc:654] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.744127  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:22.744716  8198 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:22.745321  8198 ts_tablet_manager.cc:1403] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.003s
W20260709 13:03:22.746263  7892 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.744730  8197 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.748518  8197 ts_tablet_manager.cc:1403] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:03:22.748562  8194 tablet_bootstrap.cc:654] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.752086  8197 raft_consensus.cc:359] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.752897  8197 raft_consensus.cc:385] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.753245  8197 raft_consensus.cc:740] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.754938  8195 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.755563  8195 ts_tablet_manager.cc:1403] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.006s
I20260709 13:03:22.756362  8198 raft_consensus.cc:359] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.757160  8198 raft_consensus.cc:385] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.757472  8198 raft_consensus.cc:740] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.758244  8198 consensus_queue.cc:260] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.758927  8194 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.759439  8194 ts_tablet_manager.cc:1403] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:03:22.759078  8195 raft_consensus.cc:359] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.759960  8195 raft_consensus.cc:385] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.753647  8002 raft_consensus.cc:2468] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:22.760361  8195 raft_consensus.cc:740] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.761277  8195 consensus_queue.cc:260] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.754288  8197 consensus_queue.cc:260] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.762570  8194 raft_consensus.cc:359] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.763339  8194 raft_consensus.cc:385] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.763617  8194 raft_consensus.cc:740] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.764037  8198 ts_tablet_manager.cc:1434] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:03:22.764362  8194 consensus_queue.cc:260] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.765100  8198 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.767019  8194 ts_tablet_manager.cc:1434] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:03:22.768069  8194 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.771201  8197 ts_tablet_manager.cc:1434] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:03:22.772750  8198 tablet_bootstrap.cc:654] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.775413  7890 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:22.776258  8218 raft_consensus.cc:2804] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:22.777895  8195 ts_tablet_manager.cc:1434] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:03:22.779060  8195 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.781958  8197 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.784312  8218 raft_consensus.cc:697] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:22.790323  8194 tablet_bootstrap.cc:654] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.792723  7825 catalog_manager.cc:5697] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.795495  8197 tablet_bootstrap.cc:654] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.797080  8195 tablet_bootstrap.cc:654] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.789036  8218 consensus_queue.cc:237] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.831892  8197 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.832582  8197 ts_tablet_manager.cc:1403] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.057s	user 0.020s	sys 0.007s
I20260709 13:03:22.836853  8197 raft_consensus.cc:359] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.837622  8197 raft_consensus.cc:385] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.837917  8197 raft_consensus.cc:740] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.839190  8194 tablet_bootstrap.cc:492] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.838824  8197 consensus_queue.cc:260] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.839727  8194 ts_tablet_manager.cc:1403] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.016s
I20260709 13:03:22.839741  7822 catalog_manager.cc:5697] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.843477  8194 raft_consensus.cc:359] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.844647  8194 raft_consensus.cc:385] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.845101  8194 raft_consensus.cc:740] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.846436  8194 consensus_queue.cc:260] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.849363  8197 ts_tablet_manager.cc:1434] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:03:22.853714  8198 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:22.851150  8194 ts_tablet_manager.cc:1434] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:03:22.854281  8198 ts_tablet_manager.cc:1403] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.044s
I20260709 13:03:22.854535  8195 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:22.855029  8195 ts_tablet_manager.cc:1403] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.018s
I20260709 13:03:22.855116  8194 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.856194  8219 raft_consensus.cc:493] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.856667  8219 raft_consensus.cc:515] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.857618  8198 raft_consensus.cc:359] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.859018  8219 leader_election.cc:290] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:22.854173  8197 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.859655  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.860319  8150 raft_consensus.cc:2468] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:22.860515  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.861150  7926 raft_consensus.cc:2468] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:22.861697  8195 raft_consensus.cc:359] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.862358  8195 raft_consensus.cc:385] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.862479  7967 leader_election.cc:304] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.862685  8195 raft_consensus.cc:740] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.863407  8219 raft_consensus.cc:2804] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.864249  8195 consensus_queue.cc:260] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.864621  8219 raft_consensus.cc:493] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.858400  8198 raft_consensus.cc:385] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.865039  8219 raft_consensus.cc:3060] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.865458  8198 raft_consensus.cc:740] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.866320  8198 consensus_queue.cc:260] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.868630  8198 ts_tablet_manager.cc:1434] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:03:22.872323  8195 ts_tablet_manager.cc:1434] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:03:22.873325  8195 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:22.875437  8194 tablet_bootstrap.cc:654] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.877885  8219 raft_consensus.cc:515] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.879307  8195 tablet_bootstrap.cc:654] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.879647  8197 tablet_bootstrap.cc:654] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.881384  8198 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.883172  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:22.884004  8150 raft_consensus.cc:3060] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.887250  8204 raft_consensus.cc:493] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.887960  8204 raft_consensus.cc:515] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.888549  8194 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:22.889595  8198 tablet_bootstrap.cc:654] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.889765  8194 ts_tablet_manager.cc:1403] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 13:03:22.892345  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:22.892411  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.892776  8194 raft_consensus.cc:359] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.893172  7926 raft_consensus.cc:3060] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.893488  8219 leader_election.cc:290] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:22.894701  8039 leader_election.cc:343] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.903719  7926 raft_consensus.cc:2468] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:22.904567  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.905566  8149 raft_consensus.cc:2468] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:22.905483  7967 leader_election.cc:304] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.907327  8219 raft_consensus.cc:2804] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:22.907820  8219 raft_consensus.cc:697] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:22.908459  8041 leader_election.cc:304] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:22.908648  8197 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:22.908597  8219 consensus_queue.cc:237] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.910060  8197 ts_tablet_manager.cc:1403] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.056s	user 0.005s	sys 0.009s
I20260709 13:03:22.912972  8247 raft_consensus.cc:2804] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.913457  8247 raft_consensus.cc:493] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.913889  8247 raft_consensus.cc:3060] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.914975  8197 raft_consensus.cc:359] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.915967  8197 raft_consensus.cc:385] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.916303  8197 raft_consensus.cc:740] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.917246  8197 consensus_queue.cc:260] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.910475  8194 raft_consensus.cc:385] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.918493  8194 raft_consensus.cc:740] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.910046  8204 leader_election.cc:290] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:22.919590  8229 raft_consensus.cc:493] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.920280  8229 raft_consensus.cc:515] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:22.924516  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:22.920298  8194 consensus_queue.cc:260] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.928350  8229 leader_election.cc:290] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:22.927724  8041 leader_election.cc:343] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.931584  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.932420  8197 ts_tablet_manager.cc:1434] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:03:22.934052  8194 ts_tablet_manager.cc:1434] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:03:22.935472  8194 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:22.939697  8197 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:22.940346  8199 raft_consensus.cc:493] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.940896  8198 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:22.940845  8199 raft_consensus.cc:515] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.941500  8198 ts_tablet_manager.cc:1403] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.013s
I20260709 13:03:22.943288  8199 leader_election.cc:290] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
W20260709 13:03:22.944548  8041 leader_election.cc:343] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.945106  8041 leader_election.cc:304] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:22.944839  8198 raft_consensus.cc:359] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.945792  8198 raft_consensus.cc:385] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:22.945775  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:22.946305  8198 raft_consensus.cc:740] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:22.946604  8076 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:22.946674  8229 raft_consensus.cc:2749] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:22.947209  8198 consensus_queue.cc:260] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.948019  7967 leader_election.cc:304] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.948889  8199 raft_consensus.cc:2804] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.949375  8232 raft_consensus.cc:493] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.949965  8198 ts_tablet_manager.cc:1434] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:03:22.950064  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.950176  8232 raft_consensus.cc:515] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:22.950932  7926 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:22.951157  8198 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:22.949247  8199 raft_consensus.cc:493] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.952885  8199 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.953210  8232 leader_election.cc:290] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:22.957163  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.958115  8002 raft_consensus.cc:2468] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:22.959926  8113 leader_election.cc:304] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.958474  8198 tablet_bootstrap.cc:654] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:22.965700  8232 raft_consensus.cc:2804] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.966320  8232 raft_consensus.cc:493] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.966856  8232 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.968125  8199 raft_consensus.cc:515] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:22.972579  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:22.973383  7927 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:22.977660  8229 raft_consensus.cc:493] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.978489  8229 raft_consensus.cc:515] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:22.982468  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:22.983492  8002 raft_consensus.cc:2468] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:22.985260  8039 leader_election.cc:304] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:22.986857  8204 raft_consensus.cc:2804] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:22.986912  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:22.987511  8204 raft_consensus.cc:493] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.988026  8204 raft_consensus.cc:3060] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:22.994508  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:03:22.995589  8115 leader_election.cc:343] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:22.993160  8229 leader_election.cc:290] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.001149  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:23.002242  8149 raft_consensus.cc:2468] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:23.009845  8194 tablet_bootstrap.cc:654] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.011235  8247 raft_consensus.cc:515] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.015412  7927 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:23.018963  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
W20260709 13:03:23.021183  8039 leader_election.cc:343] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.015465  8150 raft_consensus.cc:2468] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:23.025650  8204 raft_consensus.cc:515] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.027894  8197 tablet_bootstrap.cc:654] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.031562  8199 leader_election.cc:290] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.005499  7825 catalog_manager.cc:5697] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.032783  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:23.033401  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:23.033704  7967 leader_election.cc:304] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.034420  8150 raft_consensus.cc:3060] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.033416  8076 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.035107  8199 raft_consensus.cc:2804] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.035828  8199 raft_consensus.cc:697] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:23.036935  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:23.036698  8199 consensus_queue.cc:237] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.037523  8002 raft_consensus.cc:3060] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.046680  8247 leader_election.cc:290] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.061086  8150 raft_consensus.cc:2468] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:23.048687  8232 raft_consensus.cc:515] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.064622  8232 leader_election.cc:290] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.051952  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec19762f6a5e40eea7215e9981f34f9f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:23.065923  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:23.066133  8149 raft_consensus.cc:3060] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.066520  8001 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.071874  8001 raft_consensus.cc:2468] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.047195  8002 raft_consensus.cc:2468] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:23.072702  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:23.073287  8039 leader_election.cc:304] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.071522  8041 leader_election.cc:304] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:23.052395  8076 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:23.077142  8229 raft_consensus.cc:2804] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.075907  8247 raft_consensus.cc:2804] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:23.075136  8115 leader_election.cc:343] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.087031  7825 catalog_manager.cc:5697] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.082540  8194 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:23.090406  8194 ts_tablet_manager.cc:1403] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.000s
I20260709 13:03:23.075640  8204 leader_election.cc:290] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.107787  8247 raft_consensus.cc:697] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:23.111035  8149 raft_consensus.cc:2468] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:23.108048  8229 raft_consensus.cc:697] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:23.112650  8113 leader_election.cc:304] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:23.113471  8197 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:23.113143  8229 consensus_queue.cc:237] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.113881  8232 raft_consensus.cc:2804] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.114148  8197 ts_tablet_manager.cc:1403] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.029s
I20260709 13:03:23.114998  8195 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:23.115491  8195 ts_tablet_manager.cc:1403] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.242s	user 0.069s	sys 0.117s
I20260709 13:03:23.118049  8197 raft_consensus.cc:359] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.118834  8197 raft_consensus.cc:385] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.119140  8197 raft_consensus.cc:740] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.119696  8194 raft_consensus.cc:359] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.120381  8194 raft_consensus.cc:385] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.119962  8197 consensus_queue.cc:260] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.120651  8194 raft_consensus.cc:740] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.123461  8198 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:23.124178  8198 ts_tablet_manager.cc:1403] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.173s	user 0.055s	sys 0.044s
I20260709 13:03:23.123909  8194 consensus_queue.cc:260] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.129310  8197 ts_tablet_manager.cc:1434] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:03:23.127426  8247 consensus_queue.cc:237] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.131189  8197 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:23.132918  8194 ts_tablet_manager.cc:1434] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:03:23.133998  8194 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:23.134879  8199 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.135466  8199 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.132761  8195 raft_consensus.cc:359] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.136620  8195 raft_consensus.cc:385] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.137010  8195 raft_consensus.cc:740] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.137579  8199 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:23.138846  8197 tablet_bootstrap.cc:654] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.140328  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.140924  8232 raft_consensus.cc:697] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:23.140331  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:23.142171  8232 consensus_queue.cc:237] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:23.143085  7967 leader_election.cc:343] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:23.143829  7967 leader_election.cc:343] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.144234  7967 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:23.144953  8199 raft_consensus.cc:2749] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.146677  8195 consensus_queue.cc:260] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.150385  8198 raft_consensus.cc:359] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.151474  8198 raft_consensus.cc:385] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.151862  8198 raft_consensus.cc:740] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.154695  8195 ts_tablet_manager.cc:1434] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:03:23.158872  8195 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:23.159065  8272 raft_consensus.cc:493] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.159823  8272 raft_consensus.cc:515] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.163673  8198 consensus_queue.cc:260] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.166958  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.167634  8076 raft_consensus.cc:2468] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:23.168964  8115 leader_election.cc:304] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:23.169906  8274 raft_consensus.cc:2804] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.170270  8274 raft_consensus.cc:493] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.170651  8274 raft_consensus.cc:3060] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.181201  8218 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.182015  8218 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.186767  8274 raft_consensus.cc:515] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.189678  8274 leader_election.cc:290] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:23.191195  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:23.230906  7825 catalog_manager.cc:5697] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.232239  7926 raft_consensus.cc:3060] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.232606  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.234131  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.235311  8198 ts_tablet_manager.cc:1434] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.111s	user 0.012s	sys 0.001s
I20260709 13:03:23.208794  8272 leader_election.cc:290] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:23.237188  8194 tablet_bootstrap.cc:654] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.193327  7925 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.210225  8247 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.240995  8247 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.243824  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.221128  8232 raft_consensus.cc:493] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.228868  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d38630e1dc34ceb9665dd2a25e61ddb" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:23.245906  8218 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.248059  8075 raft_consensus.cc:3060] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.248495  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:23.249269  8149 raft_consensus.cc:2393] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb658b087424b87887d5bfef62d8084 in current term 1: Already voted for candidate 8e7be6d583414e048a2528f06bc9bb4f in this term.
I20260709 13:03:23.250428  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:23.251246  8001 raft_consensus.cc:2393] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
I20260709 13:03:23.252909  8039 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:23.253777  8195 tablet_bootstrap.cc:654] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.255797  8229 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.253628  8198 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:23.257315  8197 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:23.255174  7825 catalog_manager.cc:5697] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.258179  8197 ts_tablet_manager.cc:1403] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.127s	user 0.025s	sys 0.008s
I20260709 13:03:23.261065  8197 raft_consensus.cc:359] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.261616  8194 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:23.261713  8197 raft_consensus.cc:385] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.262089  8197 raft_consensus.cc:740] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.262187  8194 ts_tablet_manager.cc:1403] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.005s
I20260709 13:03:23.252112  8232 raft_consensus.cc:515] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.263978  8271 consensus_queue.cc:1048] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.265314  8194 raft_consensus.cc:359] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.252359  8247 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.266040  8194 raft_consensus.cc:385] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.267088  8194 raft_consensus.cc:740] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.266238  8197 consensus_queue.cc:260] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.268538  7892 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:23.269570  8218 raft_consensus.cc:2749] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.269896  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:23.270430  8001 raft_consensus.cc:2468] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:23.269541  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.272130  8113 leader_election.cc:304] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.272938  8274 raft_consensus.cc:2804] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.273411  8274 raft_consensus.cc:493] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.274914  8274 raft_consensus.cc:3060] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:23.277200  8115 leader_election.cc:343] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.277746  8232 leader_election.cc:290] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.253347  7822 catalog_manager.cc:5697] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.278374  8271 consensus_queue.cc:1048] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:23.282192  8229 raft_consensus.cc:2749] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.285257  8274 raft_consensus.cc:515] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.286928  8198 tablet_bootstrap.cc:654] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.287421  7926 raft_consensus.cc:2468] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.293727  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:23.295738  8115 leader_election.cc:304] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:23.296660  8232 raft_consensus.cc:2804] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:03:23.296787  8115 leader_election.cc:343] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.297209  8232 raft_consensus.cc:697] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:23.298203  8232 consensus_queue.cc:237] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.289278  8194 consensus_queue.cc:260] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.300755  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a88bacd650e3448a85930d7b4d92ee0d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:23.301163  8194 ts_tablet_manager.cc:1434] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:03:23.301460  8001 raft_consensus.cc:3060] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.301581  8075 raft_consensus.cc:2468] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.302280  8194 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:23.311163  8197 ts_tablet_manager.cc:1434] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.053s	user 0.001s	sys 0.005s
I20260709 13:03:23.353561  8219 consensus_queue.cc:1048] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.303874  8274 leader_election.cc:290] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.385680  8197 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:23.394788  8195 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:23.396399  8195 ts_tablet_manager.cc:1403] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.013s
I20260709 13:03:23.441093  8219 consensus_queue.cc:1048] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.452195  8219 consensus_queue.cc:1048] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:23.388055  8115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45223, user_credentials={real_user=slave}} blocked reactor thread for 71969.1us
I20260709 13:03:23.469609  8232 raft_consensus.cc:493] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.470247  8232 raft_consensus.cc:515] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.470728  8218 consensus_queue.cc:1048] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.473021  8232 leader_election.cc:290] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:23.475677  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.468127  8219 consensus_queue.cc:1048] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.510591  8194 tablet_bootstrap.cc:654] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.522349  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.523391  8075 raft_consensus.cc:2468] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
W20260709 13:03:23.532217  8039 consensus_peers.cc:597] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:23.538931  8115 leader_election.cc:343] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.540272  8115 leader_election.cc:304] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:23.542699  8232 raft_consensus.cc:2804] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:23.543187  8232 raft_consensus.cc:493] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.543627  8232 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.547487  8001 raft_consensus.cc:2468] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.550822  8198 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:23.551453  8288 raft_consensus.cc:493] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.553571  8288 raft_consensus.cc:515] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.554051  8113 leader_election.cc:304] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:23.555573  8274 raft_consensus.cc:2804] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.556125  8274 raft_consensus.cc:697] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:23.556173  8288 leader_election.cc:290] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.557017  8274 consensus_queue.cc:237] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.558166  8198 ts_tablet_manager.cc:1403] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.311s	user 0.051s	sys 0.074s
I20260709 13:03:23.558130  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:23.552716  8287 consensus_queue.cc:1048] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.562495  8198 raft_consensus.cc:359] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.564534  8198 raft_consensus.cc:385] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.564903  8198 raft_consensus.cc:740] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.565739  8198 consensus_queue.cc:260] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.557344  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:23.574307  8195 raft_consensus.cc:359] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.575057  8198 ts_tablet_manager.cc:1434] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:03:23.575256  8195 raft_consensus.cc:385] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.577374  8195 raft_consensus.cc:740] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.582986  8198 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:23.591961  8197 tablet_bootstrap.cc:654] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.583465  8195 consensus_queue.cc:260] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.586246  7822 catalog_manager.cc:5697] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.619899  8195 ts_tablet_manager.cc:1434] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.223s	user 0.010s	sys 0.000s
I20260709 13:03:23.617262  8001 raft_consensus.cc:2393] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb658b087424b87887d5bfef62d8084 in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:23.624677  8195 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:23.614711  8272 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.629609  8294 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.635007  8295 raft_consensus.cc:493] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.635603  8295 raft_consensus.cc:515] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.638181  8295 leader_election.cc:290] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.640092  8198 tablet_bootstrap.cc:654] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.646757  8197 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:23.647311  8197 ts_tablet_manager.cc:1403] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.335s	user 0.025s	sys 0.008s
I20260709 13:03:23.631898  8272 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.650425  8197 raft_consensus.cc:359] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.651298  8197 raft_consensus.cc:385] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.651647  8197 raft_consensus.cc:740] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.652369  8197 consensus_queue.cc:260] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.661044  8232 raft_consensus.cc:515] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.663338  8272 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:23.633495  8294 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.665072  8195 tablet_bootstrap.cc:654] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.665839  8294 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.668982  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:23.670665  8113 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.673272  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.673939  7927 raft_consensus.cc:2468] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:23.674963  7890 leader_election.cc:304] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:23.675117  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.676157  8287 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.676034  8204 consensus_queue.cc:1048] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:23.676964  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.677726  8074 raft_consensus.cc:2468] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:23.680183  8194 tablet_bootstrap.cc:492] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:23.680661  8194 ts_tablet_manager.cc:1403] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.379s	user 0.011s	sys 0.018s
I20260709 13:03:23.683754  8197 ts_tablet_manager.cc:1434] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:03:23.684594  8197 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:23.687893  8204 consensus_queue.cc:1048] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:23.689805  7967 leader_election.cc:304] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.691202  8199 raft_consensus.cc:2804] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:23.691524  8115 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.693621  8115 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:23.691581  8199 raft_consensus.cc:493] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.705787  8272 raft_consensus.cc:2749] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.708431  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:23.709129  8074 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.708882  8298 consensus_queue.cc:1048] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.717973  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:23.720199  8194 raft_consensus.cc:359] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.720934  8194 raft_consensus.cc:385] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.721194  8194 raft_consensus.cc:740] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.722494  8194 consensus_queue.cc:260] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.725816  8194 ts_tablet_manager.cc:1434] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:03:23.727082  8194 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:23.701442  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.711022  8199 raft_consensus.cc:3060] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.746496  8195 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:23.747246  8195 ts_tablet_manager.cc:1403] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.012s
I20260709 13:03:23.750044  8194 tablet_bootstrap.cc:654] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.751964  8195 raft_consensus.cc:359] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.752745  8195 raft_consensus.cc:385] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.741786  8232 leader_election.cc:290] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:23.753171  8195 raft_consensus.cc:740] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
W20260709 13:03:23.752185  7967 leader_election.cc:343] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.755091  8195 consensus_queue.cc:260] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:23.743259  7890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 45852.8us
W20260709 13:03:23.758140  7967 leader_election.cc:343] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.758580  7967 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:23.764550  8294 raft_consensus.cc:2749] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.769973  8195 ts_tablet_manager.cc:1434] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:03:23.771210  8195 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:23.773269  8199 raft_consensus.cc:515] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.775648  8287 raft_consensus.cc:2749] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.776986  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:23.783650  8197 tablet_bootstrap.cc:654] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.783927  7926 raft_consensus.cc:3060] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.793438  8271 raft_consensus.cc:493] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.794050  8271 raft_consensus.cc:515] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.796424  8074 raft_consensus.cc:2468] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.796602  8271 leader_election.cc:290] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.797967  8199 leader_election.cc:290] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.800541  8195 tablet_bootstrap.cc:654] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.803900  8115 leader_election.cc:304] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:23.805187  8298 raft_consensus.cc:2804] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.805326  8232 consensus_queue.cc:1048] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:23.805737  8298 raft_consensus.cc:697] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:23.805948  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:23.806768  7925 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.806674  8298 consensus_queue.cc:237] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.808373  8204 consensus_queue.cc:1048] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:23.813882  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:23.815215  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:23.816731  8041 leader_election.cc:343] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.821976  8194 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:23.822525  8194 ts_tablet_manager.cc:1403] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.096s	user 0.012s	sys 0.000s
I20260709 13:03:23.824277  7825 catalog_manager.cc:5697] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.825312  8194 raft_consensus.cc:359] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.826051  8194 raft_consensus.cc:385] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.826337  8194 raft_consensus.cc:740] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.827052  8194 consensus_queue.cc:260] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.829160  8194 ts_tablet_manager.cc:1434] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:03:23.830121  8194 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:23.808395  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a34bc926b47b4f1d886de1ccee78479a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:23.811652  7926 raft_consensus.cc:2468] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:23.817178  8274 consensus_queue.cc:1048] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
W20260709 13:03:23.841382  8039 leader_election.cc:343] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:23.845714  8074 raft_consensus.cc:3060] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:23.880369  8295 raft_consensus.cc:493] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.882167  8272 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.883579  8295 raft_consensus.cc:515] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.883949  8272 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.885893  8295 leader_election.cc:290] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:23.886390  8197 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:23.887087  8197 ts_tablet_manager.cc:1403] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.203s	user 0.042s	sys 0.016s
I20260709 13:03:23.887283  8272 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.889410  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:23.890103  8002 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.891043  8197 raft_consensus.cc:359] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.891345  8113 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.891412  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.891983  8197 raft_consensus.cc:385] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.894507  8197 raft_consensus.cc:740] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.895949  8076 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.897030  7967 leader_election.cc:304] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.897245  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:23.882925  8039 leader_election.cc:304] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
W20260709 13:03:23.902596  8039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 61718.8us
I20260709 13:03:23.902787  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:23.903695  8271 raft_consensus.cc:2749] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.905830  7967 leader_election.cc:304] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:23.907418  8199 raft_consensus.cc:2804] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:23.907994  8199 raft_consensus.cc:697] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:23.908231  8307 raft_consensus.cc:2749] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:23.908907  8199 consensus_queue.cc:237] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:23.911309  8272 raft_consensus.cc:2804] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:23.911724  8272 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.912077  8272 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.921861  8232 consensus_queue.cc:1048] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:23.926170  8197 consensus_queue.cc:260] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.922343  7925 raft_consensus.cc:2468] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:23.940131  8197 ts_tablet_manager.cc:1434] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:03:23.941201  8197 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:23.942108  8198 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:23.942603  8198 ts_tablet_manager.cc:1403] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.360s	user 0.014s	sys 0.008s
I20260709 13:03:23.949287  8198 raft_consensus.cc:359] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.949998  8198 raft_consensus.cc:385] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.950273  8198 raft_consensus.cc:740] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.955531  8198 consensus_queue.cc:260] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:23.957439  7824 catalog_manager.cc:5697] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.962589  8195 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:23.957890  8198 ts_tablet_manager.cc:1434] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:03:23.964236  8195 ts_tablet_manager.cc:1403] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.193s	user 0.038s	sys 0.027s
I20260709 13:03:23.965036  8198 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:23.963637  8074 raft_consensus.cc:2468] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:23.971275  8272 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:23.971357  8195 raft_consensus.cc:359] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.972415  8195 raft_consensus.cc:385] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:23.972805  8195 raft_consensus.cc:740] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:23.973506  8195 consensus_queue.cc:260] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:23.974412  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:23.975049  8001 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:23.975783  8195 ts_tablet_manager.cc:1434] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:23.976823  8195 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:23.979918  8198 tablet_bootstrap.cc:654] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.982589  8195 tablet_bootstrap.cc:654] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.984424  7825 catalog_manager.cc:5697] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.987401  8197 tablet_bootstrap.cc:654] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:23.995090  8001 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:23.997269  8113 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:23.998126  8232 raft_consensus.cc:2804] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:23.998629  8232 raft_consensus.cc:697] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:23.999310  8272 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:23.999460  8232 consensus_queue.cc:237] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.003219  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:24.013456  8194 tablet_bootstrap.cc:654] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.017131  8075 raft_consensus.cc:3060] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:24.025504  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:24.034543  8075 raft_consensus.cc:2468] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:24.040653  8001 raft_consensus.cc:3060] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.048671  8298 raft_consensus.cc:493] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.049561  8298 raft_consensus.cc:515] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.053603  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:24.055677  8113 leader_election.cc:343] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.057235  8298 leader_election.cc:290] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:24.066056  8194 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:24.067054  8194 ts_tablet_manager.cc:1403] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.237s	user 0.015s	sys 0.002s
I20260709 13:03:24.068495  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:24.070255  8115 leader_election.cc:343] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.070766  8115 leader_election.cc:304] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.071893  8298 raft_consensus.cc:2749] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.080647  8197 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:24.081125  8198 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:24.081192  8197 ts_tablet_manager.cc:1403] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.140s	user 0.046s	sys 0.034s
I20260709 13:03:24.081957  8198 ts_tablet_manager.cc:1403] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.013s
I20260709 13:03:24.083683  8194 raft_consensus.cc:359] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.084015  8197 raft_consensus.cc:359] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.084565  8194 raft_consensus.cc:385] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.084666  8197 raft_consensus.cc:385] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.084944  8194 raft_consensus.cc:740] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.085109  8197 raft_consensus.cc:740] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.085954  8194 consensus_queue.cc:260] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.087723  8198 raft_consensus.cc:359] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.088238  8198 raft_consensus.cc:385] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.085951  8197 consensus_queue.cc:260] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.088364  8194 ts_tablet_manager.cc:1434] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:24.088508  8198 raft_consensus.cc:740] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.089772  8198 consensus_queue.cc:260] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.089710  7823 catalog_manager.cc:5697] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 2, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.091284  8197 ts_tablet_manager.cc:1434] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:24.091934  8198 ts_tablet_manager.cc:1434] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:24.092175  8197 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:24.094180  8195 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:24.094696  8195 ts_tablet_manager.cc:1403] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.118s	user 0.036s	sys 0.024s
I20260709 13:03:24.089759  8194 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:24.097335  8195 raft_consensus.cc:359] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.097977  8195 raft_consensus.cc:385] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.099261  8198 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:24.104075  8194 tablet_bootstrap.cc:654] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.105736  8198 tablet_bootstrap.cc:654] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.107504  8197 tablet_bootstrap.cc:654] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.098254  8195 raft_consensus.cc:740] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.119256  8195 consensus_queue.cc:260] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.119911  8198 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:24.120589  8198 ts_tablet_manager.cc:1403] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:03:24.121541  8194 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:24.122149  8194 ts_tablet_manager.cc:1403] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.005s
I20260709 13:03:24.123394  7927 raft_consensus.cc:3060] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.123919  8198 raft_consensus.cc:359] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.124647  8198 raft_consensus.cc:385] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.124970  8198 raft_consensus.cc:740] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.125276  8232 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.125973  8232 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.129469  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.130129  8002 raft_consensus.cc:2468] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:24.131019  8298 raft_consensus.cc:493] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.131717  8298 raft_consensus.cc:515] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.132287  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:24.133080  8113 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
W20260709 13:03:24.133898  8115 leader_election.cc:343] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.134033  8272 raft_consensus.cc:2804] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.134449  8272 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.134896  8272 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.135866  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:24.137363  8115 leader_election.cc:343] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.139400  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.140053  8075 raft_consensus.cc:2468] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:24.142318  8115 leader_election.cc:304] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:24.134522  8298 leader_election.cc:290] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:24.125932  8198 consensus_queue.cc:260] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.144831  8232 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.148041  8195 ts_tablet_manager.cc:1434] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:03:24.149425  8195 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:24.171314  8232 consensus_queue.cc:1048] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:24.166512  8295 raft_consensus.cc:493] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.173493  8331 consensus_queue.cc:1048] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.178000  8272 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.180127  8272 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.173669  8295 raft_consensus.cc:515] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.187285  8295 leader_election.cc:290] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:24.171541  8298 raft_consensus.cc:2804] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.188015  8298 raft_consensus.cc:493] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.188458  8298 raft_consensus.cc:3060] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.192557  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.192775  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:24.193246  8075 raft_consensus.cc:2468] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:24.193434  8198 ts_tablet_manager.cc:1434] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
W20260709 13:03:24.194252  7967 leader_election.cc:343] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.194479  8198 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:24.195215  7967 leader_election.cc:304] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:24.196923  8199 raft_consensus.cc:2804] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.197393  8199 raft_consensus.cc:493] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.197831  8199 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.202785  8288 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.203339  8288 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.209375  8197 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:24.211349  8247 raft_consensus.cc:493] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.216727  8247 raft_consensus.cc:515] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.217401  8288 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:24.218808  8247 leader_election.cc:290] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:24.219501  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.217047  8197 ts_tablet_manager.cc:1403] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.125s	user 0.031s	sys 0.027s
I20260709 13:03:24.219978  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.220683  8001 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:24.221207  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.221725  7890 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:24.222581  8288 raft_consensus.cc:2804] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:24.222752  8039 leader_election.cc:343] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.223026  8288 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.223543  8288 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.222918  8199 raft_consensus.cc:515] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.223742  8198 tablet_bootstrap.cc:654] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.224635  8195 tablet_bootstrap.cc:654] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.229278  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
W20260709 13:03:24.223863  7892 leader_election.cc:343] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.237584  8197 raft_consensus.cc:359] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.238508  8197 raft_consensus.cc:385] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.238955  8197 raft_consensus.cc:740] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.239261  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:24.239975  8075 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.242026  8194 raft_consensus.cc:359] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.242750  8194 raft_consensus.cc:385] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.243001  8194 raft_consensus.cc:740] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.243659  8194 consensus_queue.cc:260] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.244096  8288 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.245472  8197 consensus_queue.cc:260] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.246219  8298 raft_consensus.cc:515] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.246838  8288 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:24.248055  8197 ts_tablet_manager.cc:1434] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:03:24.248262  8075 raft_consensus.cc:2468] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
W20260709 13:03:24.248314  8115 leader_election.cc:343] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.249140  8197 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:24.250638  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:24.251547  8149 raft_consensus.cc:2468] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:24.239916  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:24.225447  8199 leader_election.cc:290] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
W20260709 13:03:24.254805  8113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 110349us
I20260709 13:03:24.255245  8298 leader_election.cc:290] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:24.256337  8197 tablet_bootstrap.cc:654] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.256913  8194 ts_tablet_manager.cc:1434] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.134s	user 0.000s	sys 0.008s
I20260709 13:03:24.257880  8194 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:24.250811  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:24.298169  8075 raft_consensus.cc:3060] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.300535  8288 raft_consensus.cc:493] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.301821  8288 raft_consensus.cc:515] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.303401  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:24.304440  8197 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:24.305570  8197 ts_tablet_manager.cc:1403] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.057s	user 0.002s	sys 0.010s
I20260709 13:03:24.305794  8288 leader_election.cc:290] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:24.313793  8115 leader_election.cc:343] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.318763  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:24.320190  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.320770  8001 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.321049  8041 leader_election.cc:304] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.322686  8247 raft_consensus.cc:2804] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.323244  8247 raft_consensus.cc:493] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.323655  8247 raft_consensus.cc:3060] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.327208  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:24.327996  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.328329  8002 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.319345  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
W20260709 13:03:24.334160  7892 leader_election.cc:343] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:24.335604  7967 leader_election.cc:343] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.336884  7967 leader_election.cc:304] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:24.337100  8001 raft_consensus.cc:2468] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:24.338399  8199 raft_consensus.cc:2804] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.339226  8199 raft_consensus.cc:697] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:24.339519  7890 leader_election.cc:304] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.340726  8199 consensus_queue.cc:237] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.342456  8305 raft_consensus.cc:2749] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.343626  8113 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:24.345625  8298 raft_consensus.cc:2804] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.346261  8298 raft_consensus.cc:697] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:24.346925  8247 raft_consensus.cc:515] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.347808  8298 consensus_queue.cc:237] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.353269  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:24.355259  8331 consensus_queue.cc:1048] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:03:24.357098  8039 leader_election.cc:343] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.359925  8195 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:24.362588  8195 ts_tablet_manager.cc:1403] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.000s
I20260709 13:03:24.365569  8194 tablet_bootstrap.cc:654] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.374776  8198 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:24.375739  8198 ts_tablet_manager.cc:1403] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.182s	user 0.015s	sys 0.007s
I20260709 13:03:24.381467  8197 raft_consensus.cc:359] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.382380  8197 raft_consensus.cc:385] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.383616  8197 raft_consensus.cc:740] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.388569  8295 consensus_queue.cc:1048] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:03:24.390050  8247 leader_election.cc:290] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:24.391822  8197 consensus_queue.cc:260] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.397770  8195 raft_consensus.cc:359] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.400256  8195 raft_consensus.cc:385] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.400487  8195 raft_consensus.cc:740] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.403182  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:24.404605  8150 raft_consensus.cc:3060] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.407011  8194 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:24.408587  8194 ts_tablet_manager.cc:1403] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.151s	user 0.015s	sys 0.013s
I20260709 13:03:24.409938  8002 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:24.415107  8198 raft_consensus.cc:359] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.416159  8198 raft_consensus.cc:385] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.416507  8198 raft_consensus.cc:740] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.417076  8331 consensus_queue.cc:1048] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.417457  8198 consensus_queue.cc:260] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.419951  8195 consensus_queue.cc:260] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.422305  7890 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:24.422974  8194 raft_consensus.cc:359] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.423772  8194 raft_consensus.cc:385] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.424068  8194 raft_consensus.cc:740] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.425364  8197 ts_tablet_manager.cc:1434] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.119s	user 0.010s	sys 0.003s
I20260709 13:03:24.425608  8075 raft_consensus.cc:2468] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:24.425750  8194 consensus_queue.cc:260] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.434242  8195 ts_tablet_manager.cc:1434] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.004s
I20260709 13:03:24.436415  8195 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:24.433529  8115 leader_election.cc:304] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:24.441994  8274 raft_consensus.cc:2804] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.442678  8274 raft_consensus.cc:697] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:24.444025  8288 raft_consensus.cc:2804] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.444731  8288 raft_consensus.cc:697] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:24.445573  8274 consensus_queue.cc:237] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.452939  8198 ts_tablet_manager.cc:1434] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.077s	user 0.002s	sys 0.008s
I20260709 13:03:24.451311  8150 raft_consensus.cc:2468] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:24.446213  8288 consensus_queue.cc:237] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.476006  8198 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:24.478004  8194 ts_tablet_manager.cc:1434] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:03:24.483862  8197 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:24.491890  8199 consensus_queue.cc:1048] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.493660  8041 leader_election.cc:304] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.494719  8204 raft_consensus.cc:2804] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.495217  8204 raft_consensus.cc:697] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
W20260709 13:03:24.495749  8338 log.cc:927] Time spent T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:24.496337  8204 consensus_queue.cc:237] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.499954  7925 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.515885  8305 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.516546  8305 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.517606  8194 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:24.520537  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:24.521380  8197 tablet_bootstrap.cc:654] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.521744  8149 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:24.532840  7892 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:24.535620  8288 raft_consensus.cc:2804] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.535868  8199 raft_consensus.cc:493] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.540562  8199 raft_consensus.cc:515] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.543355  8199 leader_election.cc:290] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:24.545614  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:24.547642  7967 leader_election.cc:343] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.548345  8288 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.532780  8305 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.549703  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.537612  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:24.556092  7890 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:24.557603  7967 leader_election.cc:343] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.559700  7967 leader_election.cc:304] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:24.561637  8295 raft_consensus.cc:2749] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.553272  8288 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.551501  8198 tablet_bootstrap.cc:654] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.575104  8295 raft_consensus.cc:493] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.584568  8295 raft_consensus.cc:515] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.591403  8195 tablet_bootstrap.cc:654] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.592394  8002 raft_consensus.cc:1275] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:24.595063  8298 consensus_queue.cc:1048] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:24.595521  8295 leader_election.cc:290] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:24.597481  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.597654  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:24.599035  7967 leader_election.cc:343] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:24.599834  7967 leader_election.cc:343] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.600306  7967 leader_election.cc:304] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:24.607197  8194 tablet_bootstrap.cc:654] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.604805  8199 raft_consensus.cc:2749] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.624557  8204 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.628425  8204 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.635139  8307 raft_consensus.cc:493] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.635758  8307 raft_consensus.cc:515] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.636842  8197 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:24.637473  8197 ts_tablet_manager.cc:1403] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.185s	user 0.017s	sys 0.034s
I20260709 13:03:24.638039  8307 leader_election.cc:290] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:24.640776  8197 raft_consensus.cc:359] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.640640  7823 catalog_manager.cc:5697] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.641644  8197 raft_consensus.cc:385] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.642115  8197 raft_consensus.cc:740] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.643138  8197 consensus_queue.cc:260] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.644147  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:24.644238  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:24.645058  8195 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:24.644958  8150 raft_consensus.cc:2468] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:24.643440  7823 catalog_manager.cc:5697] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.646667  8195 ts_tablet_manager.cc:1403] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.211s	user 0.011s	sys 0.007s
I20260709 13:03:24.653805  8075 raft_consensus.cc:1275] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:03:24.646010  7967 leader_election.cc:343] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.656268  7967 leader_election.cc:304] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:24.656694  8195 raft_consensus.cc:359] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.657382  8274 consensus_queue.cc:1048] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.657393  8199 raft_consensus.cc:2804] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.659857  8199 raft_consensus.cc:493] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.660267  8199 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.657452  8195 raft_consensus.cc:385] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.667140  8195 raft_consensus.cc:740] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.671110  8195 consensus_queue.cc:260] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.680545  8274 raft_consensus.cc:493] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.681602  8274 raft_consensus.cc:515] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.685237  8197 ts_tablet_manager.cc:1434] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:03:24.652599  7824 catalog_manager.cc:5697] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.712030  8204 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.712742  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:24.716343  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.717427  8002 raft_consensus.cc:2393] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
W20260709 13:03:24.720899  8347 log.cc:927] Time spent T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:03:24.721058  8350 log.cc:927] Time spent T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:03:24.731294  8197 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
W20260709 13:03:24.731508  8353 log.cc:927] Time spent T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:03:24.738754  8039 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.739598  8274 leader_election.cc:290] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.740110  8204 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.743057  8288 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.745885  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:24.746757  8194 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:24.747277  8194 ts_tablet_manager.cc:1403] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.021s
I20260709 13:03:24.747846  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:24.750063  8115 leader_election.cc:343] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.750099  8194 raft_consensus.cc:359] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.754222  8194 raft_consensus.cc:385] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.754637  8194 raft_consensus.cc:740] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
W20260709 13:03:24.754680  8113 leader_election.cc:343] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.755970  8113 leader_election.cc:304] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:24.761255  8194 consensus_queue.cc:260] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.762846  8298 raft_consensus.cc:2749] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.769153  8195 ts_tablet_manager.cc:1434] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.119s	user 0.021s	sys 0.020s
I20260709 13:03:24.778290  8194 ts_tablet_manager.cc:1434] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.001s
I20260709 13:03:24.782636  8288 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:24.783286  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:24.783950  8150 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.784718  8194 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:24.786590  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:24.787273  7999 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.793022  8194 tablet_bootstrap.cc:654] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.797097  8333 consensus_queue.cc:1048] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.797626  8195 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:24.802793  8197 tablet_bootstrap.cc:654] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.804436  8204 raft_consensus.cc:2749] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:24.817778  8198 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:24.803503  8199 raft_consensus.cc:515] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.818359  8198 ts_tablet_manager.cc:1403] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.343s	user 0.026s	sys 0.022s
I20260709 13:03:24.810900  8150 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:24.822896  7892 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:24.823828  8288 raft_consensus.cc:2804] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.823962  8195 tablet_bootstrap.cc:654] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.824436  8288 raft_consensus.cc:697] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:24.824246  8198 raft_consensus.cc:359] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.825047  8198 raft_consensus.cc:385] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.825372  8198 raft_consensus.cc:740] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.825366  8288 consensus_queue.cc:237] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.826436  8198 consensus_queue.cc:260] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.824156  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:24.828027  8150 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.829838  8198 ts_tablet_manager.cc:1434] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:24.832693  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:24.833326  8198 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:24.833365  7925 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.834400  8199 leader_election.cc:290] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:24.834651  8115 consensus_peers.cc:597] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.838376  8194 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:24.839339  8194 ts_tablet_manager.cc:1403] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.007s
I20260709 13:03:24.841048  8195 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:24.841593  8195 ts_tablet_manager.cc:1403] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.000s
I20260709 13:03:24.844425  8195 raft_consensus.cc:359] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.845103  8195 raft_consensus.cc:385] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.845378  8195 raft_consensus.cc:740] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.846020  8195 consensus_queue.cc:260] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.846429  7925 raft_consensus.cc:2468] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:24.852624  7967 leader_election.cc:304] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:24.853786  8295 raft_consensus.cc:2804] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.854326  8295 raft_consensus.cc:697] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:24.855399  8295 consensus_queue.cc:237] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:24.857358  7999 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:24.852715  8195 ts_tablet_manager.cc:1434] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:03:24.858325  8150 raft_consensus.cc:2468] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:24.863855  8195 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:24.867592  8272 raft_consensus.cc:493] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.868134  8272 raft_consensus.cc:515] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.867750  8198 tablet_bootstrap.cc:654] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.870309  8272 leader_election.cc:290] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:24.872547  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443d2e75298341fb8ac3a2a79d5bec05" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:24.874117  8076 raft_consensus.cc:2468] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:24.872792  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443d2e75298341fb8ac3a2a79d5bec05" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:24.876745  8115 leader_election.cc:304] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:24.879597  8272 raft_consensus.cc:2804] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:24.880365  8272 raft_consensus.cc:493] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.880945  8272 raft_consensus.cc:3060] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:24.884488  8115 leader_election.cc:343] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:24.894613  8198 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:24.897451  8198 ts_tablet_manager.cc:1403] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.007s
W20260709 13:03:24.907680  8115 consensus_peers.cc:597] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:24.892733  7822 catalog_manager.cc:5697] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:24.914028  8197 tablet_bootstrap.cc:492] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:24.914726  8197 ts_tablet_manager.cc:1403] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.184s	user 0.026s	sys 0.018s
I20260709 13:03:24.908572  8195 tablet_bootstrap.cc:654] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.917837  8197 raft_consensus.cc:359] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.918664  8197 raft_consensus.cc:385] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.919013  8197 raft_consensus.cc:740] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.919654  8272 raft_consensus.cc:515] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.919809  8197 consensus_queue.cc:260] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:24.922220  8272 leader_election.cc:290] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:24.922221  8197 ts_tablet_manager.cc:1434] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:24.922554  8198 raft_consensus.cc:359] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.922995  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443d2e75298341fb8ac3a2a79d5bec05" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:24.923323  8198 raft_consensus.cc:385] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.923781  8197 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:24.855368  8194 raft_consensus.cc:359] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.923691  8076 raft_consensus.cc:3060] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.924914  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "443d2e75298341fb8ac3a2a79d5bec05" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:24.927224  8194 raft_consensus.cc:385] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.927371  8195 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:24.927559  8194 raft_consensus.cc:740] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.928035  8195 ts_tablet_manager.cc:1403] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.007s
I20260709 13:03:24.928378  8194 consensus_queue.cc:260] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.929638  8288 consensus_queue.cc:1048] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:24.931105  8195 raft_consensus.cc:359] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.923668  8198 raft_consensus.cc:740] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.931241  8194 ts_tablet_manager.cc:1434] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:03:24.931833  8195 raft_consensus.cc:385] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:24.933905  8194 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:24.934933  8198 consensus_queue.cc:260] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.935835  7925 raft_consensus.cc:3060] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.938598  8150 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:24.940649  8197 tablet_bootstrap.cc:654] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.941862  8199 consensus_queue.cc:1048] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:24.943559  7925 raft_consensus.cc:2468] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:24.948575  8198 ts_tablet_manager.cc:1434] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:03:24.952225  8199 consensus_queue.cc:1048] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:24.955564  8198 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:24.955451  8115 leader_election.cc:304] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:24.959481  8274 raft_consensus.cc:2804] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:24.959970  8274 raft_consensus.cc:697] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:24.961131  8194 tablet_bootstrap.cc:654] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.960783  8274 consensus_queue.cc:237] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:24.932528  8076 raft_consensus.cc:2468] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:24.933135  8195 raft_consensus.cc:740] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:24.964488  8204 consensus_queue.cc:1048] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:24.964680  8195 consensus_queue.cc:260] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:24.968734  8198 tablet_bootstrap.cc:654] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:24.969498  8195 ts_tablet_manager.cc:1434] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:03:24.988824  8195 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:24.973822  7825 catalog_manager.cc:5697] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.001147  8197 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.001889  8197 ts_tablet_manager.cc:1403] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.013s
I20260709 13:03:25.009367  8348 consensus_queue.cc:1048] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:25.017812  8039 consensus_peers.cc:597] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.022121  8195 tablet_bootstrap.cc:654] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.022441  7824 catalog_manager.cc:5697] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.026310  8198 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:25.035898  8198 ts_tablet_manager.cc:1403] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.020s
I20260709 13:03:25.059337  8194 tablet_bootstrap.cc:492] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.059878  8194 ts_tablet_manager.cc:1403] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.001s
I20260709 13:03:25.061134  8195 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.061715  8195 ts_tablet_manager.cc:1403] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.006s
I20260709 13:03:25.064451  8195 raft_consensus.cc:359] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.065279  8195 raft_consensus.cc:385] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.065657  8195 raft_consensus.cc:740] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.066418  8195 consensus_queue.cc:260] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.067730  8197 raft_consensus.cc:359] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.068424  8197 raft_consensus.cc:385] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.068694  8197 raft_consensus.cc:740] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.069331  8197 consensus_queue.cc:260] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:25.070858  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:25.072572  8195 ts_tablet_manager.cc:1434] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:25.074187  8274 consensus_queue.cc:1048] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.074523  8195 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.075778  8197 ts_tablet_manager.cc:1434] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.004s
I20260709 13:03:25.076896  8197 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.083177  8197 tablet_bootstrap.cc:654] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.083881  8194 raft_consensus.cc:359] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.084582  8195 tablet_bootstrap.cc:654] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.085636  8198 raft_consensus.cc:359] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.086544  8198 raft_consensus.cc:385] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.086898  8198 raft_consensus.cc:740] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.087984  8198 consensus_queue.cc:260] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.084599  8194 raft_consensus.cc:385] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.090094  8194 raft_consensus.cc:740] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.090811  8194 consensus_queue.cc:260] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.090914  8198 ts_tablet_manager.cc:1434] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 13:03:25.092612  8198 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:25.093143  8194 ts_tablet_manager.cc:1434] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:03:25.094231  8197 tablet_bootstrap.cc:492] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.094398  8194 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.094725  8197 ts_tablet_manager.cc:1403] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.007s
I20260709 13:03:25.097436  8197 raft_consensus.cc:359] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.098033  8197 raft_consensus.cc:385] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.098304  8198 tablet_bootstrap.cc:654] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.098321  8197 raft_consensus.cc:740] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.099552  8197 consensus_queue.cc:260] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.102360  7825 catalog_manager.cc:5697] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.116339  8197 ts_tablet_manager.cc:1434] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:25.103340  8194 tablet_bootstrap.cc:654] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.125739  8298 raft_consensus.cc:493] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.126482  8298 raft_consensus.cc:515] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.130362  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:25.131330  7999 raft_consensus.cc:2468] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:25.132905  8113 leader_election.cc:304] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:25.134075  8333 raft_consensus.cc:2804] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.134562  8333 raft_consensus.cc:493] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.135025  8333 raft_consensus.cc:3060] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.135478  7823 catalog_manager.cc:5697] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.139411  8298 leader_election.cc:290] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:25.144533  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.145404  8076 raft_consensus.cc:2468] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:25.153095  8333 raft_consensus.cc:515] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.125172  8197 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.157956  8295 raft_consensus.cc:493] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.158769  8295 raft_consensus.cc:515] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.161697  8295 leader_election.cc:290] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.161922  8195 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.162508  8195 ts_tablet_manager.cc:1403] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.012s
I20260709 13:03:25.164747  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.165568  8195 raft_consensus.cc:359] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.166249  8195 raft_consensus.cc:385] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.164654  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e6273fa02f47668768e36dda283b31" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.166594  8195 raft_consensus.cc:740] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.167469  8195 consensus_queue.cc:260] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.168115  7967 leader_election.cc:304] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.169746  8199 raft_consensus.cc:2749] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.170660  8195 ts_tablet_manager.cc:1434] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:03:25.171759  8195 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.179436  8194 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.179940  8194 ts_tablet_manager.cc:1403] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.007s
I20260709 13:03:25.182646  8194 raft_consensus.cc:359] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.183308  8194 raft_consensus.cc:385] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.183617  8194 raft_consensus.cc:740] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.184530  8362 raft_consensus.cc:493] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.184895  8194 consensus_queue.cc:260] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.185077  8362 raft_consensus.cc:515] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.186895  8194 ts_tablet_manager.cc:1434] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:25.187987  8194 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.189438  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:25.190101  8002 raft_consensus.cc:2468] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:25.191164  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.192373  8362 leader_election.cc:290] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:25.193626  8041 leader_election.cc:343] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.194674  8199 raft_consensus.cc:493] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.195061  8039 leader_election.cc:304] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:25.195204  8199 raft_consensus.cc:515] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.196341  8358 raft_consensus.cc:2804] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.196720  8358 raft_consensus.cc:493] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.197055  8358 raft_consensus.cc:3060] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.197443  8199 leader_election.cc:290] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:25.199682  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:25.201359  7967 leader_election.cc:343] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.203714  8194 tablet_bootstrap.cc:654] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.209244  8272 raft_consensus.cc:493] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.209815  8272 raft_consensus.cc:515] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.211135  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.211845  8272 leader_election.cc:290] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:25.212596  7967 leader_election.cc:343] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.213117  7967 leader_election.cc:304] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:25.214262  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.215193  8295 raft_consensus.cc:2749] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.214423  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.215885  8195 tablet_bootstrap.cc:654] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:25.216248  8115 leader_election.cc:343] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.216081  8074 raft_consensus.cc:2468] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:25.211550  8358 raft_consensus.cc:515] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.224390  8115 leader_election.cc:304] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:25.226109  8232 raft_consensus.cc:2804] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.226370  8358 leader_election.cc:290] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:25.226635  8232 raft_consensus.cc:493] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.227136  8232 raft_consensus.cc:3060] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.228015  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:25.228907  7999 raft_consensus.cc:3060] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.230434  8195 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.231096  8195 ts_tablet_manager.cc:1403] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.011s
I20260709 13:03:25.224350  8194 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.231976  8194 ts_tablet_manager.cc:1403] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 13:03:25.232887  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cd5d1261c74e43bd9d09e591a5b6cd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
W20260709 13:03:25.234885  8041 leader_election.cc:343] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.234822  8194 raft_consensus.cc:359] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.235733  8194 raft_consensus.cc:385] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.236027  8194 raft_consensus.cc:740] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.237380  8197 tablet_bootstrap.cc:654] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.236778  8194 consensus_queue.cc:260] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.238250  8195 raft_consensus.cc:359] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.240537  8195 raft_consensus.cc:385] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.240811  8195 raft_consensus.cc:740] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.241609  8195 consensus_queue.cc:260] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.242826  8194 ts_tablet_manager.cc:1434] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:25.243999  8194 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.251632  8333 leader_election.cc:290] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:25.252930  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:25.253597  8002 raft_consensus.cc:3060] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.255659  8198 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:25.256183  8198 ts_tablet_manager.cc:1403] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.164s	user 0.042s	sys 0.066s
I20260709 13:03:25.256000  8232 raft_consensus.cc:515] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.253535  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c49d9b38fd47608c90fc8e709332dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:25.258970  8076 raft_consensus.cc:3060] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.259196  8198 raft_consensus.cc:359] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.259888  8198 raft_consensus.cc:385] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.259850  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:25.260514  8198 raft_consensus.cc:740] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.260731  8074 raft_consensus.cc:3060] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.261271  8198 consensus_queue.cc:260] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.265554  8348 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:25.267982  8198 ts_tablet_manager.cc:1434] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:25.269068  7999 raft_consensus.cc:2468] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:25.272729  8198 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:25.275497  8195 ts_tablet_manager.cc:1434] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:03:25.277024  8195 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.278072  8197 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.278576  8197 ts_tablet_manager.cc:1403] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.014s
I20260709 13:03:25.282955  8195 tablet_bootstrap.cc:654] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.289372  8074 raft_consensus.cc:2468] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:25.291213  8115 leader_election.cc:304] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:25.292593  8333 raft_consensus.cc:2804] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.293625  8333 raft_consensus.cc:697] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:25.294021  8002 raft_consensus.cc:2468] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:25.292739  8197 raft_consensus.cc:359] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.294808  8197 raft_consensus.cc:385] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.294898  8333 consensus_queue.cc:237] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.297640  8039 leader_election.cc:304] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:25.298900  8295 raft_consensus.cc:493] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.298977  8358 raft_consensus.cc:2804] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.299274  8232 leader_election.cc:290] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.299638  8358 raft_consensus.cc:697] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:25.301029  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:25.301605  8076 raft_consensus.cc:2468] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:25.301247  8358 consensus_queue.cc:237] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:25.302522  8115 leader_election.cc:343] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.299517  8295 raft_consensus.cc:515] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.305357  8295 leader_election.cc:290] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.305657  8115 leader_election.cc:304] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:25.306636  8197 raft_consensus.cc:740] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.307277  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:25.309387  7967 leader_election.cc:343] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.309764  8362 raft_consensus.cc:493] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.310302  8362 raft_consensus.cc:515] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.312588  8362 leader_election.cc:290] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:25.313954  8272 raft_consensus.cc:2804] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.314569  8272 raft_consensus.cc:697] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:25.315873  8194 tablet_bootstrap.cc:654] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.315502  8272 consensus_queue.cc:237] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.318555  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.319301  7926 raft_consensus.cc:2468] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:25.313982  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.320550  8041 leader_election.cc:304] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
W20260709 13:03:25.321973  7967 leader_election.cc:343] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.322145  8197 consensus_queue.cc:260] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.322611  7967 leader_election.cc:304] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.322057  8362 raft_consensus.cc:2804] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.323570  8362 raft_consensus.cc:493] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.323729  8295 raft_consensus.cc:2749] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.324000  8362 raft_consensus.cc:3060] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.324764  8197 ts_tablet_manager.cc:1434] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:03:25.325336  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:25.325958  8197 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.326107  7999 raft_consensus.cc:2468] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:25.337277  8197 tablet_bootstrap.cc:654] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.341318  8198 tablet_bootstrap.cc:654] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.341859  8362 raft_consensus.cc:515] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.341835  7823 catalog_manager.cc:5697] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.343940  7823 catalog_manager.cc:5697] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.344921  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:25.345539  7926 raft_consensus.cc:3060] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.353314  7926 raft_consensus.cc:2468] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:25.354297  8197 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.354473  8041 leader_election.cc:304] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:25.354840  8197 ts_tablet_manager.cc:1403] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.002s
I20260709 13:03:25.355436  8358 raft_consensus.cc:2804] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.356236  8358 raft_consensus.cc:697] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:25.357052  8358 consensus_queue.cc:237] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.357858  8197 raft_consensus.cc:359] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.358505  8197 raft_consensus.cc:385] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.358784  8197 raft_consensus.cc:740] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.359364  8195 tablet_bootstrap.cc:492] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.359817  8195 ts_tablet_manager.cc:1403] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.010s
I20260709 13:03:25.360275  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:25.360885  8002 raft_consensus.cc:3060] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.361661  8362 leader_election.cc:290] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:25.362473  8195 raft_consensus.cc:359] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.363155  8195 raft_consensus.cc:385] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.363410  8195 raft_consensus.cc:740] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.369786  8295 consensus_queue.cc:1048] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.370782  8342 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.372784  8195 consensus_queue.cc:260] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.373677  8362 raft_consensus.cc:493] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.374161  8362 raft_consensus.cc:515] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.375852  8295 consensus_queue.cc:1048] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.378070  8362 leader_election.cc:290] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.378811  8197 consensus_queue.cc:260] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.379788  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:25.380431  8000 raft_consensus.cc:2468] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:25.381574  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.381772  8197 ts_tablet_manager.cc:1434] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:03:25.382215  8150 raft_consensus.cc:2468] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:25.383121  8197 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.383759  8041 leader_election.cc:304] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:25.384582  7821 catalog_manager.cc:5697] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.390373  8197 tablet_bootstrap.cc:654] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.392318  8195 ts_tablet_manager.cc:1434] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 13:03:25.393360  8362 raft_consensus.cc:2804] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.393656  8195 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.393829  8362 raft_consensus.cc:493] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.394271  8362 raft_consensus.cc:3060] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.394464  8194 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.395215  8194 ts_tablet_manager.cc:1403] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.002s
I20260709 13:03:25.400456  8195 tablet_bootstrap.cc:654] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.402390  8272 raft_consensus.cc:493] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.402937  8362 raft_consensus.cc:515] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.402989  8272 raft_consensus.cc:515] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.405354  8362 leader_election.cc:290] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.405869  8272 leader_election.cc:290] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.407024  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:25.407650  8000 raft_consensus.cc:3060] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.408937  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52fb0d48a61c4f3696f07f0e9f953dfa" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:25.409567  8150 raft_consensus.cc:3060] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.398372  8194 raft_consensus.cc:359] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.411877  8194 raft_consensus.cc:385] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.412705  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.413390  8074 raft_consensus.cc:2468] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:25.415274  8115 leader_election.cc:304] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:25.417279  8232 raft_consensus.cc:2804] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.417651  8232 raft_consensus.cc:493] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.417968  8232 raft_consensus.cc:3060] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.412295  8194 raft_consensus.cc:740] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.429062  8194 consensus_queue.cc:260] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.432736  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.438412  8198 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:25.439113  8198 ts_tablet_manager.cc:1403] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.167s	user 0.014s	sys 0.007s
I20260709 13:03:25.440428  8194 ts_tablet_manager.cc:1434] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:03:25.440482  8150 raft_consensus.cc:2468] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
W20260709 13:03:25.439746  8115 leader_election.cc:343] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.446991  8041 leader_election.cc:304] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:25.448176  8362 raft_consensus.cc:2804] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.448063  8232 raft_consensus.cc:515] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.448547  8002 raft_consensus.cc:2468] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:25.448920  8362 raft_consensus.cc:697] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:25.452378  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:25.453070  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:25.453627  8074 raft_consensus.cc:3060] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.450348  8232 leader_election.cc:290] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.455672  8194 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.459545  8000 raft_consensus.cc:2468] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:25.450143  8362 consensus_queue.cc:237] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:25.469544  8115 leader_election.cc:343] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.472023  8194 tablet_bootstrap.cc:654] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.474396  8195 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.474912  8195 ts_tablet_manager.cc:1403] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.018s
I20260709 13:03:25.476079  8197 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.476593  8197 ts_tablet_manager.cc:1403] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.005s
I20260709 13:03:25.481515  8195 raft_consensus.cc:359] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.482168  8195 raft_consensus.cc:385] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.482424  8195 raft_consensus.cc:740] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.482565  8197 raft_consensus.cc:359] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.483381  8074 raft_consensus.cc:2468] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:25.483678  8197 raft_consensus.cc:385] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.483995  8197 raft_consensus.cc:740] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.484623  8197 consensus_queue.cc:260] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.484835  8198 raft_consensus.cc:359] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.485495  8198 raft_consensus.cc:385] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.485782  8198 raft_consensus.cc:740] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.483140  8195 consensus_queue.cc:260] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.486665  8197 ts_tablet_manager.cc:1434] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:03:25.486469  8198 consensus_queue.cc:260] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.489122  8115 leader_election.cc:304] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:25.489872  8195 ts_tablet_manager.cc:1434] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:25.489987  8272 raft_consensus.cc:2804] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.490574  8272 raft_consensus.cc:697] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:25.491405  8272 consensus_queue.cc:237] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.492457  8198 ts_tablet_manager.cc:1434] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:03:25.493651  8198 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:25.496294  8195 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.498560  8346 raft_consensus.cc:493] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.499125  8346 raft_consensus.cc:515] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.500025  8198 tablet_bootstrap.cc:654] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.501344  8346 leader_election.cc:290] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.503895  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.492553  8197 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.508284  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79b2a47fe4a344828901bc5fdf6d45db" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.512626  8000 raft_consensus.cc:3060] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.512887  7892 leader_election.cc:304] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.522774  8348 raft_consensus.cc:2749] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.534752  8272 consensus_queue.cc:1048] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.516042  8195 tablet_bootstrap.cc:654] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.537467  7926 raft_consensus.cc:3060] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.516499  8358 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.548560  8272 consensus_queue.cc:1048] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.590732  8348 raft_consensus.cc:493] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.591490  8348 raft_consensus.cc:515] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.518198  8197 tablet_bootstrap.cc:654] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.612792  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.539053  8358 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.614791  8348 leader_election.cc:290] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:25.637882  8198 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:25.639011  8198 ts_tablet_manager.cc:1403] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.027s
I20260709 13:03:25.628556  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79f06a693fd84cf3b2eda8e179fd85dc" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:25.647082  8074 raft_consensus.cc:2393] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb658b087424b87887d5bfef62d8084 in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:25.648379  7892 leader_election.cc:304] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.650767  8348 raft_consensus.cc:3060] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.650564  8198 raft_consensus.cc:359] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.651402  8198 raft_consensus.cc:385] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.664687  8358 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.656442  8198 raft_consensus.cc:740] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.669490  8194 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.675115  8194 ts_tablet_manager.cc:1403] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.220s	user 0.010s	sys 0.025s
I20260709 13:03:25.672574  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.681318  8198 consensus_queue.cc:260] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.684118  8198 ts_tablet_manager.cc:1434] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
W20260709 13:03:25.684633  8041 leader_election.cc:343] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.679176  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.685192  8198 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:25.674271  7825 catalog_manager.cc:5697] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.687243  8197 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.688633  8197 ts_tablet_manager.cc:1403] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.008s
I20260709 13:03:25.705577  7820 catalog_manager.cc:5697] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.709931  8194 raft_consensus.cc:359] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.713524  8194 raft_consensus.cc:385] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.713976  8194 raft_consensus.cc:740] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
W20260709 13:03:25.708762  8041 leader_election.cc:343] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.718991  8041 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.720084  8358 raft_consensus.cc:2749] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.722682  8194 consensus_queue.cc:260] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.723420  8195 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.723547  8359 raft_consensus.cc:493] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.723961  8195 ts_tablet_manager.cc:1403] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.029s
I20260709 13:03:25.724094  8359 raft_consensus.cc:515] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.728348  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.729086  8149 raft_consensus.cc:2468] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:25.730304  8195 raft_consensus.cc:359] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.730803  8348 raft_consensus.cc:2749] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.731120  8195 raft_consensus.cc:385] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.731467  8195 raft_consensus.cc:740] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.732214  8195 consensus_queue.cc:260] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:25.734992  7967 leader_election.cc:304] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:25.736169  8295 raft_consensus.cc:2804] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.721306  7820 catalog_manager.cc:5697] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.736538  8295 raft_consensus.cc:493] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.740028  8295 raft_consensus.cc:3060] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.740700  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:25.743151  7967 leader_election.cc:343] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.743852  8359 leader_election.cc:290] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.748643  8295 raft_consensus.cc:515] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.751498  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:25.752112  8149 raft_consensus.cc:3060] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.754953  8194 ts_tablet_manager.cc:1434] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.001s
I20260709 13:03:25.756234  8194 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.752234  8348 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.763119  8194 tablet_bootstrap.cc:654] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.763233  8348 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.766423  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.751554  8195 ts_tablet_manager.cc:1434] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:25.753738  8197 raft_consensus.cc:359] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.769526  8197 raft_consensus.cc:385] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.769826  8197 raft_consensus.cc:740] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.767460  8348 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:25.771272  8197 consensus_queue.cc:260] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.772277  8366 consensus_queue.cc:1048] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:25.753660  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:25.772485  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:25.773403  8197 ts_tablet_manager.cc:1434] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:03:25.773571  8149 raft_consensus.cc:2468] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:25.753103  8295 leader_election.cc:290] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:25.775238  7967 leader_election.cc:343] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.775555  8195 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.775411  7890 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:25.776051  7967 leader_election.cc:304] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:25.774470  8197 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:25.776829  8288 raft_consensus.cc:2749] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.778131  8198 tablet_bootstrap.cc:654] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.782795  8272 consensus_queue.cc:1048] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.779363  8295 raft_consensus.cc:2804] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.786036  8295 raft_consensus.cc:697] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:25.787181  8295 consensus_queue.cc:237] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:25.789407  8041 consensus_peers.cc:597] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.805780  8199 raft_consensus.cc:493] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.806185  8195 tablet_bootstrap.cc:654] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.806360  8199 raft_consensus.cc:515] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.812877  8197 tablet_bootstrap.cc:654] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.811487  8199 leader_election.cc:290] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.818392  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:25.818739  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.819170  8149 raft_consensus.cc:2468] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:25.826869  7967 leader_election.cc:304] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
W20260709 13:03:25.827855  7967 leader_election.cc:343] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:25.829006  8115 consensus_peers.cc:597] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.829654  8199 raft_consensus.cc:2804] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:25.832301  8362 consensus_queue.cc:1048] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.833233  8366 consensus_queue.cc:1048] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.830053  8199 raft_consensus.cc:493] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.835409  8199 raft_consensus.cc:3060] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.841740  8198 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:25.842320  8198 ts_tablet_manager.cc:1403] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.157s	user 0.019s	sys 0.005s
I20260709 13:03:25.845088  8198 raft_consensus.cc:359] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.845770  8198 raft_consensus.cc:385] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.846040  8198 raft_consensus.cc:740] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.850392  8194 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:25.851161  8194 ts_tablet_manager.cc:1403] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.002s
I20260709 13:03:25.859392  8366 consensus_queue.cc:1048] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:25.865136  8194 raft_consensus.cc:359] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.865864  8194 raft_consensus.cc:385] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.866129  8194 raft_consensus.cc:740] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.866808  8194 consensus_queue.cc:260] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:25.868295  8194 ts_tablet_manager.cc:1434] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:03:25.869314  8194 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:25.871413  8199 raft_consensus.cc:515] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.874575  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:25.875202  8149 raft_consensus.cc:3060] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:25.875243  8272 consensus_queue.cc:1048] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.877046  8197 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:25.877552  8197 ts_tablet_manager.cc:1403] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.103s	user 0.005s	sys 0.009s
I20260709 13:03:25.886814  8149 raft_consensus.cc:2468] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:25.888144  7967 leader_election.cc:304] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:25.889674  8359 raft_consensus.cc:2804] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:25.890164  8359 raft_consensus.cc:697] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:25.891064  8359 consensus_queue.cc:237] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:25.893253  7825 catalog_manager.cc:5697] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.897477  8195 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:25.898121  8195 ts_tablet_manager.cc:1403] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.123s	user 0.010s	sys 0.005s
I20260709 13:03:25.897718  8272 consensus_queue.cc:1048] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.899969  8199 leader_election.cc:290] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.900094  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:25.856493  8198 consensus_queue.cc:260] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.901027  8197 raft_consensus.cc:359] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:25.901643  7967 leader_election.cc:343] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.901865  8197 raft_consensus.cc:385] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.903749  8198 ts_tablet_manager.cc:1434] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:03:25.910231  8194 tablet_bootstrap.cc:654] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.912783  8195 raft_consensus.cc:359] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.918092  8195 raft_consensus.cc:385] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:25.919528  8195 raft_consensus.cc:740] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:25.920576  8195 consensus_queue.cc:260] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.932148  8366 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.932719  8366 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:25.938934  8366 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:25.940223  8362 consensus_queue.cc:1048] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:25.942979  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:25.945569  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:25.946118  8041 leader_election.cc:343] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:25.947916  8041 leader_election.cc:343] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:25.948385  8041 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:25.949501  8366 raft_consensus.cc:2749] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:25.954186  8195 ts_tablet_manager.cc:1434] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.004s
I20260709 13:03:25.918270  8198 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:25.960168  8195 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:25.971550  8195 tablet_bootstrap.cc:654] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.972345  8198 tablet_bootstrap.cc:654] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:25.902228  8197 raft_consensus.cc:740] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.002311  8197 consensus_queue.cc:260] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.008529  8197 ts_tablet_manager.cc:1434] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.131s	user 0.006s	sys 0.003s
I20260709 13:03:26.010305  8197 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.036334  8272 consensus_queue.cc:1048] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:26.044394  8358 raft_consensus.cc:493] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.044973  8358 raft_consensus.cc:515] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.047051  8358 leader_election.cc:290] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.053066  7822 catalog_manager.cc:5697] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.059719  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:26.061800  8041 leader_election.cc:343] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.066776  8232 consensus_queue.cc:1048] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.070812  7925 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.073899  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:26.076187  8039 leader_election.cc:343] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.077054  8039 leader_election.cc:304] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:26.078083  8366 raft_consensus.cc:2749] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.097185  8197 tablet_bootstrap.cc:654] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.108980  8194 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:26.112732  8194 ts_tablet_manager.cc:1403] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.244s	user 0.028s	sys 0.034s
I20260709 13:03:26.121840  8195 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.122354  8195 ts_tablet_manager.cc:1403] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.162s	user 0.034s	sys 0.028s
I20260709 13:03:26.140846  8194 raft_consensus.cc:359] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.141639  8194 raft_consensus.cc:385] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.141889  8194 raft_consensus.cc:740] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.143549  8195 raft_consensus.cc:359] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.144253  8195 raft_consensus.cc:385] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.144496  8195 raft_consensus.cc:740] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.145123  8195 consensus_queue.cc:260] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.147148  8194 consensus_queue.cc:260] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.147697  8195 ts_tablet_manager.cc:1434] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
W20260709 13:03:26.160471  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:26.165577  8198 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.166101  8198 ts_tablet_manager.cc:1403] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.248s	user 0.042s	sys 0.045s
I20260709 13:03:26.168437  8194 ts_tablet_manager.cc:1434] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.002s
I20260709 13:03:26.168202  8198 raft_consensus.cc:359] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.168900  8198 raft_consensus.cc:385] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.169193  8198 raft_consensus.cc:740] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.169505  8359 raft_consensus.cc:493] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.170310  8359 raft_consensus.cc:515] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.169942  8198 consensus_queue.cc:260] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.172919  8198 ts_tablet_manager.cc:1434] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:03:26.173589  8195 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.174002  8198 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.174898  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.175631  8359 leader_election.cc:290] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:26.176193  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:26.176386  7967 leader_election.cc:343] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:26.177603  7967 leader_election.cc:343] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.177986  7967 leader_election.cc:304] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:26.169505  8194 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:26.180930  8359 raft_consensus.cc:2749] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.188529  8198 tablet_bootstrap.cc:654] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.191111  8197 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:26.191612  8197 ts_tablet_manager.cc:1403] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.182s	user 0.011s	sys 0.003s
I20260709 13:03:26.191985  8195 tablet_bootstrap.cc:654] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.194228  8197 raft_consensus.cc:359] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.194967  8197 raft_consensus.cc:385] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.195225  8197 raft_consensus.cc:740] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.196272  8197 consensus_queue.cc:260] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.189900  8194 tablet_bootstrap.cc:654] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.202805  8346 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.204265  8346 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.207119  8346 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.209218  8197 ts_tablet_manager.cc:1434] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:03:26.210678  8197 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.215236  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:26.220969  8073 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:26.221305  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.222250  8149 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:26.227681  7892 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:26.229924  8232 raft_consensus.cc:493] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.230674  8232 raft_consensus.cc:515] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.233392  8232 leader_election.cc:290] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:26.230014  8197 tablet_bootstrap.cc:654] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.235935  8346 raft_consensus.cc:2804] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.236786  8346 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.237149  8198 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.237114  8346 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.237298  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.237747  8198 ts_tablet_manager.cc:1403] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.004s
I20260709 13:03:26.240000  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:26.240974  8115 leader_election.cc:343] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.243958  8298 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.244481  8298 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.245266  8198 raft_consensus.cc:359] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:26.245652  8113 leader_election.cc:343] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.246130  8113 leader_election.cc:304] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:26.246589  8195 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.246941  8333 raft_consensus.cc:2749] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.245975  8198 raft_consensus.cc:385] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.247149  8195 ts_tablet_manager.cc:1403] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.029s
I20260709 13:03:26.249274  8198 raft_consensus.cc:740] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.249931  8194 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:26.250409  8194 ts_tablet_manager.cc:1403] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.014s
I20260709 13:03:26.250244  8198 consensus_queue.cc:260] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.250728  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:26.251402  8073 raft_consensus.cc:2468] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:26.251827  8346 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.253324  8115 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:26.254890  8194 raft_consensus.cc:359] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.255607  8194 raft_consensus.cc:385] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.256057  8194 raft_consensus.cc:740] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.253396  8195 raft_consensus.cc:359] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.256565  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:26.257100  8346 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.258301  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:26.258572  8194 consensus_queue.cc:260] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.259474  8149 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.255571  8272 raft_consensus.cc:2804] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.260381  8272 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.260747  8272 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.261276  8198 ts_tablet_manager.cc:1434] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:26.261797  8194 ts_tablet_manager.cc:1434] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:03:26.262835  8194 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:26.270545  8149 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:26.271044  8198 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.271281  8194 tablet_bootstrap.cc:654] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.271953  7892 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:26.272913  8346 raft_consensus.cc:2804] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.246598  8298 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:26.274117  8346 raft_consensus.cc:697] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:26.275019  8346 consensus_queue.cc:237] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.278761  8198 tablet_bootstrap.cc:654] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.258301  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.257198  8073 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.256806  8195 raft_consensus.cc:385] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.291692  8195 raft_consensus.cc:740] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.291985  8198 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.292644  8198 ts_tablet_manager.cc:1403] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:03:26.292480  8195 consensus_queue.cc:260] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.294680  8195 ts_tablet_manager.cc:1434] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:03:26.295877  8195 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.296373  8198 raft_consensus.cc:359] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.297326  8198 raft_consensus.cc:385] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:26.302207  8115 leader_election.cc:343] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.303026  8195 tablet_bootstrap.cc:654] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.307674  8359 consensus_queue.cc:1048] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:26.315037  7967 consensus_peers.cc:597] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.297669  8198 raft_consensus.cc:740] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.317071  8198 consensus_queue.cc:260] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.320595  8198 ts_tablet_manager.cc:1434] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 13:03:26.321933  8198 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.329063  8198 tablet_bootstrap.cc:654] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.341174  8198 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.341838  8198 ts_tablet_manager.cc:1403] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:03:26.344684  8199 consensus_queue.cc:1048] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:26.345295  8198 raft_consensus.cc:359] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.352035  8198 raft_consensus.cc:385] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.352427  8198 raft_consensus.cc:740] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.353286  8198 consensus_queue.cc:260] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.353741  7926 raft_consensus.cc:3060] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.364806  8198 ts_tablet_manager.cc:1434] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:03:26.366092  8198 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.368983  8272 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.371894  7924 raft_consensus.cc:3060] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.378037  8198 tablet_bootstrap.cc:654] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.401918  8198 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.435465  8198 ts_tablet_manager.cc:1403] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.012s
I20260709 13:03:26.414139  8199 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.418187  8366 raft_consensus.cc:493] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.437989  8366 raft_consensus.cc:515] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.437901  8199 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:26.442741  7967 consensus_peers.cc:597] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.443276  8199 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:26.447538  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:26.449393  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:26.450243  7967 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.459793  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:26.460525  8075 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.462961  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.463930  7925 raft_consensus.cc:2468] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:26.465725  8041 leader_election.cc:304] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:26.466436  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:26.467243  8358 raft_consensus.cc:2804] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:26.467762  8115 leader_election.cc:343] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.467818  8358 raft_consensus.cc:493] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.468497  8358 raft_consensus.cc:3060] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:26.468895  7967 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.469349  7967 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:26.470089  8295 raft_consensus.cc:2749] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.469905  8075 raft_consensus.cc:2468] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:26.471681  8115 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:26.472797  8298 raft_consensus.cc:2804] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.473452  8298 raft_consensus.cc:697] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:26.474587  8298 consensus_queue.cc:237] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.512524  8272 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:26.517488  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.518250  8073 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:26.518519  7999 raft_consensus.cc:2468] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:26.521401  8366 leader_election.cc:290] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:26.523386  8195 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.525231  8195 ts_tablet_manager.cc:1403] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.230s	user 0.033s	sys 0.048s
I20260709 13:03:26.528818  8195 raft_consensus.cc:359] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.524816  8198 raft_consensus.cc:359] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.533205  8198 raft_consensus.cc:385] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.533558  8198 raft_consensus.cc:740] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.534399  8198 consensus_queue.cc:260] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.536594  8198 ts_tablet_manager.cc:1434] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 13:03:26.537915  8198 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.538275  8195 raft_consensus.cc:385] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.542836  8195 raft_consensus.cc:740] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.543612  8195 consensus_queue.cc:260] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.544289  8295 raft_consensus.cc:493] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.545835  8295 raft_consensus.cc:515] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.548049  8295 leader_election.cc:290] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.551234  8195 ts_tablet_manager.cc:1434] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:03:26.557143  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.554363  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:26.559095  8195 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.556428  8198 tablet_bootstrap.cc:654] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.566412  8362 raft_consensus.cc:493] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.567899  8362 raft_consensus.cc:515] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.569092  8194 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:26.569633  8194 ts_tablet_manager.cc:1403] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.307s	user 0.033s	sys 0.100s
I20260709 13:03:26.570019  8362 leader_election.cc:290] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:26.572072  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.572600  8194 raft_consensus.cc:359] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.573297  8194 raft_consensus.cc:385] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:26.573376  8115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 62194.2us
W20260709 13:03:26.573674  8041 leader_election.cc:343] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.574429  8195 tablet_bootstrap.cc:654] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.573617  8194 raft_consensus.cc:740] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.576926  8194 consensus_queue.cc:260] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.580787  8194 ts_tablet_manager.cc:1434] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:03:26.581893  8194 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:26.585799  8198 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.586544  8198 ts_tablet_manager.cc:1403] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:03:26.590508  8198 raft_consensus.cc:359] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.591495  8198 raft_consensus.cc:385] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.591842  8198 raft_consensus.cc:740] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.592777  8198 consensus_queue.cc:260] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.595137  8194 tablet_bootstrap.cc:654] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.596966  8195 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.597671  8195 ts_tablet_manager.cc:1403] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.005s
I20260709 13:03:26.601671  8195 raft_consensus.cc:359] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.602361  8195 raft_consensus.cc:385] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.602612  8195 raft_consensus.cc:740] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
W20260709 13:03:26.602800  7967 leader_election.cc:343] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.603320  8195 consensus_queue.cc:260] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.603953  7823 catalog_manager.cc:5697] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.605459  8195 ts_tablet_manager.cc:1434] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.001s
W20260709 13:03:26.608922  7967 leader_election.cc:343] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.609423  7967 leader_election.cc:304] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:26.610128  8359 raft_consensus.cc:2749] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.611240  8198 ts_tablet_manager.cc:1434] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:03:26.611778  8194 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:26.612311  8194 ts_tablet_manager.cc:1403] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 13:03:26.612641  8198 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.615154  8194 raft_consensus.cc:359] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.615839  8194 raft_consensus.cc:385] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.616099  8194 raft_consensus.cc:740] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.616700  8194 consensus_queue.cc:260] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.606472  8195 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.619176  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.625116  8194 ts_tablet_manager.cc:1434] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 13:03:26.625502  8041 leader_election.cc:343] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.626013  8041 leader_election.cc:304] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:26.626328  8194 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:26.626951  8366 raft_consensus.cc:2749] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.630381  8195 tablet_bootstrap.cc:654] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.631819  8198 tablet_bootstrap.cc:654] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.640214  8346 raft_consensus.cc:493] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.641163  8346 raft_consensus.cc:515] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.643366  8346 leader_election.cc:290] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:26.644930  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.647475  8194 tablet_bootstrap.cc:654] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.655148  8197 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:26.655639  8197 ts_tablet_manager.cc:1403] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.445s	user 0.083s	sys 0.103s
I20260709 13:03:26.656589  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec88e145d9a940c9a732315fdcc27c53" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.653368  8346 raft_consensus.cc:493] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.658357  8197 raft_consensus.cc:359] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.659083  8346 raft_consensus.cc:515] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.659112  8197 raft_consensus.cc:385] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.659765  7822 catalog_manager.cc:5697] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.663797  7890 leader_election.cc:304] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:26.659890  8197 raft_consensus.cc:740] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.667160  8197 consensus_queue.cc:260] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.671337  8288 raft_consensus.cc:2749] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.671660  8197 ts_tablet_manager.cc:1434] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:03:26.677624  8346 leader_election.cc:290] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.678998  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.680630  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:26.682312  7892 leader_election.cc:343] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:26.683087  7892 leader_election.cc:343] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.683521  7892 leader_election.cc:304] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:26.661934  8358 raft_consensus.cc:515] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.683202  8194 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:26.687054  8194 ts_tablet_manager.cc:1403] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.007s
I20260709 13:03:26.686882  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:26.688963  7924 raft_consensus.cc:3060] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.687646  8346 raft_consensus.cc:2749] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.692664  8197 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.692553  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3212e0a78a41fdb90d232921d72ea1" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:26.695364  8000 raft_consensus.cc:3060] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.700495  8194 raft_consensus.cc:359] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.701982  8194 raft_consensus.cc:385] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.702353  8194 raft_consensus.cc:740] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.703156  8194 consensus_queue.cc:260] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.701643  8198 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.704545  8198 ts_tablet_manager.cc:1403] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.012s
I20260709 13:03:26.705464  8000 raft_consensus.cc:2468] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:26.686009  8358 leader_election.cc:290] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:26.706964  8039 leader_election.cc:304] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:26.708680  8198 raft_consensus.cc:359] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.709980  8198 raft_consensus.cc:385] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.710350  8198 raft_consensus.cc:740] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.709641  8194 ts_tablet_manager.cc:1434] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:26.711911  8463 raft_consensus.cc:493] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.711796  8198 consensus_queue.cc:260] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.712405  8463 raft_consensus.cc:515] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.715240  8198 ts_tablet_manager.cc:1434] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:03:26.715508  8463 leader_election.cc:290] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:26.717238  8198 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:26.717034  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:26.717494  8358 raft_consensus.cc:2804] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.719358  8358 raft_consensus.cc:697] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
W20260709 13:03:26.719606  8115 leader_election.cc:343] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.720247  8358 consensus_queue.cc:237] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.723148  8194 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:26.725173  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:26.726966  8113 leader_election.cc:343] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.727551  8113 leader_election.cc:304] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:26.730281  8463 raft_consensus.cc:2749] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.732074  8195 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.732793  8195 ts_tablet_manager.cc:1403] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.127s	user 0.018s	sys 0.030s
I20260709 13:03:26.775563  8195 raft_consensus.cc:359] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.778527  7924 raft_consensus.cc:2468] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:26.784148  8195 raft_consensus.cc:385] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.784473  8195 raft_consensus.cc:740] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.785264  8195 consensus_queue.cc:260] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.787065  8195 ts_tablet_manager.cc:1434] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.015s
I20260709 13:03:26.788004  8195 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.789034  8359 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.789538  8359 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.791769  8359 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:26.794258  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:26.797642  8113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 70693.2us
I20260709 13:03:26.797763  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:26.798162  8195 tablet_bootstrap.cc:654] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.798735  8359 raft_consensus.cc:493] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.799202  8359 raft_consensus.cc:515] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.801101  8359 leader_election.cc:290] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:26.798280  7967 leader_election.cc:343] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.802767  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.803371  8150 raft_consensus.cc:2468] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:26.805346  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:26.806406  7967 leader_election.cc:343] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.806890  7967 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:26.812095  7820 catalog_manager.cc:5697] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:26.814112  8359 raft_consensus.cc:2749] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:26.815480  7967 leader_election.cc:304] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:26.816437  8198 tablet_bootstrap.cc:654] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.817210  8197 tablet_bootstrap.cc:654] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.819850  8194 tablet_bootstrap.cc:654] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.823211  8359 raft_consensus.cc:2804] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.823664  8359 raft_consensus.cc:493] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.824018  8359 raft_consensus.cc:3060] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:26.834952  7967 leader_election.cc:343] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.834483  8359 raft_consensus.cc:515] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.840250  8195 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:26.840834  8195 ts_tablet_manager.cc:1403] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.053s	user 0.025s	sys 0.020s
I20260709 13:03:26.842106  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:26.842859  8150 raft_consensus.cc:3060] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.844033  8195 raft_consensus.cc:359] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.844798  8195 raft_consensus.cc:385] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.845062  8195 raft_consensus.cc:740] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.845734  8195 consensus_queue.cc:260] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.846392  8197 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:26.846904  8197 ts_tablet_manager.cc:1403] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.000s
I20260709 13:03:26.848119  8195 ts_tablet_manager.cc:1434] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:03:26.849265  8195 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:26.849642  8197 raft_consensus.cc:359] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.850342  8197 raft_consensus.cc:385] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.850610  8197 raft_consensus.cc:740] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.853089  8150 raft_consensus.cc:2468] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:26.851457  8197 consensus_queue.cc:260] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.854571  7967 leader_election.cc:304] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:26.855728  8195 tablet_bootstrap.cc:654] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.856319  8197 ts_tablet_manager.cc:1434] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:26.857118  8366 raft_consensus.cc:493] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.860895  8366 raft_consensus.cc:515] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.861438  8199 raft_consensus.cc:2804] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:26.863761  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.864658  8194 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
W20260709 13:03:26.865151  8039 leader_election.cc:343] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.865346  8194 ts_tablet_manager.cc:1403] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.006s
I20260709 13:03:26.866084  8366 leader_election.cc:290] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.868022  8197 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.868409  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.869038  8150 raft_consensus.cc:2468] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:26.870265  8359 leader_election.cc:290] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:26.870188  8041 leader_election.cc:304] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:26.871383  8366 raft_consensus.cc:2804] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.871765  8366 raft_consensus.cc:493] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.872117  8366 raft_consensus.cc:3060] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.875555  8197 tablet_bootstrap.cc:654] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.879544  8346 raft_consensus.cc:493] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.880128  8346 raft_consensus.cc:515] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:26.882416  8346 leader_election.cc:290] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:26.888932  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.896575  8298 consensus_queue.cc:1048] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:26.900795  8197 tablet_bootstrap.cc:492] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:26.901371  8197 ts_tablet_manager.cc:1403] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.000s
W20260709 13:03:26.902204  7892 leader_election.cc:343] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.903270  8438 raft_consensus.cc:493] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.903973  8438 raft_consensus.cc:515] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.904228  8197 raft_consensus.cc:359] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.904953  8197 raft_consensus.cc:385] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.905237  8197 raft_consensus.cc:740] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.905910  8197 consensus_queue.cc:260] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.907433  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.907934  8288 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.908254  7999 raft_consensus.cc:2468] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:26.909168  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:26.909521  8039 leader_election.cc:304] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:26.909824  8149 raft_consensus.cc:2468] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:26.907457  8438 leader_election.cc:290] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.912472  8197 ts_tablet_manager.cc:1434] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:26.912572  8438 raft_consensus.cc:2804] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:26.913048  8438 raft_consensus.cc:493] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.913395  8438 raft_consensus.cc:3060] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.913635  8197 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.915416  8288 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:26.930295  8197 tablet_bootstrap.cc:654] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.930985  8198 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:26.931625  8198 ts_tablet_manager.cc:1403] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.000s
I20260709 13:03:26.935757  8198 raft_consensus.cc:359] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.936705  8198 raft_consensus.cc:385] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.937036  8198 raft_consensus.cc:740] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.940372  8438 raft_consensus.cc:515] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.940680  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:26.942984  7924 raft_consensus.cc:3060] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.945837  8197 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:26.946346  8197 ts_tablet_manager.cc:1403] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 13:03:26.948868  8438 leader_election.cc:290] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:26.948781  8346 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.949131  8197 raft_consensus.cc:359] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.950021  8197 raft_consensus.cc:385] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.949542  8346 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.868043  8194 raft_consensus.cc:359] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.954479  8194 raft_consensus.cc:385] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:26.954759  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:26.956868  7892 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:26.950343  8197 raft_consensus.cc:740] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.958130  8197 consensus_queue.cc:260] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:26.953429  8346 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:26.960105  8197 ts_tablet_manager.cc:1434] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:03:26.960422  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:26.961108  8150 raft_consensus.cc:3060] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:26.961162  8197 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:26.972400  8366 raft_consensus.cc:515] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:26.975427  8115 consensus_peers.cc:597] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.974531  8194 raft_consensus.cc:740] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:26.976228  8359 raft_consensus.cc:493] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.976907  8359 raft_consensus.cc:515] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:26.977211  8194 consensus_queue.cc:260] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:26.978986  8197 tablet_bootstrap.cc:654] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:26.989246  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.989647  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:26.998255  8198 consensus_queue.cc:260] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.002044  8438 raft_consensus.cc:493] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.011490  8438 raft_consensus.cc:515] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:27.012068  8039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 102543us
I20260709 13:03:27.018436  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f1cdc967ed405b9586552899bd23fb" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:27.019817  8001 raft_consensus.cc:3060] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.019912  8438 leader_election.cc:290] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:27.021005  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:27.022827  8149 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:27.023821  8198 ts_tablet_manager.cc:1434] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:03:27.023921  8483 raft_consensus.cc:493] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.024657  8483 raft_consensus.cc:515] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.025357  8041 leader_election.cc:304] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:27.025136  8198 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:27.026350  8362 raft_consensus.cc:2804] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.026794  8362 raft_consensus.cc:493] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.027033  8483 leader_election.cc:290] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.027133  8362 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.029227  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.029995  8002 raft_consensus.cc:2468] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:27.031230  8039 leader_election.cc:304] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.033026  8358 raft_consensus.cc:2804] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.033495  8358 raft_consensus.cc:493] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.033871  8358 raft_consensus.cc:3060] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.037173  8198 tablet_bootstrap.cc:654] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.043623  8358 raft_consensus.cc:515] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.047484  8358 leader_election.cc:290] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.048861  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:27.049811  8002 raft_consensus.cc:3060] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:27.055418  7967 leader_election.cc:343] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.060149  8362 raft_consensus.cc:515] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.067281  8194 ts_tablet_manager.cc:1434] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.202s	user 0.008s	sys 0.000s
I20260709 13:03:27.069614  8359 leader_election.cc:290] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:27.007128  8199 raft_consensus.cc:697] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:27.070785  8199 consensus_queue.cc:237] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.084057  8194 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:27.087908  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.092813  8197 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:27.066509  8000 raft_consensus.cc:2468] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:27.092921  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.094466  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
W20260709 13:03:27.095649  7890 leader_election.cc:343] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.096249  7890 leader_election.cc:304] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:27.093343  8197 ts_tablet_manager.cc:1403] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.012s
I20260709 13:03:27.102017  8002 raft_consensus.cc:2468] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:27.103334  8366 leader_election.cc:290] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:27.105568  8197 raft_consensus.cc:359] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.107487  8197 raft_consensus.cc:385] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.107993  8197 raft_consensus.cc:740] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
W20260709 13:03:27.099730  7967 leader_election.cc:343] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.116394  8195 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:27.117142  8195 ts_tablet_manager.cc:1403] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.268s	user 0.071s	sys 0.052s
I20260709 13:03:27.121001  8197 consensus_queue.cc:260] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.139954  8197 ts_tablet_manager.cc:1434] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.042s	user 0.000s	sys 0.008s
W20260709 13:03:27.129106  8041 leader_election.cc:343] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.146423  8195 raft_consensus.cc:359] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.130461  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.147547  8195 raft_consensus.cc:385] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.154760  8195 raft_consensus.cc:740] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.136366  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:27.157837  8195 consensus_queue.cc:260] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.167016  8197 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:27.172070  8463 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.172703  8463 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.175583  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:27.157817  7925 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
W20260709 13:03:27.186658  7967 leader_election.cc:343] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.189638  8198 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:27.203924  8198 ts_tablet_manager.cc:1403] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.179s	user 0.031s	sys 0.044s
I20260709 13:03:27.179798  8039 leader_election.cc:304] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.194943  8272 raft_consensus.cc:493] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.197568  8195 ts_tablet_manager.cc:1434] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.080s	user 0.011s	sys 0.003s
I20260709 13:03:27.157929  8150 raft_consensus.cc:2468] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:27.199185  8362 leader_election.cc:290] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:27.198406  8001 raft_consensus.cc:2468] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
W20260709 13:03:27.176452  8041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 55056.9us
I20260709 13:03:27.204993  7967 leader_election.cc:304] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
W20260709 13:03:27.179471  7890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 83832.2us
I20260709 13:03:27.202111  8463 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.213629  8358 raft_consensus.cc:2804] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.225455  7823 catalog_manager.cc:5697] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.217283  8359 raft_consensus.cc:2749] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.219131  7890 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:27.229493  8195 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:27.211901  8272 raft_consensus.cc:515] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.220301  8493 raft_consensus.cc:2749] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.231367  8358 raft_consensus.cc:697] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:27.263032  8501 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.263602  8501 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.265224  8195 tablet_bootstrap.cc:654] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.265676  8501 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:27.266958  8498 raft_consensus.cc:2804] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.267330  8498 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.267664  8498 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.269353  8197 tablet_bootstrap.cc:654] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.271427  8358 consensus_queue.cc:237] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.273995  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:27.274648  8148 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.276373  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:27.277004  7926 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.278774  8194 tablet_bootstrap.cc:654] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.243593  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
W20260709 13:03:27.290103  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 62318.4us
I20260709 13:03:27.298121  8272 leader_election.cc:290] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:27.298897  8039 leader_election.cc:343] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.299645  8039 leader_election.cc:304] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.301330  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:27.302251  8041 leader_election.cc:343] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.305735  8483 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.306196  8483 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.308152  8483 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.288563  8150 raft_consensus.cc:3060] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.312330  8071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:27.312719  8198 raft_consensus.cc:359] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.313562  8198 raft_consensus.cc:385] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.313894  8198 raft_consensus.cc:740] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.314576  8198 consensus_queue.cc:260] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:27.316439  8494 log.cc:927] Time spent T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:03:27.319304  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.319969  8001 raft_consensus.cc:2468] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:27.324841  8150 raft_consensus.cc:2468] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:27.316510  8198 ts_tablet_manager.cc:1434] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.002s
W20260709 13:03:27.326758  8115 leader_election.cc:343] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.328212  8199 raft_consensus.cc:493] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.325281  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:27.328845  8199 raft_consensus.cc:515] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.337729  8199 leader_election.cc:290] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:27.338667  8506 raft_consensus.cc:493] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.339164  8506 raft_consensus.cc:515] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.340833  8148 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:27.340970  8072 raft_consensus.cc:2468] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:27.341271  8506 leader_election.cc:290] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.325466  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.348688  8115 leader_election.cc:304] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:27.350289  8198 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:27.351577  8195 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:27.352032  8195 ts_tablet_manager.cc:1403] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.007s
I20260709 13:03:27.353233  8505 raft_consensus.cc:2804] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.353801  8505 raft_consensus.cc:493] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.354224  8505 raft_consensus.cc:3060] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.333467  8362 raft_consensus.cc:2804] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.369915  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:27.370654  8072 raft_consensus.cc:2468] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:27.370837  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:27.366385  7927 raft_consensus.cc:3060] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.371812  7967 leader_election.cc:304] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
W20260709 13:03:27.362573  7890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 143474us
I20260709 13:03:27.383817  8295 raft_consensus.cc:2804] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.401435  8113 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:27.397399  8295 raft_consensus.cc:493] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.403363  8295 raft_consensus.cc:3060] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.403829  8333 raft_consensus.cc:2804] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.404260  8333 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.404619  8333 raft_consensus.cc:3060] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.409777  8195 raft_consensus.cc:359] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.366578  8041 leader_election.cc:304] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:27.410538  8195 raft_consensus.cc:385] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.419166  8195 raft_consensus.cc:740] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.417512  8295 raft_consensus.cc:515] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:27.421478  8115 leader_election.cc:343] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.423785  8198 tablet_bootstrap.cc:654] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.426198  8295 leader_election.cc:290] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
W20260709 13:03:27.426492  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:27.398368  7926 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:27.441617  8195 consensus_queue.cc:260] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.444212  8197 tablet_bootstrap.cc:492] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:27.446079  8197 ts_tablet_manager.cc:1403] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.279s	user 0.019s	sys 0.012s
I20260709 13:03:27.451289  8333 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.432031  8362 raft_consensus.cc:697] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:27.440836  8483 raft_consensus.cc:2804] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.470266  8195 ts_tablet_manager.cc:1434] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.005s
I20260709 13:03:27.470778  8197 raft_consensus.cc:359] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.471520  8197 raft_consensus.cc:385] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.471771  8197 raft_consensus.cc:740] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.472411  8197 consensus_queue.cc:260] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.473158  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:27.473788  8073 raft_consensus.cc:3060] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.474021  8197 ts_tablet_manager.cc:1434] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.000s
I20260709 13:03:27.449841  8498 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:27.447657  8041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 95023.5us
I20260709 13:03:27.488070  8041 leader_election.cc:304] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:27.488863  8073 raft_consensus.cc:2468] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:27.490315  8438 raft_consensus.cc:2804] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.490857  8438 raft_consensus.cc:697] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:27.491695  8438 consensus_queue.cc:237] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.495795  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:27.496423  7998 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.498062  8362 consensus_queue.cc:237] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.499166  7967 leader_election.cc:304] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.500365  8504 raft_consensus.cc:2804] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.500856  8504 raft_consensus.cc:697] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:27.501211  7925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:27.501677  8504 consensus_queue.cc:237] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.477380  8483 raft_consensus.cc:697] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:27.522658  8498 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:27.523681  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:27.525687  8149 raft_consensus.cc:2468] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:27.527801  8197 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:27.530447  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:27.531947  8115 leader_election.cc:343] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.533427  8194 tablet_bootstrap.cc:492] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:27.533946  8194 ts_tablet_manager.cc:1403] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.452s	user 0.015s	sys 0.021s
I20260709 13:03:27.534176  8514 consensus_queue.cc:1048] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.533973  8195 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:27.540364  7892 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:27.543118  8501 raft_consensus.cc:2749] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:27.544680  8512 log.cc:927] Time spent T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:27.544540  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.545462  7926 raft_consensus.cc:2393] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
I20260709 13:03:27.548301  8333 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.549777  8195 tablet_bootstrap.cc:654] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.550971  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.552816  8194 raft_consensus.cc:359] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.553545  8194 raft_consensus.cc:385] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.553797  8194 raft_consensus.cc:740] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.554471  8194 consensus_queue.cc:260] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.557966  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:27.558594  8148 raft_consensus.cc:3060] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.577055  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ebe75a90346379724aca3aad860e2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.577812  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:27.578686  8002 raft_consensus.cc:3060] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.581182  7822 catalog_manager.cc:5697] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.583995  7890 leader_election.cc:304] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:27.570489  8039 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:27.590374  8362 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.590793  8493 raft_consensus.cc:2749] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.593034  8194 ts_tablet_manager.cc:1434] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.003s
I20260709 13:03:27.597518  8198 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:27.598037  8198 ts_tablet_manager.cc:1403] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.250s	user 0.007s	sys 0.023s
I20260709 13:03:27.598696  7926 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.606354  8148 raft_consensus.cc:2468] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:27.621251  8194 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:27.622001  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:27.622485  8366 consensus_queue.cc:1048] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.599537  7820 catalog_manager.cc:5697] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.627048  8198 raft_consensus.cc:359] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.627777  8198 raft_consensus.cc:385] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.628068  8198 raft_consensus.cc:740] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.592051  8483 consensus_queue.cc:237] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:27.636849  7967 consensus_peers.cc:597] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.642367  8194 tablet_bootstrap.cc:654] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.647961  8362 raft_consensus.cc:2749] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.648048  8197 tablet_bootstrap.cc:654] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.650772  7998 raft_consensus.cc:2468] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:27.657490  8505 raft_consensus.cc:515] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.648697  8198 consensus_queue.cc:260] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.672470  7890 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.673352  8493 raft_consensus.cc:2804] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.673825  8493 raft_consensus.cc:697] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:27.674599  8493 consensus_queue.cc:237] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.702203  8198 ts_tablet_manager.cc:1434] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.002s
I20260709 13:03:27.703409  8198 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:27.705919  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:27.706661  8072 raft_consensus.cc:3060] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.709539  8198 tablet_bootstrap.cc:654] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.713223  8073 raft_consensus.cc:2468] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:27.715991  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:27.717360  8195 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:27.676954  8002 raft_consensus.cc:2468] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:27.717876  8195 ts_tablet_manager.cc:1403] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.008s
I20260709 13:03:27.718811  8113 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:27.720846  8195 raft_consensus.cc:359] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.721504  8195 raft_consensus.cc:385] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.722119  8195 raft_consensus.cc:740] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.676134  8505 leader_election.cc:290] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:27.727151  8199 consensus_queue.cc:1048] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:27.724746  8115 leader_election.cc:343] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.725329  8333 raft_consensus.cc:2804] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.731807  8333 raft_consensus.cc:697] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:27.732617  8333 consensus_queue.cc:237] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.737476  8195 consensus_queue.cc:260] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.744541  8072 raft_consensus.cc:2468] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:27.757684  8366 consensus_queue.cc:1048] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.759608  8115 leader_election.cc:304] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:27.760927  8502 raft_consensus.cc:2804] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:27.753702  8195 ts_tablet_manager.cc:1434] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:03:27.761446  8502 raft_consensus.cc:697] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:27.764993  7822 catalog_manager.cc:5697] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.770047  8502 consensus_queue.cc:237] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.781245  8197 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:27.780682  7822 catalog_manager.cc:5697] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.781770  8197 ts_tablet_manager.cc:1403] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.266s	user 0.018s	sys 0.021s
I20260709 13:03:27.785288  8195 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:27.786677  7822 catalog_manager.cc:5697] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.805197  8194 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:27.805972  8194 ts_tablet_manager.cc:1403] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.187s	user 0.020s	sys 0.002s
I20260709 13:03:27.809667  8194 raft_consensus.cc:359] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.810462  8194 raft_consensus.cc:385] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.810822  8194 raft_consensus.cc:740] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.816560  8194 consensus_queue.cc:260] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.835126  7823 catalog_manager.cc:5697] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.836823  8197 raft_consensus.cc:359] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.824219  8504 raft_consensus.cc:493] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.841207  8197 raft_consensus.cc:385] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.841570  8197 raft_consensus.cc:740] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.845348  8504 raft_consensus.cc:515] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.847472  8504 leader_election.cc:290] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:27.851781  8514 raft_consensus.cc:493] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.852316  8514 raft_consensus.cc:515] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.852952  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:27.855088  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dd7f48731264748981e15dd47fb7bb6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:27.855867  8150 raft_consensus.cc:2393] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate 8e7be6d583414e048a2528f06bc9bb4f in this term.
I20260709 13:03:27.857110  7967 leader_election.cc:304] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
W20260709 13:03:27.858937  8041 consensus_peers.cc:597] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.859794  8197 consensus_queue.cc:260] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.861567  8197 ts_tablet_manager.cc:1434] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.002s
I20260709 13:03:27.860181  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.862834  8295 raft_consensus.cc:3060] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.863600  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.854373  8514 leader_election.cc:290] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:27.865033  8041 leader_election.cc:343] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.867130  8195 tablet_bootstrap.cc:654] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.862939  8000 raft_consensus.cc:2468] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:27.868849  8039 leader_election.cc:304] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:27.869697  8514 raft_consensus.cc:2804] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.870052  8514 raft_consensus.cc:493] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.870390  8514 raft_consensus.cc:3060] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:27.880812  8295 raft_consensus.cc:2749] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.883173  8197 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:27.886205  8504 consensus_queue.cc:1048] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.887529  8496 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.892005  8194 ts_tablet_manager.cc:1434] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.004s
I20260709 13:03:27.908607  8366 raft_consensus.cc:493] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.909457  8198 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:27.909227  8366 raft_consensus.cc:515] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:27.909947  8198 ts_tablet_manager.cc:1403] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.207s	user 0.026s	sys 0.008s
I20260709 13:03:27.911499  8366 leader_election.cc:290] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:27.913038  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.900815  8496 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:27.933528  8194 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
W20260709 13:03:27.925972  8039 leader_election.cc:343] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.937493  8198 raft_consensus.cc:359] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.934955  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.939942  8198 raft_consensus.cc:385] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:27.940266  8198 raft_consensus.cc:740] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:27.940852  8198 consensus_queue.cc:260] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:27.944391  8198 ts_tablet_manager.cc:1434] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 13:03:27.945364  8198 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:27.953946  8199 raft_consensus.cc:493] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.954439  8199 raft_consensus.cc:515] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:27.954511  8366 consensus_queue.cc:1048] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:27.956365  8199 leader_election.cc:290] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:27.956913  8199 consensus_queue.cc:1048] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.958001  8362 consensus_queue.cc:1048] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:27.960422  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:27.961037  7922 raft_consensus.cc:2468] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:27.962381  7967 leader_election.cc:304] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:27.966056  8197 tablet_bootstrap.cc:654] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:27.967346  8199 raft_consensus.cc:2804] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:27.967249  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:27.967922  8199 raft_consensus.cc:493] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.968357  8199 raft_consensus.cc:3060] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:27.969213  7967 leader_election.cc:343] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:27.970638  8041 leader_election.cc:343] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:27.971639  8041 leader_election.cc:304] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:27.978968  8362 raft_consensus.cc:2749] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:27.988593  8496 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:27.986871  7820 catalog_manager.cc:5697] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.988714  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:27.999356  8195 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:28.002067  8195 ts_tablet_manager.cc:1403] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.228s	user 0.020s	sys 0.002s
I20260709 13:03:28.006078  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:28.009954  8115 leader_election.cc:343] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.011044  8514 raft_consensus.cc:515] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.015960  8002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:28.016567  8002 raft_consensus.cc:3060] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.018492  8198 tablet_bootstrap.cc:654] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.027072  8195 raft_consensus.cc:359] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.030404  8195 raft_consensus.cc:385] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.030836  8195 raft_consensus.cc:740] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.035965  7825 catalog_manager.cc:5697] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.035065  8195 consensus_queue.cc:260] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:28.050930  8113 leader_election.cc:343] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.051630  8113 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:28.053190  8333 raft_consensus.cc:2749] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.054200  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:28.034157  8514 leader_election.cc:290] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:28.063553  8199 raft_consensus.cc:515] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.070422  8195 ts_tablet_manager.cc:1434] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:03:28.071660  8195 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
W20260709 13:03:28.089964  8041 leader_election.cc:343] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.095239  8195 tablet_bootstrap.cc:654] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.098649  8199 leader_election.cc:290] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:28.101780  8362 consensus_queue.cc:1048] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.102562  8194 tablet_bootstrap.cc:654] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.104393  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:28.105021  7926 raft_consensus.cc:3060] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.105490  8002 raft_consensus.cc:2468] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:28.112852  8039 leader_election.cc:304] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:28.118137  8198 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:28.118722  8198 ts_tablet_manager.cc:1403] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.174s	user 0.031s	sys 0.025s
I20260709 13:03:28.121399  8198 raft_consensus.cc:359] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.122057  8198 raft_consensus.cc:385] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.122310  8198 raft_consensus.cc:740] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.123208  8438 raft_consensus.cc:2804] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.123757  8438 raft_consensus.cc:697] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:28.125065  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:28.124697  8438 consensus_queue.cc:237] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.124173  8198 consensus_queue.cc:260] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.127177  8198 ts_tablet_manager.cc:1434] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:28.128285  8198 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:28.129029  8507 raft_consensus.cc:493] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.129714  8507 raft_consensus.cc:515] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.132409  8507 leader_election.cc:290] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:28.133401  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:28.138021  7927 raft_consensus.cc:3060] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.142478  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab7e0f3150e480ea34f7b131978b028" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:28.143798  7967 leader_election.cc:343] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.144133  7892 leader_election.cc:304] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:28.148962  8362 consensus_queue.cc:1048] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.150370  8507 consensus_queue.cc:1048] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.160014  8198 tablet_bootstrap.cc:654] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.170960  7926 raft_consensus.cc:2468] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:28.181063  7967 leader_election.cc:304] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:28.182328  8199 raft_consensus.cc:2804] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.182763  8199 raft_consensus.cc:697] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:28.183370  8199 consensus_queue.cc:237] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.213085  8194 tablet_bootstrap.cc:492] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:28.213778  8194 ts_tablet_manager.cc:1403] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.286s	user 0.023s	sys 0.011s
I20260709 13:03:28.246420  8514 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.251163  8514 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.261981  8463 consensus_queue.cc:1048] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.262512  8195 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:28.263016  8195 ts_tablet_manager.cc:1403] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.001s
I20260709 13:03:28.271584  8195 raft_consensus.cc:359] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.272253  8195 raft_consensus.cc:385] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.272504  8195 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.272535  7825 catalog_manager.cc:5697] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.273164  8195 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.274582  8195 ts_tablet_manager.cc:1434] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:03:28.274978  8194 raft_consensus.cc:359] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.275856  8194 raft_consensus.cc:385] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.276108  8194 raft_consensus.cc:740] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.276335  8195 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:28.276785  8194 consensus_queue.cc:260] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.278286  8333 consensus_queue.cc:1048] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.279095  7820 catalog_manager.cc:5697] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.280086  8194 ts_tablet_manager.cc:1434] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.001s
I20260709 13:03:28.283596  8195 tablet_bootstrap.cc:654] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.293850  8507 raft_consensus.cc:493] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.294483  8507 raft_consensus.cc:515] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.312959  8194 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:28.332199  8199 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.332913  8199 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.329247  8507 leader_election.cc:290] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:28.346076  7924 raft_consensus.cc:3060] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.346496  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:28.358157  8197 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:28.358729  8197 ts_tablet_manager.cc:1403] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.496s	user 0.018s	sys 0.008s
I20260709 13:03:28.361665  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b05fd148ee7149088d25a5342739c87e" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:28.366288  8115 consensus_peers.cc:597] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.367703  8514 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:28.368543  8493 raft_consensus.cc:2749] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.375411  8199 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:28.374416  8197 raft_consensus.cc:359] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.368557  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:28.376856  8197 raft_consensus.cc:385] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.377086  8148 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:28.377188  8197 raft_consensus.cc:740] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.378367  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:28.378190  8197 consensus_queue.cc:260] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.379065  7999 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:28.380048  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:28.380656  8072 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:28.381601  8197 ts_tablet_manager.cc:1434] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:03:28.382653  8197 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:28.386229  7967 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:28.388196  8504 raft_consensus.cc:2804] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.388391  8041 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:28.388633  8504 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.389091  8504 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.392478  8195 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:28.392997  8195 ts_tablet_manager.cc:1403] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.017s
I20260709 13:03:28.392535  8514 raft_consensus.cc:2804] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:28.395099  8514 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.395444  8514 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.396273  8493 consensus_queue.cc:1048] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:28.396342  8483 consensus_queue.cc:1048] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:28.407374  8194 tablet_bootstrap.cc:654] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.412847  8195 raft_consensus.cc:359] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.413614  8195 raft_consensus.cc:385] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.413872  8195 raft_consensus.cc:740] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.414491  8195 consensus_queue.cc:260] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.430060  8195 ts_tablet_manager.cc:1434] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:03:28.439054  8198 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:28.439800  8198 ts_tablet_manager.cc:1403] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.312s	user 0.017s	sys 0.021s
I20260709 13:03:28.443521  7892 leader_election.cc:304] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:28.449730  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:28.427578  8558 consensus_queue.cc:1048] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:28.450728  8146 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:28.459067  8195 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:28.463255  8563 raft_consensus.cc:2749] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.488792  7923 raft_consensus.cc:3060] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.485611  8567 raft_consensus.cc:493] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.489482  8567 raft_consensus.cc:515] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.450287  8514 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.491673  8567 leader_election.cc:290] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:28.492779  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:28.494520  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4114d662304b8293dc9591163d2125" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:28.494956  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:28.495297  7926 raft_consensus.cc:2393] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:28.495587  8149 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.498667  8483 raft_consensus.cc:493] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.499743  8115 leader_election.cc:304] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:28.500028  8483 raft_consensus.cc:515] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.500617  8504 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.501296  8564 raft_consensus.cc:3060] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.503588  8197 tablet_bootstrap.cc:654] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.503724  8483 leader_election.cc:290] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:28.504146  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:28.505012  8075 raft_consensus.cc:2393] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate 8e7be6d583414e048a2528f06bc9bb4f in this term.
I20260709 13:03:28.503412  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:28.511512  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:28.516968  8567 consensus_queue.cc:1048] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:03:28.507526  8514 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:28.520478  8198 raft_consensus.cc:359] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.528586  8198 raft_consensus.cc:385] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.528930  8198 raft_consensus.cc:740] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
W20260709 13:03:28.532172  8041 leader_election.cc:343] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.532956  8504 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:28.531175  8198 consensus_queue.cc:260] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.534485  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:28.535138  8564 raft_consensus.cc:2749] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.536065  8198 ts_tablet_manager.cc:1434] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:03:28.536113  7967 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:28.539403  8504 raft_consensus.cc:2749] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:03:28.543093  8041 leader_election.cc:343] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.543543  8041 leader_election.cc:304] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:28.544360  8558 raft_consensus.cc:2749] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:28.528371  8514 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.551122  8514 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:28.553689  8514 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:28.554916  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:28.556423  8041 leader_election.cc:343] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.558952  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:28.559789  7999 raft_consensus.cc:2393] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:28.563845  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:28.565013  8041 leader_election.cc:343] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:28.568809  8041 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:28.567710  8197 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:28.569842  8197 ts_tablet_manager.cc:1403] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.187s	user 0.006s	sys 0.008s
I20260709 13:03:28.570447  8558 raft_consensus.cc:2749] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:28.573920  8566 log.cc:927] Time spent T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:28.569329  8195 tablet_bootstrap.cc:654] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.579166  8197 raft_consensus.cc:359] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.582882  8197 raft_consensus.cc:385] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.583256  8197 raft_consensus.cc:740] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.584643  8198 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:28.588064  8194 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:28.588822  8194 ts_tablet_manager.cc:1403] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.279s	user 0.012s	sys 0.013s
I20260709 13:03:28.565231  8149 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
W20260709 13:03:28.608310  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:28.651849  8559 raft_consensus.cc:493] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e7be6d583414e048a2528f06bc9bb4f)
I20260709 13:03:28.656553  8559 raft_consensus.cc:515] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.663702  8198 tablet_bootstrap.cc:654] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.679226  8194 raft_consensus.cc:359] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.679404  8197 consensus_queue.cc:260] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.680151  8194 raft_consensus.cc:385] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.680508  8194 raft_consensus.cc:740] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.683429  8194 consensus_queue.cc:260] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.700649  8438 consensus_queue.cc:1048] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:28.705062  8197 ts_tablet_manager.cc:1434] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.000s
I20260709 13:03:28.706346  8197 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:28.711848  8041 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:28.719163  8199 consensus_queue.cc:1048] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:28.681799  8564 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.735399  8194 ts_tablet_manager.cc:1434] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.001s
I20260709 13:03:28.753245  8195 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:28.753839  8195 ts_tablet_manager.cc:1403] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.315s	user 0.017s	sys 0.001s
I20260709 13:03:28.727360  8438 raft_consensus.cc:2804] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:28.760529  8194 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:28.765762  8198 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:28.766366  8198 ts_tablet_manager.cc:1403] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.017s
I20260709 13:03:28.733253  8564 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.779872  7924 raft_consensus.cc:3060] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:28.766304  8438 raft_consensus.cc:697] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:28.795465  8194 tablet_bootstrap.cc:654] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.796330  8198 raft_consensus.cc:359] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.806777  8198 raft_consensus.cc:385] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.807148  8198 raft_consensus.cc:740] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.799685  8559 leader_election.cc:290] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:28.801076  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:28.824028  8195 raft_consensus.cc:359] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.828799  8438 consensus_queue.cc:237] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:28.850852  8195 raft_consensus.cc:385] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:28.808058  8198 consensus_queue.cc:260] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.851284  8195 raft_consensus.cc:740] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:28.854776  8195 consensus_queue.cc:260] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:28.852723  8563 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.875784  8195 ts_tablet_manager.cc:1434] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.122s	user 0.007s	sys 0.002s
I20260709 13:03:28.879704  8198 ts_tablet_manager.cc:1434] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.113s	user 0.005s	sys 0.002s
I20260709 13:03:28.890200  8195 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:28.898348  8197 tablet_bootstrap.cc:654] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:28.873656  8563 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:28.903165  8198 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:28.903765  8564 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:28.942467  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45223, user_credentials={real_user=slave}} blocked reactor thread for 136550us
I20260709 13:03:28.950546  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:28.981838  8115 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.001929  8507 raft_consensus.cc:493] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.002547  8507 raft_consensus.cc:515] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.005151  8507 leader_election.cc:290] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.013187  8563 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.015307  8195 tablet_bootstrap.cc:654] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.034127  7924 raft_consensus.cc:3060] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.046176  8198 tablet_bootstrap.cc:654] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:29.063030  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 77269.4us
W20260709 13:03:29.069696  7892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45223, user_credentials={real_user=slave}} blocked reactor thread for 96198.3us
I20260709 13:03:29.071031  8483 consensus_queue.cc:1048] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:03:29.094270  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c57f47c624d4610b8a17b50701ede64" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.095288  8194 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.095675  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.088716  8366 raft_consensus.cc:493] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.096987  8366 raft_consensus.cc:515] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:29.098258  8113 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.098752  8113 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.099189  8366 leader_election.cc:290] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.100514  8298 raft_consensus.cc:2749] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.101213  8197 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.101667  8197 ts_tablet_manager.cc:1403] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.396s	user 0.019s	sys 0.031s
I20260709 13:03:29.103083  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.095777  8194 ts_tablet_manager.cc:1403] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.344s	user 0.019s	sys 0.014s
W20260709 13:03:29.106803  8041 leader_election.cc:343] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.086503  8543 consensus_queue.cc:1048] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:03:29.110548  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.113895  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.120643  8194 raft_consensus.cc:359] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.121438  8194 raft_consensus.cc:385] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.121706  8194 raft_consensus.cc:740] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.124801  8197 raft_consensus.cc:359] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.125540  8197 raft_consensus.cc:385] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.125820  8197 raft_consensus.cc:740] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.127373  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa58a98b8994582a9cd95d99596f4ea" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.122361  8194 consensus_queue.cc:260] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.129973  8194 ts_tablet_manager.cc:1434] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:03:29.126492  8197 consensus_queue.cc:260] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.132036  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.136729  8198 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.130997  8195 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:29.137311  8198 ts_tablet_manager.cc:1403] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.017s
I20260709 13:03:29.137629  8195 ts_tablet_manager.cc:1403] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.255s	user 0.010s	sys 0.010s
I20260709 13:03:29.140071  8198 raft_consensus.cc:359] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.140857  8198 raft_consensus.cc:385] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.141184  8198 raft_consensus.cc:740] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.141101  7822 catalog_manager.cc:5697] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.142892  8197 ts_tablet_manager.cc:1434] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:03:29.152482  8197 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:29.153530  8194 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.156224  8496 raft_consensus.cc:493] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.156713  8496 raft_consensus.cc:515] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.158746  8496 leader_election.cc:290] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.159354  7890 leader_election.cc:304] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.160368  8561 raft_consensus.cc:2749] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:29.159430  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.161142  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:29.162796  8113 leader_election.cc:343] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:29.163995  8115 leader_election.cc:343] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.164405  8115 leader_election.cc:304] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.165407  8496 raft_consensus.cc:2749] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.165336  8195 raft_consensus.cc:359] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.166181  8195 raft_consensus.cc:385] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.166476  8195 raft_consensus.cc:740] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.169727  8194 tablet_bootstrap.cc:654] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.171062  8197 tablet_bootstrap.cc:654] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.179984  8195 consensus_queue.cc:260] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.201511  8195 ts_tablet_manager.cc:1434] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.002s
I20260709 13:03:29.202564  8195 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:29.142211  8198 consensus_queue.cc:260] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.206544  8198 ts_tablet_manager.cc:1434] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:03:29.207640  8198 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.213204  8198 tablet_bootstrap.cc:654] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.214993  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
W20260709 13:03:29.223722  8039 leader_election.cc:343] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.224326  8039 leader_election.cc:304] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.230774  8543 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.231325  8543 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.232191  8596 raft_consensus.cc:493] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.232683  8596 raft_consensus.cc:515] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.233518  8543 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:29.233588  7890 leader_election.cc:304] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.233968  8587 raft_consensus.cc:2749] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.235049  7890 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.235953  8592 raft_consensus.cc:2749] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:29.235329  8596 leader_election.cc:290] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.237251  8507 raft_consensus.cc:2749] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.245779  8195 tablet_bootstrap.cc:654] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.249688  8198 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.250352  8198 ts_tablet_manager.cc:1403] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.003s
I20260709 13:03:29.255149  8198 raft_consensus.cc:359] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.258451  8198 raft_consensus.cc:385] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.258850  8198 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.255716  8197 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.260052  8197 ts_tablet_manager.cc:1403] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.013s
I20260709 13:03:29.259717  8198 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.251660  8194 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.262226  8194 ts_tablet_manager.cc:1403] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.017s
I20260709 13:03:29.263880  8198 ts_tablet_manager.cc:1434] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:29.265141  8198 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.264894  8194 raft_consensus.cc:359] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.265712  8194 raft_consensus.cc:385] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.266104  8194 raft_consensus.cc:740] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.266775  8194 consensus_queue.cc:260] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.268724  8194 ts_tablet_manager.cc:1434] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:29.270901  8197 raft_consensus.cc:359] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.271606  8197 raft_consensus.cc:385] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.271909  8197 raft_consensus.cc:740] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.269726  8194 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.274504  8198 tablet_bootstrap.cc:654] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.278669  8194 tablet_bootstrap.cc:654] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.281477  8197 consensus_queue.cc:260] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.283625  8197 ts_tablet_manager.cc:1434] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:03:29.284747  8197 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:29.288347  8198 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.289005  8198 ts_tablet_manager.cc:1403] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:03:29.291380  8197 tablet_bootstrap.cc:654] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.292076  8198 raft_consensus.cc:359] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.293520  8198 raft_consensus.cc:385] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.293856  8198 raft_consensus.cc:740] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.294637  8198 consensus_queue.cc:260] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.297183  8194 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.297672  8194 ts_tablet_manager.cc:1403] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 13:03:29.297770  8198 ts_tablet_manager.cc:1434] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:29.299068  8198 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.300631  8194 raft_consensus.cc:359] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.301329  8194 raft_consensus.cc:385] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.301600  8194 raft_consensus.cc:740] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.302264  8194 consensus_queue.cc:260] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.304466  8194 ts_tablet_manager.cc:1434] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:29.305437  8194 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.306305  8198 tablet_bootstrap.cc:654] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.321501  8579 raft_consensus.cc:493] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.321992  8579 raft_consensus.cc:515] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.324164  8579 leader_election.cc:290] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:29.324909  8198 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.325738  8198 ts_tablet_manager.cc:1403] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.006s
I20260709 13:03:29.324117  8194 tablet_bootstrap.cc:654] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.328438  8198 raft_consensus.cc:359] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.328652  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.329118  8198 raft_consensus.cc:385] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.329444  8198 raft_consensus.cc:740] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.330057  8198 consensus_queue.cc:260] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:29.332047  8115 leader_election.cc:343] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.332322  8198 ts_tablet_manager.cc:1434] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:29.333639  8198 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.338461  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.339104  8198 tablet_bootstrap.cc:654] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.339186  8073 raft_consensus.cc:2468] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:29.340488  8115 leader_election.cc:304] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:29.341610  8579 raft_consensus.cc:2804] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.342056  8579 raft_consensus.cc:493] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.342458  8579 raft_consensus.cc:3060] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.357179  8198 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.357721  8198 ts_tablet_manager.cc:1403] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.010s
W20260709 13:03:29.321041  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 63610.9us
I20260709 13:03:29.368924  8198 raft_consensus.cc:359] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.370200  8198 raft_consensus.cc:385] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.370438  8198 raft_consensus.cc:740] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.371057  8198 consensus_queue.cc:260] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.373140  8198 ts_tablet_manager.cc:1434] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:29.374303  8198 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.375483  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.377529  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.378144  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.378842  7924 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:29.380591  8198 tablet_bootstrap.cc:654] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.381924  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.382467  8073 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:29.360754  8579 raft_consensus.cc:515] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.364334  8197 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.387014  8197 ts_tablet_manager.cc:1403] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.011s
I20260709 13:03:29.388065  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:29.388707  8072 raft_consensus.cc:3060] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.389988  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:29.390120  8197 raft_consensus.cc:359] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.390825  8197 raft_consensus.cc:385] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.390962  8592 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.391129  8197 raft_consensus.cc:740] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
W20260709 13:03:29.391332  8115 leader_election.cc:343] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.365876  8195 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:29.391556  8592 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.392314  8195 ts_tablet_manager.cc:1403] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.000s
I20260709 13:03:29.391924  8197 consensus_queue.cc:260] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.394189  8197 ts_tablet_manager.cc:1434] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:29.395149  8197 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:29.396143  8072 raft_consensus.cc:2468] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:29.397344  8115 leader_election.cc:304] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:29.397533  8592 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.399091  8298 raft_consensus.cc:2804] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.399603  8298 raft_consensus.cc:697] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:29.400408  8298 consensus_queue.cc:237] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.401430  8197 tablet_bootstrap.cc:654] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.404717  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.405334  8149 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:29.405544  7967 leader_election.cc:304] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:29.406351  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.406586  8596 raft_consensus.cc:2804] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.407299  8596 raft_consensus.cc:493] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.407757  8596 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.408514  8366 consensus_queue.cc:1048] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.406666  7892 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:29.411487  8561 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.411625  8563 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.411907  8561 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.412302  8561 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.412220  8563 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.418422  8596 raft_consensus.cc:515] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.419786  8561 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.420596  8596 leader_election.cc:290] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
W20260709 13:03:29.421514  7967 leader_election.cc:343] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.422431  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.422310  8561 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:29.424155  7892 leader_election.cc:343] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.425414  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:29.426040  8148 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:29.427877  7967 leader_election.cc:343] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.428292  7967 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:29.366242  8194 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.385109  8507 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.429134  8194 ts_tablet_manager.cc:1403] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.014s
I20260709 13:03:29.429095  8507 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.414429  8563 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:29.431219  8507 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.433372  8366 consensus_queue.cc:1048] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.435539  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.439067  8543 raft_consensus.cc:2749] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:29.439277  7892 leader_election.cc:343] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.441206  8194 raft_consensus.cc:359] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.441879  8194 raft_consensus.cc:385] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.442140  8194 raft_consensus.cc:740] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.442787  8194 consensus_queue.cc:260] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.448022  8148 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:29.449533  7892 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:29.450129  8194 ts_tablet_manager.cc:1434] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:03:29.527004  8194 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.522338  7820 catalog_manager.cc:5697] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.479588  8543 raft_consensus.cc:493] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.531095  8543 raft_consensus.cc:515] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.450301  8507 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.532267  8507 raft_consensus.cc:697] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:29.533752  8543 leader_election.cc:290] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.462970  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.472064  8195 raft_consensus.cc:359] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.535579  8195 raft_consensus.cc:385] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.458280  8579 leader_election.cc:290] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:29.535898  8195 raft_consensus.cc:740] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.536777  8195 consensus_queue.cc:260] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.525557  8197 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.538122  8197 ts_tablet_manager.cc:1403] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.048s
I20260709 13:03:29.537989  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:29.538573  7924 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.539486  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:29.535713  8072 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:29.540066  8073 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.542780  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:29.544178  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.544770  7998 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:29.545687  7924 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:29.525760  8198 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.547513  8198 ts_tablet_manager.cc:1403] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.002s
I20260709 13:03:29.548645  8073 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:29.549445  8197 raft_consensus.cc:359] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.550109  8197 raft_consensus.cc:385] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.550405  8197 raft_consensus.cc:740] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.551379  8195 ts_tablet_manager.cc:1434] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.159s	user 0.005s	sys 0.005s
I20260709 13:03:29.552435  8195 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
W20260709 13:03:29.479261  7890 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:29.553244  7890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 74017.4us
I20260709 13:03:29.559597  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.561787  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.562386  8076 raft_consensus.cc:2468] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
I20260709 13:03:29.563633  8198 raft_consensus.cc:359] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.551069  8197 consensus_queue.cc:260] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.570775  8198 raft_consensus.cc:385] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.571827  8198 raft_consensus.cc:740] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.571938  7892 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:29.572860  8197 ts_tablet_manager.cc:1434] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:03:29.573596  8563 raft_consensus.cc:2804] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.573874  8197 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:29.574138  8563 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.574553  8563 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.575088  8194 tablet_bootstrap.cc:654] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.567494  8195 tablet_bootstrap.cc:654] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:29.567589  7890 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.566560  7967 leader_election.cc:304] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:29.578868  7890 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:29.579270  7967 leader_election.cc:304] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:29.579757  8592 raft_consensus.cc:2804] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.580153  8592 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.580492  8592 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.569211  8593 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.582166  8593 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
W20260709 13:03:29.582578  7967 leader_election.cc:343] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.584746  8593 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.584837  8585 raft_consensus.cc:2804] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.585922  8585 raft_consensus.cc:697] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:29.573516  8198 consensus_queue.cc:260] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.585242  8543 raft_consensus.cc:2804] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.586796  8543 raft_consensus.cc:493] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.586824  8585 consensus_queue.cc:237] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.587352  8543 raft_consensus.cc:3060] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.587770  7923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.590373  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.591140  7996 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:29.593286  8039 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:29.593781  8592 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.595614  8198 ts_tablet_manager.cc:1434] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:03:29.585032  8197 tablet_bootstrap.cc:654] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.596200  7923 raft_consensus.cc:2393] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
I20260709 13:03:29.596688  8198 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.597653  8592 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.599500  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:29.600099  7996 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.601066  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:29.601815  8076 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.540491  8507 consensus_queue.cc:237] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.607230  8496 raft_consensus.cc:493] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.607740  7996 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:29.607792  8496 raft_consensus.cc:515] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.610966  8483 raft_consensus.cc:493] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.611835  8483 raft_consensus.cc:515] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.613684  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.614675  8483 leader_election.cc:290] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:29.614583  7890 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:29.614392  7924 raft_consensus.cc:2468] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:29.615953  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.616582  8149 raft_consensus.cc:2468] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:29.617048  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.617471  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.618868  8115 leader_election.cc:304] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
W20260709 13:03:29.619520  8039 leader_election.cc:343] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:29.619576  8113 leader_election.cc:343] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.620503  8579 raft_consensus.cc:2804] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.620656  8041 leader_election.cc:304] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.619725  8563 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.636862  8194 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.637393  8194 ts_tablet_manager.cc:1403] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 13:03:29.637884  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:29.638559  8073 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.639246  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:29.629206  8483 raft_consensus.cc:2804] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.628515  8579 raft_consensus.cc:493] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.623600  8496 leader_election.cc:290] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.629490  8592 raft_consensus.cc:2804] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.650215  8076 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:29.650889  8198 tablet_bootstrap.cc:654] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.650529  8543 raft_consensus.cc:515] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.647607  8483 raft_consensus.cc:493] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.651840  8579 raft_consensus.cc:3060] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.652010  8197 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.657672  8197 ts_tablet_manager.cc:1403] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.010s
I20260709 13:03:29.655289  8438 raft_consensus.cc:2764] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:29.659548  8483 raft_consensus.cc:3060] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.648339  8563 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:29.664918  8197 raft_consensus.cc:359] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.665710  8197 raft_consensus.cc:385] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.668426  8197 raft_consensus.cc:740] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.666898  8579 raft_consensus.cc:515] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.657781  8592 raft_consensus.cc:697] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:29.684643  8592 consensus_queue.cc:237] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.671454  7820 catalog_manager.cc:5697] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.655007  7892 leader_election.cc:343] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.671976  8194 raft_consensus.cc:359] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.690059  8194 raft_consensus.cc:385] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.690332  8194 raft_consensus.cc:740] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.690995  8194 consensus_queue.cc:260] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.691571  8579 leader_election.cc:290] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:29.693280  8197 consensus_queue.cc:260] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.692443  7927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:29.694936  8194 ts_tablet_manager.cc:1434] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 13:03:29.713034  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:29.713927  8076 raft_consensus.cc:3060] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.714116  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:29.717226  8194 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.718921  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:29.719522  7924 raft_consensus.cc:3060] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.702329  8543 leader_election.cc:290] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.728992  8073 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:29.730502  7892 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:29.731074  8197 ts_tablet_manager.cc:1434] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.073s	user 0.001s	sys 0.005s
I20260709 13:03:29.733583  8197 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
W20260709 13:03:29.734784  7967 leader_election.cc:343] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.735313  8195 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:29.735795  8195 ts_tablet_manager.cc:1403] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.184s	user 0.023s	sys 0.015s
I20260709 13:03:29.734258  8507 raft_consensus.cc:2804] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.742435  8507 raft_consensus.cc:697] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:29.743345  8507 consensus_queue.cc:237] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.748529  7822 catalog_manager.cc:5697] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.753540  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:29.757143  8194 tablet_bootstrap.cc:654] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.764302  7820 catalog_manager.cc:5697] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:29.765035  8113 leader_election.cc:343] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.772295  8483 raft_consensus.cc:515] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.787915  8198 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.788762  8198 ts_tablet_manager.cc:1403] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.192s	user 0.019s	sys 0.006s
I20260709 13:03:29.790067  8197 tablet_bootstrap.cc:654] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.794996  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:29.795639  8146 raft_consensus.cc:3060] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.794190  8076 raft_consensus.cc:2468] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:29.798134  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:29.810467  8198 raft_consensus.cc:359] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.811259  8198 raft_consensus.cc:385] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.811524  8198 raft_consensus.cc:740] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
W20260709 13:03:29.820029  8039 leader_election.cc:343] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.792781  8483 leader_election.cc:290] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:29.824920  8563 raft_consensus.cc:493] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.825634  8563 raft_consensus.cc:515] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.826474  8198 consensus_queue.cc:260] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.829389  8563 leader_election.cc:290] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:29.831171  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.828377  8146 raft_consensus.cc:2468] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:29.832659  8198 ts_tablet_manager.cc:1434] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:03:29.832971  8041 leader_election.cc:304] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.834877  7924 raft_consensus.cc:2468] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:29.836004  8483 raft_consensus.cc:2804] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.836615  8483 raft_consensus.cc:697] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:29.837391  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117d9367cf76482abd217a33615ad4ef" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.837641  8483 consensus_queue.cc:237] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.838434  8072 raft_consensus.cc:2393] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb658b087424b87887d5bfef62d8084 in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:29.836453  8115 leader_election.cc:304] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.840097  8496 raft_consensus.cc:2804] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.840809  8198 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.843662  8195 raft_consensus.cc:359] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.845146  7967 leader_election.cc:304] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:29.847086  8298 raft_consensus.cc:493] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.856650  8298 raft_consensus.cc:515] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.858526  8628 raft_consensus.cc:2804] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:29.849342  7892 leader_election.cc:304] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:29.840585  8496 raft_consensus.cc:697] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:29.861161  8507 raft_consensus.cc:3060] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.861202  8496 consensus_queue.cc:237] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.863963  8197 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:29.858872  8298 leader_election.cc:290] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.864461  8197 ts_tablet_manager.cc:1403] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.004s
I20260709 13:03:29.865219  8195 raft_consensus.cc:385] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.865486  8195 raft_consensus.cc:740] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.847398  8198 tablet_bootstrap.cc:654] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.870208  8195 consensus_queue.cc:260] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.875352  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.876011  7996 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 0.
I20260709 13:03:29.873703  7820 catalog_manager.cc:5697] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.878157  7822 catalog_manager.cc:5697] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.880548  8507 raft_consensus.cc:2749] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.880714  8298 raft_consensus.cc:493] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.881281  8298 raft_consensus.cc:515] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.883366  8298 leader_election.cc:290] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:29.883958  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.885222  8195 ts_tablet_manager.cc:1434] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:03:29.886173  8195 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:29.887086  8194 tablet_bootstrap.cc:492] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.887576  8194 ts_tablet_manager.cc:1403] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.179s	user 0.010s	sys 0.003s
I20260709 13:03:29.892896  8195 tablet_bootstrap.cc:654] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:29.894506  8115 leader_election.cc:343] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.890440  8194 raft_consensus.cc:359] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.895116  8194 raft_consensus.cc:385] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.895426  8194 raft_consensus.cc:740] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.896260  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:29.896051  8194 consensus_queue.cc:260] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.866766  8628 raft_consensus.cc:697] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
W20260709 13:03:29.901624  8115 leader_election.cc:343] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.903038  8628 consensus_queue.cc:237] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.906096  8197 raft_consensus.cc:359] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.906772  8197 raft_consensus.cc:385] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.907002  8197 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.914242  8113 leader_election.cc:304] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:29.916566  8194 ts_tablet_manager.cc:1434] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:03:29.918560  7822 catalog_manager.cc:5697] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.920032  8197 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:29.924170  8496 raft_consensus.cc:2804] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:29.924515  8194 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.924693  8496 raft_consensus.cc:493] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.925199  8496 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.925554  8198 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.926012  8198 ts_tablet_manager.cc:1403] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.005s
I20260709 13:03:29.931855  8198 raft_consensus.cc:359] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.932631  8198 raft_consensus.cc:385] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.932940  8198 raft_consensus.cc:740] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.933579  8198 consensus_queue.cc:260] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:29.937475  8198 ts_tablet_manager.cc:1434] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:29.940742  8194 tablet_bootstrap.cc:654] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:29.942746  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:29.944286  8198 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:29.950873  8198 tablet_bootstrap.cc:654] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:29.953490  8113 leader_election.cc:343] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:29.954286  8113 leader_election.cc:304] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:29.955605  8579 raft_consensus.cc:2749] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.956938  8199 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.957456  8199 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.959326  8199 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:29.961783  8194 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:29.962262  8194 ts_tablet_manager.cc:1403] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 13:03:29.961548  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:29.963024  8146 raft_consensus.cc:2393] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
I20260709 13:03:29.963661  7924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:29.969691  7967 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:29.972179  8496 raft_consensus.cc:515] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:29.974228  8197 ts_tablet_manager.cc:1434] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 13:03:29.975034  8628 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:29.983897  8298 consensus_queue.cc:1048] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:29.984503  7822 catalog_manager.cc:5697] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.987286  8194 raft_consensus.cc:359] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.987991  8194 raft_consensus.cc:385] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:29.988250  8194 raft_consensus.cc:740] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:29.988893  8194 consensus_queue.cc:260] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:29.990006  8628 raft_consensus.cc:2749] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:29.991041  8194 ts_tablet_manager.cc:1434] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:03:29.992051  8194 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:29.994093  8197 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:29.996501  8198 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:29.997018  8198 ts_tablet_manager.cc:1403] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.005s
I20260709 13:03:29.998003  8592 raft_consensus.cc:493] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.998514  8592 raft_consensus.cc:515] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:30.000582  8592 leader_election.cc:290] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:30.001085  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:30.001688  7996 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.003255  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:30.004669  8199 consensus_queue.cc:1048] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.004077  8076 raft_consensus.cc:2393] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bb658b087424b87887d5bfef62d8084 in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:30.012776  8496 leader_election.cc:290] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:30.016603  8199 raft_consensus.cc:493] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.017230  8199 raft_consensus.cc:515] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.022030  8199 leader_election.cc:290] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:30.023567  8195 tablet_bootstrap.cc:492] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:30.024159  8195 ts_tablet_manager.cc:1403] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.004s
I20260709 13:03:30.023973  8198 raft_consensus.cc:359] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.027848  8198 raft_consensus.cc:385] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.028134  8198 raft_consensus.cc:740] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.028820  8198 consensus_queue.cc:260] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.026774  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:30.011309  8298 consensus_queue.cc:1048] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:03:30.036619  8076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:30.019762  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:30.043910  8197 tablet_bootstrap.cc:654] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.045571  7890 leader_election.cc:304] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:30.045671  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc77641f1caf4b5aa4ad012540fbb5a5" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:30.046456  8149 raft_consensus.cc:2393] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate 8e7be6d583414e048a2528f06bc9bb4f in this term.
I20260709 13:03:30.046589  8592 raft_consensus.cc:3060] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.046744  7996 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:30.049363  7967 leader_election.cc:304] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:30.051740  8625 raft_consensus.cc:3060] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.052431  8113 leader_election.cc:304] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:30.052695  8198 ts_tablet_manager.cc:1434] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.003s
I20260709 13:03:30.053437  8199 consensus_queue.cc:1048] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.057468  8564 raft_consensus.cc:2804] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.058161  8564 raft_consensus.cc:697] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:30.059329  8564 consensus_queue.cc:237] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.080615  8198 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:30.103154  8194 tablet_bootstrap.cc:654] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.121791  8199 raft_consensus.cc:493] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.122995  8199 raft_consensus.cc:515] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.135308  8195 raft_consensus.cc:359] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.136898  8195 raft_consensus.cc:385] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.137573  8195 raft_consensus.cc:740] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.090278  8507 consensus_queue.cc:1048] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
I20260709 13:03:30.147825  8195 consensus_queue.cc:260] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.152649  8199 leader_election.cc:290] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:30.154807  8073 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.166321  8197 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:30.172410  7921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:30.175107  8197 ts_tablet_manager.cc:1403] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.003s
I20260709 13:03:30.183751  8592 raft_consensus.cc:2749] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.185079  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:30.193805  8625 raft_consensus.cc:2749] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:30.195518  8592 consensus_queue.cc:1048] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.199848  8563 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.200970  8592 raft_consensus.cc:493] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.201503  8592 raft_consensus.cc:515] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.200341  8563 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.203586  8592 leader_election.cc:290] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:30.205304  7921 raft_consensus.cc:2393] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 1: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:30.206118  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:30.207480  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:30.208710  7892 leader_election.cc:343] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.209452  8592 consensus_queue.cc:1048] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.210266  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:30.210608  8507 consensus_queue.cc:1048] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.209563  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:30.210990  8074 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:30.211555  7998 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:30.211827  8073 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:30.212849  7890 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:30.214021  8592 raft_consensus.cc:2804] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.214452  8592 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.215021  8592 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.215579  7892 leader_election.cc:304] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:30.216760  8561 raft_consensus.cc:2804] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:30.217120  8561 raft_consensus.cc:493] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.217492  8561 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.219082  8563 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:30.225579  8198 tablet_bootstrap.cc:654] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.226145  7967 leader_election.cc:304] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:30.240075  8195 ts_tablet_manager.cc:1434] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.215s	user 0.014s	sys 0.000s
I20260709 13:03:30.234984  8543 raft_consensus.cc:3060] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.260699  8195 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
I20260709 13:03:30.272506  8149 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.277817  8561 raft_consensus.cc:515] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.279851  8194 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:30.279768  8563 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.282905  8197 raft_consensus.cc:359] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.295725  8197 raft_consensus.cc:385] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.296167  8197 raft_consensus.cc:740] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.296859  8197 consensus_queue.cc:260] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.290318  8194 ts_tablet_manager.cc:1403] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.298s	user 0.013s	sys 0.017s
I20260709 13:03:30.299211  8147 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 0.
I20260709 13:03:30.300643  8507 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.300947  8194 raft_consensus.cc:359] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.301611  8194 raft_consensus.cc:385] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.301884  8194 raft_consensus.cc:740] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.307868  8194 consensus_queue.cc:260] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:30.321157  8197 ts_tablet_manager.cc:1434] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.142s	user 0.006s	sys 0.001s
I20260709 13:03:30.324470  8194 ts_tablet_manager.cc:1434] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:03:30.326781  8194 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:30.331070  7820 catalog_manager.cc:5697] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:30.314553  8543 raft_consensus.cc:2749] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:30.333254  7892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 47149.8us
I20260709 13:03:30.374037  8197 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
W20260709 13:03:30.385069  8113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 60818.3us
I20260709 13:03:30.380199  8496 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.435165  8333 consensus_queue.cc:1048] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.413168  8496 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.438910  8496 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:30.442836  8194 tablet_bootstrap.cc:654] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.456301  8197 tablet_bootstrap.cc:654] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.424357  8561 leader_election.cc:290] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:30.460038  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:30.416234  8592 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.470654  8592 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:30.472261  8198 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:30.472811  8198 ts_tablet_manager.cc:1403] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.392s	user 0.028s	sys 0.022s
I20260709 13:03:30.473903  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:30.475407  8628 consensus_queue.cc:1048] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:30.475876  7892 leader_election.cc:343] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.477912  8074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:30.478605  8074 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:30.479313  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:30.479885  8147 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.480530  8198 raft_consensus.cc:359] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.483381  8198 raft_consensus.cc:385] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.483667  8198 raft_consensus.cc:740] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.484424  8198 consensus_queue.cc:260] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.486785  8198 ts_tablet_manager.cc:1434] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:03:30.487946  8195 tablet_bootstrap.cc:654] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:30.488970  8039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 66966.3us
W20260709 13:03:30.492497  8041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 138158us
W20260709 13:03:30.489117  7890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 85672.7us
I20260709 13:03:30.548378  8198 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:30.562417  8194 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:30.563181  8194 ts_tablet_manager.cc:1403] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.237s	user 0.013s	sys 0.004s
I20260709 13:03:30.619710  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:30.620385  8001 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:30.619365  8115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 111140us
I20260709 13:03:30.624717  8194 raft_consensus.cc:359] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:30.625787  8194 raft_consensus.cc:385] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.626164  8194 raft_consensus.cc:740] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.632261  8147 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:30.640189  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:30.662725  8075 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:30.671237  8115 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:30.672158  8298 raft_consensus.cc:2804] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:30.672574  8298 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:30.672925  8298 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.684556  8298 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.688714  8298 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:30.638461  8666 log.cc:927] Time spent T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:03:30.705552  8146 raft_consensus.cc:1240] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Rejecting Update request from peer 2bb658b087424b87887d5bfef62d8084 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:30.706964  8583 raft_consensus.cc:493] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.707695  8653 consensus_queue.cc:1059] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.707729  8583 raft_consensus.cc:515] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
W20260709 13:03:30.709685  8113 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 75086.6us
I20260709 13:03:30.711203  8663 raft_consensus.cc:3055] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:30.711724  8663 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:30.713487  8583 leader_election.cc:290] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:30.714555  8663 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.716248  8663 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.716800  8579 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.718468  8651 consensus_queue.cc:1048] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:30.634490  8194 consensus_queue.cc:260] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:30.744813  7892 leader_election.cc:304] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:30.752391  8194 ts_tablet_manager.cc:1434] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.189s	user 0.010s	sys 0.000s
I20260709 13:03:30.753603  8194 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: Bootstrap starting.
I20260709 13:03:30.763521  8001 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:30.735397  8543 raft_consensus.cc:493] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.766659  8543 raft_consensus.cc:515] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:30.759240  8563 raft_consensus.cc:2804] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.785310  8197 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:30.786448  8197 ts_tablet_manager.cc:1403] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.413s	user 0.014s	sys 0.006s
I20260709 13:03:30.774729  8663 raft_consensus.cc:493] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.789179  8663 raft_consensus.cc:515] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.791250  8663 leader_election.cc:290] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:30.797231  8194 tablet_bootstrap.cc:654] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.797396  8590 consensus_queue.cc:1048] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:30.799063  8067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:30.800314  8563 raft_consensus.cc:697] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:30.801294  8563 consensus_queue.cc:237] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.801657  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:30.803879  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:30.825165  7967 leader_election.cc:343] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:30.826023  8198 tablet_bootstrap.cc:654] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:30.834518  8197 raft_consensus.cc:359] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.835515  8197 raft_consensus.cc:385] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.835824  8197 raft_consensus.cc:740] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.836566  8197 consensus_queue.cc:260] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.829365  7890 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:30.840708  8670 raft_consensus.cc:2804] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:30.841233  8670 raft_consensus.cc:697] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:30.842255  8670 consensus_queue.cc:237] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:30.837957  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
W20260709 13:03:30.822957  7892 leader_election.cc:343] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:30.856949  8041 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:39687, user_credentials={real_user=slave}} blocked reactor thread for 64170.5us
I20260709 13:03:30.871680  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:30.874050  8197 ts_tablet_manager.cc:1434] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.004s
I20260709 13:03:30.882892  7926 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:30.895536  8195 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:30.896282  8195 ts_tablet_manager.cc:1403] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.645s	user 0.025s	sys 0.023s
I20260709 13:03:30.912343  8197 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:30.923287  8195 raft_consensus.cc:359] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.924017  8195 raft_consensus.cc:385] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:30.924324  8195 raft_consensus.cc:740] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:30.924527  8075 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:30.924985  8195 consensus_queue.cc:260] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:30.938360  8195 ts_tablet_manager.cc:1434] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:03:30.884502  8676 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20260709 13:03:30.950356  8194 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: No bootstrap required, opened a new log
I20260709 13:03:30.950984  8194 ts_tablet_manager.cc:1403] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent bootstrapping tablet: real 0.198s	user 0.008s	sys 0.012s
I20260709 13:03:30.966153  8195 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
W20260709 13:03:30.968972  8115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 45158.7us
I20260709 13:03:30.946179  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:30.971731  8115 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:30.981293  8333 raft_consensus.cc:2804] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:30.981844  8333 raft_consensus.cc:697] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:30.982764  8333 consensus_queue.cc:237] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:30.986164  8039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 113907us
W20260709 13:03:30.998062  8684 log.cc:927] Time spent T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:31.000355  8680 consensus_queue.cc:1048] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.005523  8543 leader_election.cc:290] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
W20260709 13:03:31.012156  7893 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.993980  8145 raft_consensus.cc:2468] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
W20260709 13:03:31.020364  7892 leader_election.cc:343] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.020869  7892 leader_election.cc:304] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:31.022189  8663 raft_consensus.cc:2749] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.018105  8194 raft_consensus.cc:359] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.031052  8194 raft_consensus.cc:385] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.031472  8194 raft_consensus.cc:740] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.032207  8194 consensus_queue.cc:260] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.034636  8194 ts_tablet_manager.cc:1434] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:03:31.035252  8197 tablet_bootstrap.cc:654] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.056321  8195 tablet_bootstrap.cc:654] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.086513  8198 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:31.087039  8198 ts_tablet_manager.cc:1403] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.573s	user 0.014s	sys 0.003s
I20260709 13:03:31.090184  8198 raft_consensus.cc:359] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.090689  8680 raft_consensus.cc:493] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.090925  8198 raft_consensus.cc:385] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.091233  8198 raft_consensus.cc:740] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.091922  8198 consensus_queue.cc:260] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.093964  8198 ts_tablet_manager.cc:1434] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:03:31.091238  8680 raft_consensus.cc:515] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:31.097635  8680 leader_election.cc:290] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:31.098084  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.100596  8198 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:31.114426  7926 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:31.119140  8041 leader_election.cc:304] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
W20260709 13:03:31.119881  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 168805us
I20260709 13:03:31.120093  8691 raft_consensus.cc:2804] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.120610  7825 catalog_manager.cc:5697] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.122030  8691 raft_consensus.cc:493] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.122474  8691 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.126744  8197 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:31.127275  8197 ts_tablet_manager.cc:1403] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.014s
I20260709 13:03:31.132898  8197 raft_consensus.cc:359] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:31.133567  8197 raft_consensus.cc:385] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.133839  8197 raft_consensus.cc:740] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.134351  7825 catalog_manager.cc:5697] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.135648  8197 consensus_queue.cc:260] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:31.136397  8198 tablet_bootstrap.cc:654] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.137986  8195 tablet_bootstrap.cc:492] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:31.138489  8195 ts_tablet_manager.cc:1403] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.000s
I20260709 13:03:31.139478  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:31.140110  8146 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
W20260709 13:03:31.146209  7873 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:31.141319  8195 raft_consensus.cc:359] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:31.146755  8195 raft_consensus.cc:385] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.147055  8195 raft_consensus.cc:740] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.148310  8626 consensus_queue.cc:1048] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.149150  8197 ts_tablet_manager.cc:1434] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:03:31.150146  8197 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: Bootstrap starting.
I20260709 13:03:31.150900  8195 consensus_queue.cc:260] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:31.151346  8691 raft_consensus.cc:515] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:31.153474  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.157505  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:31.165434  8691 leader_election.cc:290] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:31.160147  7967 leader_election.cc:304] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:31.167459  8626 raft_consensus.cc:2804] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.167837  8626 raft_consensus.cc:493] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.168177  8626 raft_consensus.cc:3060] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.168716  7926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:31.169531  7926 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.173959  8695 raft_consensus.cc:493] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.174724  8695 raft_consensus.cc:515] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.177357  8695 leader_election.cc:290] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:31.178500  8195 ts_tablet_manager.cc:1434] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:03:31.185714  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.184127  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:31.187556  7922 raft_consensus.cc:2468] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 0.
W20260709 13:03:31.195997  7967 leader_election.cc:343] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.197258  8195 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: Bootstrap starting.
W20260709 13:03:31.197386  7967 leader_election.cc:343] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.197955  7967 leader_election.cc:304] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:31.198781  8695 raft_consensus.cc:2749] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.200469  7926 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:31.201696  8041 leader_election.cc:304] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:31.199637  7967 leader_election.cc:304] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:31.202564  8691 raft_consensus.cc:2804] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.203223  8691 raft_consensus.cc:697] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:31.203985  8688 raft_consensus.cc:2804] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.204205  8691 consensus_queue.cc:237] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:31.204883  8688 raft_consensus.cc:493] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.205586  8688 raft_consensus.cc:3060] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:31.209666  7967 leader_election.cc:343] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.215277  8651 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.228562  8651 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.230687  8651 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:31.236848  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:31.237020  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:31.237675  7998 raft_consensus.cc:2393] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 1: Already voted for candidate 2bb658b087424b87887d5bfef62d8084 in this term.
I20260709 13:03:31.239393  8195 tablet_bootstrap.cc:654] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.237671  8148 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.243865  8198 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: No bootstrap required, opened a new log
I20260709 13:03:31.244323  8198 ts_tablet_manager.cc:1403] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.144s	user 0.022s	sys 0.010s
I20260709 13:03:31.245971  8197 tablet_bootstrap.cc:654] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:31.246943  8198 raft_consensus.cc:359] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.247671  8198 raft_consensus.cc:385] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.247750  8148 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:31.247991  8198 raft_consensus.cc:740] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.250639  8626 raft_consensus.cc:515] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:31.251991  8198 consensus_queue.cc:260] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.252736  8626 leader_election.cc:290] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:31.256367  8198 ts_tablet_manager.cc:1434] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:03:31.257282  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:31.258138  8075 raft_consensus.cc:3060] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.261024  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:31.261613  8146 raft_consensus.cc:3060] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.263406  8195 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: No bootstrap required, opened a new log
I20260709 13:03:31.263904  8195 ts_tablet_manager.cc:1403] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.000s
I20260709 13:03:31.266700  8195 raft_consensus.cc:359] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.267311  8195 raft_consensus.cc:385] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.267549  8195 raft_consensus.cc:740] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.268364  8195 consensus_queue.cc:260] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.270953  8195 ts_tablet_manager.cc:1434] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:31.280112  7918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.280691  8146 raft_consensus.cc:2468] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:31.284241  7967 leader_election.cc:304] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:31.285386  8626 raft_consensus.cc:2804] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.285853  8626 raft_consensus.cc:697] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:31.286652  8626 consensus_queue.cc:237] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:31.290897  8688 raft_consensus.cc:515] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.292940  8688 leader_election.cc:290] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:31.295955  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:31.298552  7918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:31.299186  7918 raft_consensus.cc:3060] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.307096  8145 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.307525  7918 raft_consensus.cc:2468] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
W20260709 13:03:31.311887  7967 leader_election.cc:343] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:31.312772  7967 leader_election.cc:304] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:31.313467  8688 raft_consensus.cc:2804] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.314177  8688 raft_consensus.cc:697] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:31.315048  8688 consensus_queue.cc:237] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.328022  8115 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:31.343060  8075 raft_consensus.cc:2468] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:31.357126  7822 catalog_manager.cc:5697] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.367537  8298 raft_consensus.cc:2749] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.369190  8197 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: No bootstrap required, opened a new log
I20260709 13:03:31.369776  8197 ts_tablet_manager.cc:1403] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: Time spent bootstrapping tablet: real 0.220s	user 0.010s	sys 0.003s
I20260709 13:03:31.369742  8507 consensus_queue.cc:1048] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.372586  8197 raft_consensus.cc:359] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.373222  8197 raft_consensus.cc:385] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:31.373706  8197 raft_consensus.cc:740] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Initialized, Role: FOLLOWER
I20260709 13:03:31.374318  8197 consensus_queue.cc:260] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.376161  8197 ts_tablet_manager.cc:1434] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:03:31.377862  8298 raft_consensus.cc:493] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.378372  8298 raft_consensus.cc:515] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:31.380189  8298 leader_election.cc:290] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:31.382782  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.383983  7922 raft_consensus.cc:2393] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 1: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:31.407006  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:31.407437  8663 consensus_queue.cc:1048] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.408614  8113 leader_election.cc:304] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:31.409562  8298 raft_consensus.cc:3060] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.411178  8507 consensus_queue.cc:1048] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:31.421918  8298 raft_consensus.cc:2749] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:31.426394  7823 catalog_manager.cc:5697] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.429221  8507 consensus_queue.cc:1048] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.428295  7823 catalog_manager.cc:5697] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 0 to 1, leader changed from <none> to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.455475  8075 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.500873  7918 raft_consensus.cc:1275] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.503785  8333 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:31.504485  8075 raft_consensus.cc:1275] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:31.509696  8298 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.530763  7822 catalog_manager.cc:5697] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:31.534412  8438 raft_consensus.cc:493] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.535004  8438 raft_consensus.cc:515] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.537933  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:31.538647  7922 raft_consensus.cc:2468] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:31.539829  8041 leader_election.cc:304] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:31.540586  8483 raft_consensus.cc:2804] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:31.540953  8483 raft_consensus.cc:493] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.541277  8483 raft_consensus.cc:3060] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.541383  8438 leader_election.cc:290] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:31.542405  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:31.543088  7998 raft_consensus.cc:2468] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 0.
I20260709 13:03:31.546952  8483 raft_consensus.cc:515] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.549471  7922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:31.550034  7922 raft_consensus.cc:3060] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.556645  8483 leader_election.cc:290] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:31.556821  7922 raft_consensus.cc:2468] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:31.557466  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26d79363387a421ab0dd5c8ee4a99a9c" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:31.558051  7998 raft_consensus.cc:3060] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:31.558166  8041 leader_election.cc:304] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:31.558943  8483 raft_consensus.cc:2804] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:31.559487  8483 raft_consensus.cc:697] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:31.560338  8483 consensus_queue.cc:237] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:31.566059  7998 raft_consensus.cc:2468] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:31.573602  7820 catalog_manager.cc:5697] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 1 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:31.714389  8626 consensus_queue.cc:1048] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.734736  8199 consensus_queue.cc:1048] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.790117  8483 consensus_queue.cc:1048] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.800442  8483 consensus_queue.cc:1048] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.830163  8199 consensus_queue.cc:1048] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.847527  8695 consensus_queue.cc:1048] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:31.872264   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:31.877563  8115 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:31.882179  8115 consensus_peers.cc:597] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.929994  8115 consensus_peers.cc:597] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.933501  8041 consensus_peers.cc:597] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.936236   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:31.937124   431 tablet_replica.cc:333] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.938236   431 raft_consensus.cc:2243] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.938798   431 raft_consensus.cc:2272] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.941573   431 tablet_replica.cc:333] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.942202   431 raft_consensus.cc:2243] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.943143   431 raft_consensus.cc:2272] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.945188   431 tablet_replica.cc:333] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.945796   431 raft_consensus.cc:2243] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.946228   431 raft_consensus.cc:2272] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.948488   431 tablet_replica.cc:333] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.949265   431 raft_consensus.cc:2243] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.949729   431 raft_consensus.cc:2272] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.951858   431 tablet_replica.cc:333] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.952430   431 raft_consensus.cc:2243] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:31.953353   431 raft_consensus.cc:2272] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.955451   431 tablet_replica.cc:333] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.956154   431 raft_consensus.cc:2243] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.956658   431 raft_consensus.cc:2272] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.958798   431 tablet_replica.cc:333] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.959296   431 raft_consensus.cc:2243] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.959590   431 raft_consensus.cc:2272] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.961277   431 tablet_replica.cc:333] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.962047   431 raft_consensus.cc:2243] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.962464   431 raft_consensus.cc:2272] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:31.964378  8041 consensus_peers.cc:597] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:31.964691   431 tablet_replica.cc:333] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.965356   431 raft_consensus.cc:2243] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.965768   431 raft_consensus.cc:2272] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.967732   431 tablet_replica.cc:333] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.968375   431 raft_consensus.cc:2243] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.968737   431 raft_consensus.cc:2272] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.970430   431 tablet_replica.cc:333] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.971218   431 raft_consensus.cc:2243] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.971737   431 raft_consensus.cc:2272] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.975497   431 tablet_replica.cc:333] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.977156   431 raft_consensus.cc:2243] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.978202   431 raft_consensus.cc:2272] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.984437   431 tablet_replica.cc:333] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:31.986256   431 raft_consensus.cc:2243] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.988461   431 raft_consensus.cc:2272] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.002830  8115 consensus_peers.cc:597] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.004782   431 tablet_replica.cc:333] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.006799   431 raft_consensus.cc:2243] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.008293   431 raft_consensus.cc:2272] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.013896   431 tablet_replica.cc:333] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.015009   431 raft_consensus.cc:2243] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.015544   431 raft_consensus.cc:2272] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.018397   431 tablet_replica.cc:333] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.019253   431 raft_consensus.cc:2243] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.019755   431 raft_consensus.cc:2272] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.022593   431 tablet_replica.cc:333] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
W20260709 13:03:32.023439  8115 consensus_peers.cc:597] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.023494   431 raft_consensus.cc:2243] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.024370   431 raft_consensus.cc:2272] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.024389  7967 consensus_peers.cc:597] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.025277  7967 consensus_peers.cc:597] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.027020   431 tablet_replica.cc:333] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.027911   431 raft_consensus.cc:2243] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.028415   431 raft_consensus.cc:2272] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.028693  8115 consensus_peers.cc:597] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.030800   431 tablet_replica.cc:333] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.031641   431 raft_consensus.cc:2243] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:03:32.032306  8115 consensus_peers.cc:597] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.032603   431 raft_consensus.cc:2272] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.035085   431 tablet_replica.cc:333] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.035719   431 raft_consensus.cc:2243] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.036144   431 raft_consensus.cc:2272] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.037883   431 tablet_replica.cc:333] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.038465   431 raft_consensus.cc:2243] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.038978   431 raft_consensus.cc:2272] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.041229   431 tablet_replica.cc:333] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.041988   431 raft_consensus.cc:2243] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.042443   431 raft_consensus.cc:2272] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.044514   431 tablet_replica.cc:333] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.045264   431 raft_consensus.cc:2243] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.045729   431 raft_consensus.cc:2272] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.047919   431 tablet_replica.cc:333] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.048614   431 raft_consensus.cc:2243] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.049124   431 raft_consensus.cc:2272] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.050585  8041 consensus_peers.cc:597] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.051379   431 tablet_replica.cc:333] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.052217   431 raft_consensus.cc:2243] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.052700   431 raft_consensus.cc:2272] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.053493  8483 consensus_queue.cc:1048] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:32.054999   431 tablet_replica.cc:333] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.055953   431 raft_consensus.cc:2243] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.056437   431 raft_consensus.cc:2272] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.059222   431 tablet_replica.cc:333] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.059942   431 raft_consensus.cc:2243] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.060470   431 raft_consensus.cc:2272] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.061654  8041 consensus_peers.cc:597] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.063277   431 tablet_replica.cc:333] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.064257   431 raft_consensus.cc:2243] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.064760   431 raft_consensus.cc:2272] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.066016  8115 consensus_peers.cc:597] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.067164   431 tablet_replica.cc:333] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.068117   431 raft_consensus.cc:2243] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.068656   431 raft_consensus.cc:2272] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.068802  8041 consensus_peers.cc:597] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.071632   431 tablet_replica.cc:333] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.072559   431 raft_consensus.cc:2243] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.073159   431 raft_consensus.cc:2272] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.079567   431 tablet_replica.cc:333] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.080912   431 raft_consensus.cc:2243] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.081545   431 raft_consensus.cc:2272] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.092216   431 tablet_replica.cc:333] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.093019   431 raft_consensus.cc:2243] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:32.093165  8115 consensus_peers.cc:597] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.093618   431 raft_consensus.cc:2272] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.094978  8115 consensus_peers.cc:597] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.095572  8115 consensus_peers.cc:597] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.095927  8041 consensus_peers.cc:597] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.096618   431 tablet_replica.cc:333] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.098654   431 raft_consensus.cc:2243] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.099556   431 raft_consensus.cc:2272] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.101920   431 tablet_replica.cc:333] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.102499   431 raft_consensus.cc:2243] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.103430   431 raft_consensus.cc:2272] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.105510   431 tablet_replica.cc:333] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.106043   431 raft_consensus.cc:2243] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.106439   431 raft_consensus.cc:2272] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.108103   431 tablet_replica.cc:333] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.108640   431 raft_consensus.cc:2243] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.109334   431 raft_consensus.cc:2272] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.111151   431 tablet_replica.cc:333] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.111682   431 raft_consensus.cc:2243] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.112089   431 raft_consensus.cc:2272] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.113785   431 tablet_replica.cc:333] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.114285   431 raft_consensus.cc:2243] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.115000   431 raft_consensus.cc:2272] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.116683   431 tablet_replica.cc:333] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.117198   431 raft_consensus.cc:2243] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.117660   431 raft_consensus.cc:2272] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.120434   431 tablet_replica.cc:333] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.121125   431 raft_consensus.cc:2243] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.121592   431 raft_consensus.cc:2272] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.124655   431 tablet_replica.cc:333] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.125340   431 raft_consensus.cc:2243] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.125810   431 raft_consensus.cc:2272] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.128011   431 tablet_replica.cc:333] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
W20260709 13:03:32.128545  8115 consensus_peers.cc:597] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.128808   431 raft_consensus.cc:2243] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.129397   431 raft_consensus.cc:2272] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.131718   431 tablet_replica.cc:333] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.132267   431 raft_consensus.cc:2243] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.132972   431 raft_consensus.cc:2272] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.134749   431 tablet_replica.cc:333] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.135216   431 raft_consensus.cc:2243] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.135898   431 raft_consensus.cc:2272] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.138027   431 tablet_replica.cc:333] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: stopping tablet replica
I20260709 13:03:32.138489   431 raft_consensus.cc:2243] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.139014   431 raft_consensus.cc:2272] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.149963  8115 consensus_peers.cc:597] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.151284  7967 consensus_peers.cc:597] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.151978  7967 consensus_peers.cc:597] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.163259  8041 consensus_peers.cc:597] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.189764  7967 consensus_peers.cc:597] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.216085  7967 consensus_peers.cc:597] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.222918   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:32.233103  8041 consensus_peers.cc:597] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.271126  8041 consensus_peers.cc:597] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.285341   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:32.288100  7967 consensus_peers.cc:597] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.293565  8729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.299713  8730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.301134  8732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:32.303994  7967 consensus_peers.cc:597] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.304450  7967 consensus_peers.cc:597] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.306718   431 server_base.cc:1061] running on GCE node
I20260709 13:03:32.311264   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:32.311570   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:32.311806   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602212311787 us; error 0 us; skew 500 ppm
I20260709 13:03:32.312641   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:32.317821   431 webserver.cc:533] Webserver started at http://127.0.107.193:38429/ using document root <none> and password file <none>
I20260709 13:03:32.318512   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:32.318747   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:03:32.322171   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
W20260709 13:03:32.330152  8115 consensus_peers.cc:597] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.334189  8738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:32.335152   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:03:32.335513   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "2bb658b087424b87887d5bfef62d8084"
format_stamp: "Formatted at 2026-07-09 13:03:19 on dist-test-slave-n5kz"
I20260709 13:03:32.336000   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:03:32.348204  8115 consensus_peers.cc:597] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.360262  7967 consensus_peers.cc:597] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.364732   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:32.366127   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:32.367486   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:32.372797  8745 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:03:32.373064  7967 consensus_peers.cc:597] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.416731  8115 consensus_peers.cc:597] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.433554  7967 consensus_peers.cc:597] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.650632   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:03:32.651027   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.279s	user 0.006s	sys 0.003s
I20260709 13:03:32.651381   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:03:32.656379  8745 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.669773  8745 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.670696  8745 tablet_bootstrap.cc:492] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.671283  8745 ts_tablet_manager.cc:1403] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:03:32.673025  8745 raft_consensus.cc:359] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:32.673530  8745 raft_consensus.cc:740] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.674084  8745 consensus_queue.cc:260] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:32.675902  8745 ts_tablet_manager.cc:1434] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:03:32.676538  8745 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.715849  8745 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.716739  8745 tablet_bootstrap.cc:492] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.717456  8745 ts_tablet_manager.cc:1403] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.020s
I20260709 13:03:32.719929  8745 raft_consensus.cc:359] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.720577  8745 raft_consensus.cc:740] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.721254  8745 consensus_queue.cc:260] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.723276  8745 ts_tablet_manager.cc:1434] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:32.724007  8745 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.738334  8745 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.739353  8745 tablet_bootstrap.cc:492] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.740082  8745 ts_tablet_manager.cc:1403] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:03:32.741945  8745 raft_consensus.cc:359] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:32.742452  8745 raft_consensus.cc:740] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.743127  8745 consensus_queue.cc:260] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:32.744844  8745 ts_tablet_manager.cc:1434] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:03:32.745656  8745 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.760842  8745 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.761736  8745 tablet_bootstrap.cc:492] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.762326  8745 ts_tablet_manager.cc:1403] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:03:32.764602  8745 raft_consensus.cc:359] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:32.765247  8745 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.765865  8745 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:32.767663  8745 ts_tablet_manager.cc:1434] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:03:32.768414  8745 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.781524  8745 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.782290  8745 tablet_bootstrap.cc:492] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.782910  8745 ts_tablet_manager.cc:1403] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:03:32.784845  8745 raft_consensus.cc:359] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.785446  8745 raft_consensus.cc:740] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.786080  8745 consensus_queue.cc:260] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.787722  8745 ts_tablet_manager.cc:1434] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:32.788338  8745 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.802310  8745 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.803977  8745 tablet_bootstrap.cc:492] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.804590  8745 ts_tablet_manager.cc:1403] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:03:32.806527  8745 raft_consensus.cc:359] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.807209  8745 raft_consensus.cc:740] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.807809  8745 consensus_queue.cc:260] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.811072  8745 ts_tablet_manager.cc:1434] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:32.819113  8745 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.855201  8745 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.856166  8745 tablet_bootstrap.cc:492] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.856818  8745 ts_tablet_manager.cc:1403] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.007s
I20260709 13:03:32.859058  8745 raft_consensus.cc:359] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:32.859694  8745 raft_consensus.cc:740] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.860357  8745 consensus_queue.cc:260] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:32.862244  8745 ts_tablet_manager.cc:1434] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:03:32.862962  8745 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.876189  8745 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.877110  8745 tablet_bootstrap.cc:492] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.877705  8745 ts_tablet_manager.cc:1403] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:03:32.880164  8745 raft_consensus.cc:359] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.880818  8745 raft_consensus.cc:740] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.881428  8745 consensus_queue.cc:260] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.883524  8745 ts_tablet_manager.cc:1434] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:32.884316  8745 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.899905  8745 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.900995  8745 tablet_bootstrap.cc:492] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.902256  8745 ts_tablet_manager.cc:1403] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:03:32.907109  8745 raft_consensus.cc:359] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.919361  8745 raft_consensus.cc:740] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.927301  8745 consensus_queue.cc:260] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.931493  8745 ts_tablet_manager.cc:1434] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:03:32.933271  8745 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:32.952471   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:03:32.952873   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.302s	user 0.250s	sys 0.000s
I20260709 13:03:32.962934  8745 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:32.963821  8745 tablet_bootstrap.cc:492] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:32.964587  8745 ts_tablet_manager.cc:1403] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.004s
I20260709 13:03:32.966538  8745 raft_consensus.cc:359] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.967427  8745 raft_consensus.cc:740] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:32.968360  8745 consensus_queue.cc:260] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:32.971076  8745 ts_tablet_manager.cc:1434] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:32.971911  8745 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.015970  8745 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.016945  8745 tablet_bootstrap.cc:492] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.017571  8745 ts_tablet_manager.cc:1403] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.010s
I20260709 13:03:33.020289  8745 raft_consensus.cc:359] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.020958  8745 raft_consensus.cc:740] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.021665  8745 consensus_queue.cc:260] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.023588  8745 ts_tablet_manager.cc:1434] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:03:33.024325  8745 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.025144  8755 raft_consensus.cc:493] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.025871  8755 raft_consensus.cc:515] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.028847  8755 leader_election.cc:290] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.034929  8145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
W20260709 13:03:33.041301  8041 leader_election.cc:336] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:33.041731  8041 leader_election.cc:304] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:33.042987  8755 raft_consensus.cc:2749] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.043787  8745 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.044744  8745 tablet_bootstrap.cc:492] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.045385  8745 ts_tablet_manager.cc:1403] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.001s
I20260709 13:03:33.049059  8745 raft_consensus.cc:359] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.049593  8745 raft_consensus.cc:740] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.050238  8745 consensus_queue.cc:260] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.051962  8745 ts_tablet_manager.cc:1434] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:33.052591  8745 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.065999  8745 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.066926  8745 tablet_bootstrap.cc:492] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.067543  8745 ts_tablet_manager.cc:1403] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.002s	sys 0.011s
I20260709 13:03:33.070099  8745 raft_consensus.cc:359] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.070794  8745 raft_consensus.cc:740] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.071475  8745 consensus_queue.cc:260] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.073463  8745 ts_tablet_manager.cc:1434] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:33.074213  8745 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.076617  8688 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.077448  8688 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.082744  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.085412  8688 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
W20260709 13:03:33.085822  7967 leader_election.cc:336] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:33.086314  7967 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:33.087010  8688 raft_consensus.cc:2749] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.092268  8745 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.093219  8745 tablet_bootstrap.cc:492] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.093839  8745 ts_tablet_manager.cc:1403] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.004s
I20260709 13:03:33.096134  8745 raft_consensus.cc:359] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.096783  8745 raft_consensus.cc:740] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.097798  8745 consensus_queue.cc:260] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.099973  8745 ts_tablet_manager.cc:1434] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:33.100726  8745 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.118355  8745 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.119365  8745 tablet_bootstrap.cc:492] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.120007  8745 ts_tablet_manager.cc:1403] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:03:33.122107  8745 raft_consensus.cc:359] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.122822  8745 raft_consensus.cc:740] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.123528  8745 consensus_queue.cc:260] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.124145   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:38449
I20260709 13:03:33.124295  8821 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:38449 every 8 connection(s)
I20260709 13:03:33.125609  8745 ts_tablet_manager.cc:1434] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:33.126286  8745 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.143705  8755 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.144511  8755 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.148581  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.151619  8755 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.164641  8746 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.165439  8746 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.168359  8746 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.172689  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.196158  8822 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37283
I20260709 13:03:33.196792  8822 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:33.197988  8822 heartbeater.cc:507] Master 127.0.107.254:37283 requested a full tablet report, sending...
I20260709 13:03:33.324067  8199 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.324764  8199 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.332989  8579 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.333324  8199 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.333621  8579 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.336798  8579 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.338603  8483 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.339218  8483 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.347427  8483 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.351980  8829 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.352574  8829 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.378196  8829 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.395695  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.396700  8075 raft_consensus.cc:2468] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.394932  8747 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.415884  8745 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.416654  8199 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.416976  8745 tablet_bootstrap.cc:492] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.417201  8199 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.417685  8745 ts_tablet_manager.cc:1403] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.292s	user 0.053s	sys 0.102s
I20260709 13:03:33.419207  8199 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.420392  8745 raft_consensus.cc:359] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.421097  8745 raft_consensus.cc:740] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.406571  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:33.421886  8745 consensus_queue.cc:260] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.423978  8745 ts_tablet_manager.cc:1434] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:33.426134  8745 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.426133  8148 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.427970  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:33.428553  8658 raft_consensus.cc:493] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.434914  8658 raft_consensus.cc:515] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.429195  8829 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.435981  8829 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.432981  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.437232  7999 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:33.437342  8658 leader_election.cc:290] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.437940  8829 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.440784  7967 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.443552  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.444185  8073 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:33.443703  8438 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.447926  8438 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.448865  8755 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.449385  8755 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.421772  8747 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.451393  8755 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.452165  8747 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.452853  8438 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.452792  8147 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.453828  7967 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.454587  8199 raft_consensus.cc:2804] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.454991  8199 raft_consensus.cc:493] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.455327  8199 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.444120  8829 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.456039  8829 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.454811  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.456440  8829 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.459864  8115 leader_election.cc:304] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:33.463058  8199 raft_consensus.cc:515] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.464529  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:33.465183  8146 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:33.465689  8792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.466413  7820 ts_manager.cc:194] Re-registered known tserver with Master: 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.468113  8041 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:33.468917  8483 raft_consensus.cc:2804] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.469264  8483 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.469620  8483 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.471364  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.472535  8792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.473165  8792 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.474236  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.475616  8658 raft_consensus.cc:2804] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.476030  8658 raft_consensus.cc:493] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.476398  8658 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.476670  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.477283  7998 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:33.480698  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.463275  7967 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.488057  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.489245  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.492077  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
W20260709 13:03:33.492491  7967 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.493269  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.490311  8113 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.494920  8695 raft_consensus.cc:2804] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.495368  8695 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.495721  8695 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.496803  8746 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.497242  8746 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.497601  8746 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:33.499470  8115 leader_election.cc:343] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.501214  8791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.502558  8790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.498744  8199 leader_election.cc:290] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.504766  8788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.506289  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.507198  8787 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:33.510088  8829 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
W20260709 13:03:33.511502  8041 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.512758  8115 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.516440  8041 leader_election.cc:343] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.517098  8115 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.517567  8041 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.518193  8041 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
W20260709 13:03:33.518414  8115 leader_election.cc:343] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.519117  8115 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:33.519261  8039 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.519958  8831 raft_consensus.cc:2749] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.519011  8755 raft_consensus.cc:2749] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.520123  8438 raft_consensus.cc:2804] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.506701  8658 raft_consensus.cc:515] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.520610  8438 raft_consensus.cc:493] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.521067  8438 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.522320  8658 leader_election.cc:290] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.524166  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:33.524639  8829 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.524951  8075 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.527215  8483 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.533252  8695 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.533821  8075 raft_consensus.cc:2468] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:33.535552  8039 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:33.536461  8759 raft_consensus.cc:2749] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.537874  8115 leader_election.cc:304] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:33.536482  8792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05e192005fb424591cc4763fbafb9af" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.540156  8831 raft_consensus.cc:2804] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.541231  8831 raft_consensus.cc:697] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:33.542202  8831 consensus_queue.cc:237] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.515087  8746 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.550655  8792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
W20260709 13:03:33.551985  8041 leader_election.cc:343] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.554574  8695 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.554723  8483 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:33.556764  8115 leader_election.cc:343] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.560928  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.562650  8000 raft_consensus.cc:2393] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 2: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:33.563635  8746 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.564551  8745 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.564459  8438 raft_consensus.cc:515] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.565543  8745 tablet_bootstrap.cc:492] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.565025  7823 catalog_manager.cc:5697] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:33.565599  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 71603.7us
I20260709 13:03:33.567528  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:33.571051  7999 raft_consensus.cc:2393] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae54318e37b24e6085239e7e480d5d66 in current term 2: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:33.568358  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:33.571854  8147 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:33.571979  7967 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.572678  8745 ts_tablet_manager.cc:1403] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.147s	user 0.031s	sys 0.015s
I20260709 13:03:33.573366  7967 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:33.574384  8834 raft_consensus.cc:2804] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.574827  8834 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.575191  8834 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.577406  8792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.578123  8792 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.569965  8113 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:33.568053  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.580149  8483 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.580686  8483 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.589071  8834 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.591079  8831 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.601660  8147 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:33.603269  8831 raft_consensus.cc:2749] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:33.604463  8115 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.607671  8792 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:33.608012  8745 raft_consensus.cc:359] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.608866  8041 leader_election.cc:304] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:33.611068  8041 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:33.611564  8834 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.611826  8755 raft_consensus.cc:2804] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.609287  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.610067  8745 raft_consensus.cc:740] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.613346  8785 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 1.
I20260709 13:03:33.614028  8745 consensus_queue.cc:260] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.616041  8759 raft_consensus.cc:2804] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.619346  8041 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:33.619485  8745 ts_tablet_manager.cc:1434] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:03:33.621518  8745 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.608734  8483 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.627558  8658 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.628983  8658 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.635373  8438 leader_election.cc:290] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.646190  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.647447  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.649013  7999 raft_consensus.cc:2393] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 2: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:33.649231  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b04470e6e2425e851b3269445fa374" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:33.650019  7996 raft_consensus.cc:3060] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:33.652627  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:38449, user_credentials={real_user=slave}} blocked reactor thread for 79322.3us
W20260709 13:03:33.653644  7967 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.653853  8113 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:33.647744  8793 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:33.663887  8747 raft_consensus.cc:2749] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.637210  8658 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.674317  8115 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:33.676004  8747 raft_consensus.cc:2804] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.670315  8755 raft_consensus.cc:697] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:33.676389  8747 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.671222  8843 raft_consensus.cc:2804] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.674242  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:33.685777  7998 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 1.
I20260709 13:03:33.683190  8747 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.685901  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.687180  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:33.687856  8075 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.695847  8837 raft_consensus.cc:493] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.684634  8836 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.684864  8843 raft_consensus.cc:493] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.718181  8075 raft_consensus.cc:2468] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:33.680778  8759 raft_consensus.cc:697] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
W20260709 13:03:33.756640  8039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43691, user_credentials={real_user=slave}} blocked reactor thread for 88757.5us
I20260709 13:03:33.704190  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.708446  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.740579  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:33.705468  7996 raft_consensus.cc:2468] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:33.742827  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:33.736377  8836 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.706223  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:33.760835  7967 leader_election.cc:304] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.734449  8843 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.743253  8785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.772769  8836 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.774344  8785 raft_consensus.cc:3060] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.774395  8834 raft_consensus.cc:2804] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.777487  8834 raft_consensus.cc:697] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:33.775312  8759 consensus_queue.cc:237] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.778298  8834 consensus_queue.cc:237] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.706410  8837 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.780004  8747 raft_consensus.cc:515] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.774914  8146 raft_consensus.cc:2393] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 2: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
W20260709 13:03:33.783725  7967 leader_election.cc:343] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:33.789181  7967 leader_election.cc:343] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.709863  8755 consensus_queue.cc:237] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.799746  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.805286  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:33.805949  8073 raft_consensus.cc:2468] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.808624  8837 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:33.810694  7967 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:33.813612  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:33.814849  8146 raft_consensus.cc:2393] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 2: Already voted for candidate ae54318e37b24e6085239e7e480d5d66 in this term.
I20260709 13:03:33.813839  8745 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.816203  8745 tablet_bootstrap.cc:492] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.816624  8834 raft_consensus.cc:2749] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.816864  8745 ts_tablet_manager.cc:1403] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.196s	user 0.024s	sys 0.009s
I20260709 13:03:33.813763  8785 raft_consensus.cc:2468] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:33.819214  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:33.818984  7967 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.820034  8793 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:33.820650  8834 raft_consensus.cc:2804] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.823199  8745 raft_consensus.cc:359] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.821066  8834 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:33.825675  8834 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:33.836409  7967 leader_election.cc:343] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.836776  7822 catalog_manager.cc:5697] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:33.837435  7967 leader_election.cc:343] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:33.825781  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.840255  8793 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.841040  7967 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.842180  8829 raft_consensus.cc:2804] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.825037  8745 raft_consensus.cc:740] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.830358  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0b865da0fa54a2f80b832869c24f96d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:33.842239  7967 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:33.843720  7999 raft_consensus.cc:3060] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.843631  8745 consensus_queue.cc:260] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.847532  8745 ts_tablet_manager.cc:1434] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 13:03:33.829104  8147 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:33.851373  7967 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:33.830180  8747 leader_election.cc:290] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.855232  8695 raft_consensus.cc:2804] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.855803  8695 raft_consensus.cc:697] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:33.843564  8829 raft_consensus.cc:697] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:33.856598  8695 consensus_queue.cc:237] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.857760  8829 consensus_queue.cc:237] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.863561  8745 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.865680  7999 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:33.866294  8836 raft_consensus.cc:2764] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:33.869115  8113 leader_election.cc:304] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.869992  8747 raft_consensus.cc:2804] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.873835  8747 raft_consensus.cc:697] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:33.886030  8747 consensus_queue.cc:237] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.887704  8793 raft_consensus.cc:2468] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 2.
I20260709 13:03:33.921532  8745 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.899538  8834 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.905503  7822 catalog_manager.cc:5697] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.922547  8745 tablet_bootstrap.cc:492] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.923215  8745 ts_tablet_manager.cc:1403] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.001s
I20260709 13:03:33.925446  8745 raft_consensus.cc:359] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.926061  8745 raft_consensus.cc:740] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:33.926182  8834 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:33.926891  8745 consensus_queue.cc:260] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:33.913414  7825 catalog_manager.cc:5697] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.929754  7825 catalog_manager.cc:5697] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.933369  7820 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51428
I20260709 13:03:33.935765  8745 ts_tablet_manager.cc:1434] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:03:33.936666  8745 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:33.938799  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:33.939420  8073 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.909142  7823 catalog_manager.cc:5697] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.938982  8822 heartbeater.cc:499] Master 127.0.107.254:37283 was elected leader, sending a full tablet report...
I20260709 13:03:33.951690  8843 raft_consensus.cc:515] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.947414  8073 raft_consensus.cc:2468] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:33.958765  8745 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:33.959760  8745 tablet_bootstrap.cc:492] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:33.960383  8070 raft_consensus.cc:2393] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d1a4c5f7c52440a690a17ed2307b7b17 in current term 2: Already voted for candidate 8e7be6d583414e048a2528f06bc9bb4f in this term.
I20260709 13:03:33.961864  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.966075  8793 raft_consensus.cc:2393] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8e7be6d583414e048a2528f06bc9bb4f in current term 2: Already voted for candidate d1a4c5f7c52440a690a17ed2307b7b17 in this term.
I20260709 13:03:33.960855  8745 ts_tablet_manager.cc:1403] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 13:03:33.964533  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:33.969686  8789 raft_consensus.cc:3060] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.959856  7967 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:33.972960  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef50729a4ad94bf1b63e925aeb1f763b" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:33.973330  8843 leader_election.cc:290] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Requested vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:33.973940  8688 raft_consensus.cc:2804] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.974503  8688 raft_consensus.cc:697] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:33.975548  8688 consensus_queue.cc:237] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:33.984319  8039 leader_election.cc:304] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:33.991343  8755 raft_consensus.cc:2749] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.981743  7825 catalog_manager.cc:5697] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.995851  8745 raft_consensus.cc:359] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:33.996565  8745 raft_consensus.cc:740] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.008484  8745 consensus_queue.cc:260] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.010960  8745 ts_tablet_manager.cc:1434] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.001s
I20260709 13:03:34.011760  8745 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.017225  8789 raft_consensus.cc:2468] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:34.040123  8070 raft_consensus.cc:1275] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.043284  8846 consensus_queue.cc:1048] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.048705  7822 catalog_manager.cc:5697] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 2, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:34.065817  8041 consensus_peers.cc:597] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.099625  8745 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.100597  8745 tablet_bootstrap.cc:492] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.101404  8745 ts_tablet_manager.cc:1403] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.015s
W20260709 13:03:34.101835  8115 consensus_peers.cc:597] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.104197  8745 raft_consensus.cc:359] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.104926  8745 raft_consensus.cc:740] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.106977  8745 consensus_queue.cc:260] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.109988  8745 ts_tablet_manager.cc:1434] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:34.110795  8745 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.124097  8745 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.124867  8745 tablet_bootstrap.cc:492] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.125368  8745 ts_tablet_manager.cc:1403] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:03:34.127094  8745 raft_consensus.cc:359] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.127597  8745 raft_consensus.cc:740] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.128096  8745 consensus_queue.cc:260] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.129750  8745 ts_tablet_manager.cc:1434] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:34.130368  8745 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.141614  8745 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.142544  8745 tablet_bootstrap.cc:492] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.143265  8745 ts_tablet_manager.cc:1403] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:03:34.145562  8745 raft_consensus.cc:359] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.146068  8745 raft_consensus.cc:740] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.146610  8745 consensus_queue.cc:260] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.148701  8745 ts_tablet_manager.cc:1434] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:34.149761  8745 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.170369  8745 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.171394  8745 tablet_bootstrap.cc:492] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.172082  8745 ts_tablet_manager.cc:1403] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:03:34.174000  8745 raft_consensus.cc:359] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.174587  8745 raft_consensus.cc:740] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.175235  8745 consensus_queue.cc:260] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.177237  8745 ts_tablet_manager.cc:1434] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:34.178031  8745 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
W20260709 13:03:34.188675  7967 consensus_peers.cc:597] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:34.194272  7999 raft_consensus.cc:1275] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.195847  8843 consensus_queue.cc:1048] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.198848  8745 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.199887  8745 tablet_bootstrap.cc:492] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.200539  8745 ts_tablet_manager.cc:1403] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 13:03:34.202976  8745 raft_consensus.cc:359] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.203583  8745 raft_consensus.cc:740] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.204197  8745 consensus_queue.cc:260] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.206072  8745 ts_tablet_manager.cc:1434] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:03:34.206828  8745 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.221217  8789 raft_consensus.cc:1275] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.222922  8755 consensus_queue.cc:1048] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.278275  8745 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.279300  8745 tablet_bootstrap.cc:492] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.279966  8745 ts_tablet_manager.cc:1403] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.007s
I20260709 13:03:34.286260  8745 raft_consensus.cc:359] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.287007  8745 raft_consensus.cc:740] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.287637  8745 consensus_queue.cc:260] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.289100  8745 ts_tablet_manager.cc:1434] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:03:34.289896  8745 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.293803  8070 raft_consensus.cc:1275] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.298547  8836 consensus_queue.cc:1048] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.304797  7996 raft_consensus.cc:1275] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.306054  8846 consensus_queue.cc:1048] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.319337  8789 raft_consensus.cc:1275] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.320972  8846 consensus_queue.cc:1048] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.327280  8793 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.346469  8148 raft_consensus.cc:1275] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.348295  8842 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.349563  8793 raft_consensus.cc:1275] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.351455  8842 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.361227  8787 raft_consensus.cc:1275] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.363289  8688 consensus_queue.cc:1048] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.370777  8792 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.377519  8792 raft_consensus.cc:1275] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.383325  8073 raft_consensus.cc:1275] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.384759  8834 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.385990  8834 consensus_queue.cc:1048] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.413209  8792 raft_consensus.cc:1275] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:34.425922  8873 log.cc:927] Time spent T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:03:34.426816  8876 log.cc:927] Time spent T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
W20260709 13:03:34.474673  8115 consensus_peers.cc:597] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.507946  8695 consensus_queue.cc:1048] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:34.580873  8745 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.582612  8745 tablet_bootstrap.cc:492] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
W20260709 13:03:34.612816  7967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45223, user_credentials={real_user=slave}} blocked reactor thread for 72205.4us
W20260709 13:03:34.621791  8041 consensus_peers.cc:597] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.622973  8041 consensus_peers.cc:597] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.635475  8148 raft_consensus.cc:1275] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:34.673308  8115 consensus_peers.cc:597] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.674268  8115 consensus_peers.cc:597] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.707084  8041 consensus_peers.cc:597] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.706318  8887 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:03:34.727830  8745 ts_tablet_manager.cc:1403] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.438s	user 0.041s	sys 0.065s
I20260709 13:03:34.762284  8745 raft_consensus.cc:359] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.763305  8745 raft_consensus.cc:740] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.763082  8075 raft_consensus.cc:1275] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:34.771404  7967 consensus_peers.cc:597] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.782081  7967 consensus_peers.cc:597] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.792408  8115 consensus_peers.cc:597] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.793318  8115 consensus_peers.cc:597] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.764341  8745 consensus_queue.cc:260] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
W20260709 13:03:34.801964  7967 consensus_peers.cc:597] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.802287  8745 ts_tablet_manager.cc:1434] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.000s
I20260709 13:03:34.803823  8745 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.821940  8886 consensus_queue.cc:1048] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:34.834894  7967 consensus_peers.cc:597] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.867380  7967 consensus_peers.cc:597] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:34.879052  8115 consensus_peers.cc:597] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.897086  8745 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.898074  8745 tablet_bootstrap.cc:492] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.898769  8745 ts_tablet_manager.cc:1403] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.006s
I20260709 13:03:34.901275  8745 raft_consensus.cc:359] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.901961  8745 raft_consensus.cc:740] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.902707  8745 consensus_queue.cc:260] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:34.904909  8745 ts_tablet_manager.cc:1434] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:34.905900  8745 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.935097  8745 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.935870  8745 tablet_bootstrap.cc:492] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.936558  8745 ts_tablet_manager.cc:1403] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.015s
I20260709 13:03:34.939056  8745 raft_consensus.cc:359] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.939733  8745 raft_consensus.cc:740] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.940500  8745 consensus_queue.cc:260] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:34.942721  8745 ts_tablet_manager.cc:1434] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.006s
I20260709 13:03:34.943658  8745 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.958276  8745 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.959093  8745 tablet_bootstrap.cc:492] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.959648  8745 ts_tablet_manager.cc:1403] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:03:34.961504  8745 raft_consensus.cc:359] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.961997  8745 raft_consensus.cc:740] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.962554  8745 consensus_queue.cc:260] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.964293  8745 ts_tablet_manager.cc:1434] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:34.965458  8745 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:34.978919  8745 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.979760  8745 tablet_bootstrap.cc:492] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:34.980341  8745 ts_tablet_manager.cc:1403] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:03:34.982308  8745 raft_consensus.cc:359] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.982882  8745 raft_consensus.cc:740] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:34.983527  8745 consensus_queue.cc:260] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:34.985612  8745 ts_tablet_manager.cc:1434] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:34.987174  8745 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.001261  8745 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.002213  8745 tablet_bootstrap.cc:492] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.003120  8745 ts_tablet_manager.cc:1403] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:03:35.005951  8745 raft_consensus.cc:359] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.006603  8745 raft_consensus.cc:740] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.007368  8745 consensus_queue.cc:260] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.009265  8745 ts_tablet_manager.cc:1434] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:35.010476  8745 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.026208  8745 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.027184  8745 tablet_bootstrap.cc:492] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.027840  8745 ts_tablet_manager.cc:1403] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 13:03:35.030181  8745 raft_consensus.cc:359] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.030862  8745 raft_consensus.cc:740] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.031606  8745 consensus_queue.cc:260] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.033972  8745 ts_tablet_manager.cc:1434] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:03:35.034909  8745 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.049584  8745 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.050421  8745 tablet_bootstrap.cc:492] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.051029  8745 ts_tablet_manager.cc:1403] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:03:35.052814  8745 raft_consensus.cc:359] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.053298  8745 raft_consensus.cc:740] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.053840  8745 consensus_queue.cc:260] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.055498  8745 ts_tablet_manager.cc:1434] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:03:35.056550  8745 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.070807  8745 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.071635  8745 tablet_bootstrap.cc:492] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.072253  8745 ts_tablet_manager.cc:1403] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 13:03:35.074297  8745 raft_consensus.cc:359] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.074851  8745 raft_consensus.cc:740] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.075357  8745 consensus_queue.cc:260] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.077076  8745 ts_tablet_manager.cc:1434] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:35.078179  8745 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.093490  8745 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.094559  8745 tablet_bootstrap.cc:492] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.095330  8745 ts_tablet_manager.cc:1403] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:03:35.097602  8745 raft_consensus.cc:359] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.098274  8745 raft_consensus.cc:740] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.099151  8745 consensus_queue.cc:260] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.103215  8745 ts_tablet_manager.cc:1434] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:35.104313  8745 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.141777  8745 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.142849  8745 tablet_bootstrap.cc:492] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.143558  8745 ts_tablet_manager.cc:1403] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.014s
I20260709 13:03:35.146651  8745 raft_consensus.cc:359] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.147393  8745 raft_consensus.cc:740] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.148211  8745 consensus_queue.cc:260] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.150368  8745 ts_tablet_manager.cc:1434] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:35.154140  8745 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.167132  8745 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.168022  8745 tablet_bootstrap.cc:492] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.168643  8745 ts_tablet_manager.cc:1403] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:03:35.170593  8745 raft_consensus.cc:359] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.171108  8745 raft_consensus.cc:740] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.171727  8745 consensus_queue.cc:260] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.174331  8745 ts_tablet_manager.cc:1434] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:03:35.176092  8745 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.243199  8745 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.243964  8745 tablet_bootstrap.cc:492] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.244612  8745 ts_tablet_manager.cc:1403] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.069s	user 0.037s	sys 0.011s
I20260709 13:03:35.247016  8745 raft_consensus.cc:359] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.247687  8745 raft_consensus.cc:740] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.248368  8745 consensus_queue.cc:260] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.250991  8745 ts_tablet_manager.cc:1434] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:03:35.251955  8745 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.265542  8745 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.266496  8745 tablet_bootstrap.cc:492] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.267514  8745 ts_tablet_manager.cc:1403] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:03:35.270147  8745 raft_consensus.cc:359] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.270949  8745 raft_consensus.cc:740] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.271754  8745 consensus_queue.cc:260] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.273952  8745 ts_tablet_manager.cc:1434] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:35.275198  8745 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.290221  8745 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.291157  8745 tablet_bootstrap.cc:492] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.291818  8745 ts_tablet_manager.cc:1403] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:03:35.293781  8745 raft_consensus.cc:359] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.294322  8745 raft_consensus.cc:740] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.294967  8745 consensus_queue.cc:260] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.296963  8745 ts_tablet_manager.cc:1434] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:35.298867  8745 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.314415  8745 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.315445  8745 tablet_bootstrap.cc:492] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.316107  8745 ts_tablet_manager.cc:1403] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:03:35.322902  8745 raft_consensus.cc:359] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.323952  8745 raft_consensus.cc:740] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.325229  8793 raft_consensus.cc:3060] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.326213  8745 consensus_queue.cc:260] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:35.328779  8745 ts_tablet_manager.cc:1434] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 13:03:35.329598  8745 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.345772  8745 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.346720  8745 tablet_bootstrap.cc:492] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.347373  8745 ts_tablet_manager.cc:1403] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:03:35.349891  8745 raft_consensus.cc:359] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.350543  8745 raft_consensus.cc:740] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.355108  8745 consensus_queue.cc:260] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.357234  8745 ts_tablet_manager.cc:1434] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:03:35.358116  8745 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.375067  8745 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.376538  8745 tablet_bootstrap.cc:492] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.377184  8745 ts_tablet_manager.cc:1403] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:03:35.377964  8793 raft_consensus.cc:3060] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.381304  8745 raft_consensus.cc:359] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.381974  8745 raft_consensus.cc:740] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.382596  8745 consensus_queue.cc:260] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.384801  8745 ts_tablet_manager.cc:1434] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:03:35.391728  8745 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Bootstrap starting.
I20260709 13:03:35.403162  8688 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.403767  8688 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.406951  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:35.406128  8688 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:35.407334  8745 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.407864  8147 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:35.408053  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:35.408834  8745 tablet_bootstrap.cc:492] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Bootstrap complete.
I20260709 13:03:35.408932  8793 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 1.
I20260709 13:03:35.409637  8745 ts_tablet_manager.cc:1403] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:03:35.409714  7967 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:35.410517  8688 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:35.410873  8688 raft_consensus.cc:493] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.411206  8688 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.412415  8745 raft_consensus.cc:359] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.413085  8745 raft_consensus.cc:740] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Initialized, Role: FOLLOWER
I20260709 13:03:35.413734  8745 consensus_queue.cc:260] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:35.416016  8745 ts_tablet_manager.cc:1434] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:35.423673  8688 raft_consensus.cc:515] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.425746  8688 leader_election.cc:290] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 3 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:35.426855  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:35.427505  8150 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.428848  8793 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e361579718846d08eb4509a5caeeb3c" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084"
I20260709 13:03:35.430675  8793 raft_consensus.cc:3060] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.435192  8150 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 3.
I20260709 13:03:35.436350  7967 leader_election.cc:304] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:35.437083  8688 raft_consensus.cc:2804] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.437455  8793 raft_consensus.cc:2468] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 3.
I20260709 13:03:35.437687  8688 raft_consensus.cc:697] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:35.439072  8688 consensus_queue.cc:237] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:35.456665  7825 catalog_manager.cc:5697] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 3, leader changed from 2bb658b087424b87887d5bfef62d8084 (127.0.107.193) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.989571  8790 raft_consensus.cc:1275] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:35.991564  8886 consensus_queue.cc:1048] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.009696  8150 raft_consensus.cc:1275] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:36.012473  8688 consensus_queue.cc:1048] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.132692   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:43.184455  8075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "507f378c61374021afd81f65ffe484b2"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:43.185169  8075 raft_consensus.cc:606] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.197341  8150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:43.197924  8150 raft_consensus.cc:606] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.200536  8075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:43.201131  8075 raft_consensus.cc:606] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.203645  8075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94e6f3b32be489795228057469a99d6"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:43.204099  8075 raft_consensus.cc:606] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.216562  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:43.217048  7999 raft_consensus.cc:606] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.219501  8075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:43.219940  8075 raft_consensus.cc:606] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:43.221076   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:43.222716   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:43.240706  8945 raft_consensus.cc:993] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.241271  8944 raft_consensus.cc:1081] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.242678  8793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c94e6f3b32be489795228057469a99d6"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33590
I20260709 13:03:43.243165  8793 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.243582  8793 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.246541  8942 raft_consensus.cc:993] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.247246  8885 raft_consensus.cc:1081] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.248711  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33580
I20260709 13:03:43.249222  8790 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.249607  8790 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.251266  8793 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.259210  8790 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.266084  8790 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:43.270838  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:43.271483  8075 raft_consensus.cc:3055] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:43.271858  8075 raft_consensus.cc:740] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:43.272526  8075 consensus_queue.cc:260] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.273424  8075 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.277638  8793 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:43.280136  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.280587  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.281204  8149 raft_consensus.cc:3060] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.280642  8150 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.283800  8075 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:43.285171  8741 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:43.288060  8149 raft_consensus.cc:2468] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:43.290000  8150 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:43.292328  8952 raft_consensus.cc:2804] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:43.292856  8741 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:43.293268  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf19d48029f343a1aa509c8e4ef726a6" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:43.293823  7999 raft_consensus.cc:3055] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:43.294057  7999 raft_consensus.cc:740] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:43.295156  8954 raft_consensus.cc:2804] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:43.295038  7999 consensus_queue.cc:260] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.295727  8954 raft_consensus.cc:697] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.296358  7999 raft_consensus.cc:3060] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.296656  8954 consensus_queue.cc:237] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.305243  7999 raft_consensus.cc:2468] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:43.308089  8952 raft_consensus.cc:697] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.309019  8952 consensus_queue.cc:237] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.321089  7822 catalog_manager.cc:5697] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 2 to 3, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.347889  7822 catalog_manager.cc:5697] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 2 to 3, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:43.367465  8944 raft_consensus.cc:993] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.368040  8932 raft_consensus.cc:1081] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.368067  8940 raft_consensus.cc:993] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.368810  8945 raft_consensus.cc:1081] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.370042  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33590
I20260709 13:03:43.370441  8793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33590
I20260709 13:03:43.370586  8790 raft_consensus.cc:493] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.370961  8790 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.370975  8793 raft_consensus.cc:493] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.371451  8793 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.377671  8793 raft_consensus.cc:515] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.377622  8790 raft_consensus.cc:515] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.379649  8790 leader_election.cc:290] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:43.379670  8793 leader_election.cc:290] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:43.381124  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:43.381457  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:43.381775  8075 raft_consensus.cc:3055] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:43.382055  8070 raft_consensus.cc:3055] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:43.382184  8075 raft_consensus.cc:740] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:43.382520  8070 raft_consensus.cc:740] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:43.383391  8070 consensus_queue.cc:260] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.383244  8075 consensus_queue.cc:260] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.384388  8070 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.384577  8075 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.390841  8070 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.392107  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b72bd45f8f674163bc3489db86c80c66" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.392740  8150 raft_consensus.cc:3060] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.395586  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea00da638b4f45eea1984895448e1d37" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.396282  8149 raft_consensus.cc:3060] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.395632  8741 leader_election.cc:304] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:43.398460  8952 raft_consensus.cc:2804] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:43.398974  8952 raft_consensus.cc:697] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.399905  8150 raft_consensus.cc:2468] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.399794  8952 consensus_queue.cc:237] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.403419  8149 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.408525  8741 leader_election.cc:304] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:43.411149  7822 catalog_manager.cc:5697] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.413138  8952 raft_consensus.cc:2804] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:43.413692  8952 raft_consensus.cc:697] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.414516  8952 consensus_queue.cc:237] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.410135  8075 raft_consensus.cc:2468] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.434569  7822 catalog_manager.cc:5697] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.453785  8939 raft_consensus.cc:993] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.455020  8941 raft_consensus.cc:1081] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.459131  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:03:43.460246  8790 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.460826  8790 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.474902  8790 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.476655  8790 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:43.477242  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.477663  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0b2a413d084182b0f28a502f04dff2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:43.477958  8149 raft_consensus.cc:3055] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:43.478384  8149 raft_consensus.cc:740] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:43.478411  7999 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.479269  8149 consensus_queue.cc:260] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.480616  8149 raft_consensus.cc:3060] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.484432  7999 raft_consensus.cc:2468] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.486004  8739 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:43.486945  8952 raft_consensus.cc:2804] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:43.487406  8952 raft_consensus.cc:697] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.488210  8952 consensus_queue.cc:237] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:43.491189  8149 raft_consensus.cc:2468] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.508208  7822 catalog_manager.cc:5697] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:43.561766  8932 raft_consensus.cc:993] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.562259  8945 raft_consensus.cc:1081] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:43.563647  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "507f378c61374021afd81f65ffe484b2"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33590
I20260709 13:03:43.564121  8790 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:43.564388  8790 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.569080  8790 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.570930  8790 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:43.571480  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:43.572082  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "507f378c61374021afd81f65ffe484b2" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:43.572119  8075 raft_consensus.cc:3055] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:43.572662  8075 raft_consensus.cc:740] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:43.572696  8150 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.573518  8075 consensus_queue.cc:260] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.574435  8075 raft_consensus.cc:3060] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.579205  8150 raft_consensus.cc:2468] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.580297  8741 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:43.580511  8075 raft_consensus.cc:2468] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:43.581073  8952 raft_consensus.cc:2804] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:43.581550  8952 raft_consensus.cc:697] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:43.582355  8952 consensus_queue.cc:237] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:43.601802  7822 catalog_manager.cc:5697] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.760660  8150 raft_consensus.cc:1275] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.762256  8952 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.772715  8070 raft_consensus.cc:1275] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.774523  8954 consensus_queue.cc:1048] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.791834  8149 raft_consensus.cc:1275] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.799346  8954 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.806640  7999 raft_consensus.cc:1275] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.808997  8954 consensus_queue.cc:1048] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:43.840085  8150 raft_consensus.cc:1275] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.843395  8953 consensus_queue.cc:1048] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:43.853708  8070 raft_consensus.cc:1275] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.858112  8953 consensus_queue.cc:1048] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.889509  8149 raft_consensus.cc:1275] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.891446  8072 raft_consensus.cc:1275] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.897604  8953 consensus_queue.cc:1048] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.900136  8953 consensus_queue.cc:1048] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.923557  8149 raft_consensus.cc:1275] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.925544  8954 consensus_queue.cc:1048] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.929504  8000 raft_consensus.cc:1275] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.931172  8953 consensus_queue.cc:1048] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:43.989492  8150 raft_consensus.cc:1275] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:43.990708  8953 consensus_queue.cc:1048] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.000542  8075 raft_consensus.cc:1275] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.002291  8953 consensus_queue.cc:1048] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.223886   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.263922   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.300922  8149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:44.301568  8149 raft_consensus.cc:606] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:44.304909  8149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:44.305433  8149 raft_consensus.cc:606] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Received request to transfer leadership to TS 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:44.309249  8000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:44.309816  8000 raft_consensus.cc:606] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:44.312481  8149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:44.313046  8149 raft_consensus.cc:606] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:44.315608  8149 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:44.316289  8149 raft_consensus.cc:606] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:44.317407   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:44.318569   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:44.333861  8939 raft_consensus.cc:993] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.334424  8963 raft_consensus.cc:1081] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.336050  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:03:44.336529  8790 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.336777  8790 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.341739  8790 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.343510  8790 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:44.344002  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:44.344710  8075 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.344841  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1af1b402194d8c90df94542ed85d63" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:44.345443  8149 raft_consensus.cc:3055] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.345782  8149 raft_consensus.cc:740] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:44.346491  8149 consensus_queue.cc:260] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.347735  8149 raft_consensus.cc:3060] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.350366  8075 raft_consensus.cc:2468] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.351709  8741 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:44.352484  8976 raft_consensus.cc:2804] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.352999  8976 raft_consensus.cc:697] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:44.353205  8149 raft_consensus.cc:2468] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.353955  8976 consensus_queue.cc:237] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.366746  7820 catalog_manager.cc:5697] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.463616  8963 raft_consensus.cc:993] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.464160  8939 raft_consensus.cc:1081] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.465685  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:03:44.466284  8790 raft_consensus.cc:493] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.468986  8790 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.474512  8790 raft_consensus.cc:515] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.476357  8790 leader_election.cc:290] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:44.477526  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:44.478075  8070 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.483381  8070 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:44.484683  8741 leader_election.cc:304] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:44.485440  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1d3eb748fc547daa3c67446a34670fd" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:44.486048  8149 raft_consensus.cc:3055] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.486106  8953 raft_consensus.cc:2804] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:44.486382  8149 raft_consensus.cc:740] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:44.486768  8953 raft_consensus.cc:697] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:44.488157  8149 consensus_queue.cc:260] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.488937  8953 consensus_queue.cc:237] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.489945  8149 raft_consensus.cc:3060] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.499487  8149 raft_consensus.cc:2468] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 3.
I20260709 13:03:44.502167  7820 catalog_manager.cc:5697] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 2 to 3, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.511335  8963 raft_consensus.cc:993] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.511888  8963 raft_consensus.cc:1081] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.513437  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:03:44.513871  8790 raft_consensus.cc:493] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.514168  8790 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.549268  8790 raft_consensus.cc:515] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.554106  8790 leader_election.cc:290] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:44.559959  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:44.561429  8149 raft_consensus.cc:3055] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.560179  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4988500e3bc44817a1bd87f1c4979cca" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:44.561937  8149 raft_consensus.cc:740] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:44.562588  8075 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.564772  8149 consensus_queue.cc:260] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.568445  8149 raft_consensus.cc:3060] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.585544  8149 raft_consensus.cc:2468] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.587155  8741 leader_election.cc:304] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:44.594684  8953 raft_consensus.cc:2804] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.595371  8953 raft_consensus.cc:697] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:44.598318  8953 consensus_queue.cc:237] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:44.604892  8075 raft_consensus.cc:2468] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.644646  7820 catalog_manager.cc:5697] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:44.700726  8942 raft_consensus.cc:993] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.701429  8992 raft_consensus.cc:1081] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:44.703208  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33580
I20260709 13:03:44.703931  8790 raft_consensus.cc:493] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.704424  8790 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.727758  8790 raft_consensus.cc:515] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:44.728384  8963 raft_consensus.cc:993] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 8e7be6d583414e048a2528f06bc9bb4f to start an election
I20260709 13:03:44.735493  8963 raft_consensus.cc:1081] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Signalling peer 8e7be6d583414e048a2528f06bc9bb4f to start an election
I20260709 13:03:44.738585  8790 leader_election.cc:290] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:44.739044  8075 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
 from {username='slave'} at 127.0.0.1:47880
I20260709 13:03:44.739214  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:44.739701  8075 raft_consensus.cc:493] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:44.739761  8000 raft_consensus.cc:3055] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.739836  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377aa62f193a4388a82ea786f25ba033" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:44.740271  8000 raft_consensus.cc:740] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:44.740661  8070 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.741374  8000 consensus_queue.cc:260] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:44.743024  8000 raft_consensus.cc:3060] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.740160  8075 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.747737  8070 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.749250  8741 leader_election.cc:304] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:44.750463  8954 raft_consensus.cc:2804] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.750991  8954 raft_consensus.cc:697] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:44.752300  8000 raft_consensus.cc:2468] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:44.752130  8954 consensus_queue.cc:237] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:44.755662  8075 raft_consensus.cc:515] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:44.759195  8075 leader_election.cc:290] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:44.759820  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:44.760502  8000 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.761521  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:44.762135  8150 raft_consensus.cc:3055] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.762410  8150 raft_consensus.cc:740] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:44.763469  8070 raft_consensus.cc:1275] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.763299  8150 consensus_queue.cc:260] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:44.764948  8954 consensus_queue.cc:1048] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.768672  7820 catalog_manager.cc:5697] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:44.770443  8000 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:44.764782  8150 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.772505  8039 leader_election.cc:304] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:44.773463  8945 raft_consensus.cc:2804] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.773995  8945 raft_consensus.cc:697] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:44.775163  8945 consensus_queue.cc:237] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:44.787106  8150 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:44.799455  8150 raft_consensus.cc:1275] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.803094  8976 consensus_queue.cc:1048] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.826695  7820 catalog_manager.cc:5697] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 1 to 2, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.042906  8070 raft_consensus.cc:1275] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.044107  8976 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:45.053838  8149 raft_consensus.cc:1275] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.056911  8954 consensus_queue.cc:1048] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:45.081951  8149 raft_consensus.cc:1275] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.083139  8954 consensus_queue.cc:1048] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.092303  8070 raft_consensus.cc:1275] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.093976  8976 consensus_queue.cc:1048] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.273785  8070 raft_consensus.cc:1275] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.274967  8953 consensus_queue.cc:1048] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.284279  7996 raft_consensus.cc:1275] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.286334  8953 consensus_queue.cc:1048] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:45.318886  8150 raft_consensus.cc:1275] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.319780   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.320262  9000 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:45.338333  7996 raft_consensus.cc:1275] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.341882  9001 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:45.378412   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.418570  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07c8df4352104870bd7c48c69566d909"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:45.419293  7999 raft_consensus.cc:606] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:45.422477  8075 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "ae54318e37b24e6085239e7e480d5d66"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:45.423100  8075 raft_consensus.cc:606] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Received request to transfer leadership to TS ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:45.425791  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:45.426378  7999 raft_consensus.cc:606] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Received request to transfer leadership to TS 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:45.428776  7999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:45.429252  7999 raft_consensus.cc:606] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:45.430150   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:45.431690   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:45.561218  8985 raft_consensus.cc:993] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:45.561755  8942 raft_consensus.cc:1081] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:45.563212  8793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33580
I20260709 13:03:45.563679  8793 raft_consensus.cc:493] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.563970  8793 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.569223  8793 raft_consensus.cc:515] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:45.570830  8793 leader_election.cc:290] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:45.571959  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:45.571625  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd0103deb344096a33481aeda5d1d70" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:45.572523  7999 raft_consensus.cc:3055] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:45.572940  7999 raft_consensus.cc:740] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:45.572928  8070 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.573936  7999 consensus_queue.cc:260] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:45.575263  7999 raft_consensus.cc:3060] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.580992  8070 raft_consensus.cc:2468] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:45.582278  8741 leader_election.cc:304] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f; no voters: 
I20260709 13:03:45.583287  8953 raft_consensus.cc:2804] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:45.583786  8953 raft_consensus.cc:697] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:45.584779  8953 consensus_queue.cc:237] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:45.586117  7999 raft_consensus.cc:2468] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:45.594341  7820 catalog_manager.cc:5697] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.641047  8985 raft_consensus.cc:993] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 8e7be6d583414e048a2528f06bc9bb4f to start an election
I20260709 13:03:45.642119  8942 raft_consensus.cc:1081] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Signalling peer 8e7be6d583414e048a2528f06bc9bb4f to start an election
I20260709 13:03:45.645951  8070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
 from {username='slave'} at 127.0.0.1:47870
I20260709 13:03:45.647203  8070 raft_consensus.cc:493] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.651417  8070 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.655987  8985 raft_consensus.cc:993] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:45.657334  8942 raft_consensus.cc:1081] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:45.664074  8793 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07c8df4352104870bd7c48c69566d909"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33580
I20260709 13:03:45.664594  8793 raft_consensus.cc:493] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.664896  8793 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.665510  8070 raft_consensus.cc:515] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.668190  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:45.668458  8070 leader_election.cc:290] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:45.668758  7999 raft_consensus.cc:3055] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:45.669094  7999 raft_consensus.cc:740] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:45.669873  7999 consensus_queue.cc:260] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.670902  7999 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.671732  8793 raft_consensus.cc:515] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:45.672736  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74089dee1ade40d0a51a6bcb238fb462" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:45.673290  8150 raft_consensus.cc:3060] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.674211  8793 leader_election.cc:290] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:45.674937  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:45.675541  7996 raft_consensus.cc:3055] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:45.675891  7996 raft_consensus.cc:740] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:45.676787  7996 consensus_queue.cc:260] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:45.677904  7996 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.679986  8150 raft_consensus.cc:2468] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:45.681730  8041 leader_election.cc:304] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:45.682557  9001 raft_consensus.cc:2804] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:45.683063  7999 raft_consensus.cc:2468] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e7be6d583414e048a2528f06bc9bb4f in term 2.
I20260709 13:03:45.683061  9001 raft_consensus.cc:697] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Leader. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:45.685477  9001 consensus_queue.cc:237] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.690768  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:45.691411  8070 raft_consensus.cc:3060] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.696347  7996 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:45.699004  8739 leader_election.cc:304] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:45.700131  7820 catalog_manager.cc:5697] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f reported cstate change: term changed from 1 to 2, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195). New cstate: current_term: 2 leader_uuid: "8e7be6d583414e048a2528f06bc9bb4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.701622  8953 raft_consensus.cc:2804] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:45.702159  8070 raft_consensus.cc:2468] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:45.702411  8953 raft_consensus.cc:697] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:45.703708  8953 consensus_queue.cc:237] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:45.716989  7825 catalog_manager.cc:5697] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.856904  8932 raft_consensus.cc:993] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower ae54318e37b24e6085239e7e480d5d66 to start an election
I20260709 13:03:45.857313  9001 raft_consensus.cc:1081] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Signalling peer ae54318e37b24e6085239e7e480d5d66 to start an election
I20260709 13:03:45.858892  8150 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
 from {username='slave'} at 127.0.0.1:56624
I20260709 13:03:45.859388  8150 raft_consensus.cc:493] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.859664  8150 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.864552  8150 raft_consensus.cc:515] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.866703  8150 leader_election.cc:290] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 election: Requested vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:45.867555  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:45.867595  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:45.868225  7999 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.868273  8070 raft_consensus.cc:3055] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:45.868710  8070 raft_consensus.cc:740] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:45.869349  8070 consensus_queue.cc:260] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.870229  8070 raft_consensus.cc:3060] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.875352  7999 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 3.
I20260709 13:03:45.876709  8113 leader_election.cc:304] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:45.877535  8997 raft_consensus.cc:2804] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:45.878293  8997 raft_consensus.cc:697] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 3 LEADER]: Becoming Leader. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:45.878533  8070 raft_consensus.cc:2468] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae54318e37b24e6085239e7e480d5d66 in term 3.
I20260709 13:03:45.879215  8997 consensus_queue.cc:237] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:45.889178  7825 catalog_manager.cc:5697] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 reported cstate change: term changed from 2 to 3, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to ae54318e37b24e6085239e7e480d5d66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "ae54318e37b24e6085239e7e480d5d66" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:45.971627  8070 raft_consensus.cc:1275] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.973238  8953 consensus_queue.cc:1048] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:45.982966  7996 raft_consensus.cc:1275] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.984632  8953 consensus_queue.cc:1048] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.097785  7996 raft_consensus.cc:1275] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.100489  8932 consensus_queue.cc:1048] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.110515  8149 raft_consensus.cc:1275] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 8e7be6d583414e048a2528f06bc9bb4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.112020  8932 consensus_queue.cc:1048] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.141466  7999 raft_consensus.cc:1275] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.148814  8954 consensus_queue.cc:1048] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.163468  8075 raft_consensus.cc:1275] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.167464  8953 consensus_queue.cc:1048] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.391621  8070 raft_consensus.cc:1275] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.396422  8997 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.406519  7996 raft_consensus.cc:1275] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Refusing update from remote peer ae54318e37b24e6085239e7e480d5d66: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.408418  8963 consensus_queue.cc:1048] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.432647   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:46.477753   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:46.515532  8150 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de"
dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:47796
I20260709 13:03:46.516050  8150 raft_consensus.cc:606] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:46.518661  8070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4"
dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
mode: GRACEFUL
new_leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
 from {username='slave'} at 127.0.0.1:52888
I20260709 13:03:46.519218  8070 raft_consensus.cc:606] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Received request to transfer leadership to TS d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:46.520529   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:46.522032   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:46.554219  8963 raft_consensus.cc:993] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:46.554844  8963 raft_consensus.cc:1081] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:46.556411  8790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33584
I20260709 13:03:46.556941  8790 raft_consensus.cc:493] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.557271  8790 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.565474  8790 raft_consensus.cc:515] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:46.569830  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:46.570505  8150 raft_consensus.cc:3055] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.570883  8150 raft_consensus.cc:740] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:46.571700  8150 consensus_queue.cc:260] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:46.573449  8150 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.581594  8790 leader_election.cc:290] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:46.582810  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1879a702e0ba41b7b0d96b56a99217de" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:46.583451  7999 raft_consensus.cc:3060] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.591019  7999 raft_consensus.cc:2468] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:46.591315  8150 raft_consensus.cc:2468] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:46.592214  8739 leader_election.cc:304] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:46.593204  8953 raft_consensus.cc:2804] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.593734  8953 raft_consensus.cc:697] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:46.594517  8953 consensus_queue.cc:237] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:46.604285  7822 catalog_manager.cc:5697] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from ae54318e37b24e6085239e7e480d5d66 (127.0.107.196) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.722718  8932 raft_consensus.cc:993] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: : Instructing follower d1a4c5f7c52440a690a17ed2307b7b17 to start an election
I20260709 13:03:46.723198  9001 raft_consensus.cc:1081] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Signalling peer d1a4c5f7c52440a690a17ed2307b7b17 to start an election
I20260709 13:03:46.724746  7999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
 from {username='slave'} at 127.0.0.1:55204
I20260709 13:03:46.725283  7999 raft_consensus.cc:493] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:46.725631  7999 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.732255  7999 raft_consensus.cc:515] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:46.735026  7999 leader_election.cc:290] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Requested vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:46.735769  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f"
I20260709 13:03:46.736290  8075 raft_consensus.cc:3055] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:46.738857  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445e4d228e048d79a4dc7e65bf17ce4" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:46.739456  8150 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.736482  8075 raft_consensus.cc:740] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8e7be6d583414e048a2528f06bc9bb4f, State: Running, Role: LEADER
I20260709 13:03:46.742822  8075 consensus_queue.cc:260] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:46.744069  8075 raft_consensus.cc:3060] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:46.746265  8150 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:46.748832  7967 leader_election.cc:304] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:46.749588  8942 raft_consensus.cc:2804] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.749996  8942 raft_consensus.cc:697] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Becoming Leader. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:46.750804  8942 consensus_queue.cc:237] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:46.758268  8075 raft_consensus.cc:2468] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1a4c5f7c52440a690a17ed2307b7b17 in term 2.
I20260709 13:03:46.767057  7822 catalog_manager.cc:5697] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 reported cstate change: term changed from 1 to 2, leader changed from 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195) to d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.083794  7999 raft_consensus.cc:1275] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.085088  8954 consensus_queue.cc:1048] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.104192  8149 raft_consensus.cc:1275] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.111718  8953 consensus_queue.cc:1048] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.263646  8149 raft_consensus.cc:1275] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.264925  8942 consensus_queue.cc:1048] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:47.275223  8075 raft_consensus.cc:1275] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Refusing update from remote peer d1a4c5f7c52440a690a17ed2307b7b17: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:47.297863  8942 consensus_queue.cc:1048] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:47.522970   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.568253   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.606900  7996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8ade0a1743d454eb241e68ef253f4e6"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:47.607474  7996 raft_consensus.cc:606] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:47.608669   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:47.610275   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:48.642781   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.810022  9053 raft_consensus.cc:493] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e7be6d583414e048a2528f06bc9bb4f)
I20260709 13:03:48.816893  9053 raft_consensus.cc:515] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:48.819082  9053 leader_election.cc:290] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:48.845642  9060 raft_consensus.cc:493] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.852437  9060 raft_consensus.cc:515] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.855960  9060 leader_election.cc:290] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.832453  9062 raft_consensus.cc:493] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.857686  9062 raft_consensus.cc:515] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:48.861481  9062 leader_election.cc:290] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:48.861980  7998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.864846  9059 raft_consensus.cc:493] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.865172  9057 raft_consensus.cc:493] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8e7be6d583414e048a2528f06bc9bb4f)
I20260709 13:03:48.865509  9059 raft_consensus.cc:515] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.865700  9057 raft_consensus.cc:515] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:48.867645  9057 leader_election.cc:290] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:48.867616  9059 leader_election.cc:290] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.869580  8149 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65f361d07e44b12ae649ea71e589a3e" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:48.875864  9068 raft_consensus.cc:493] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.876582  9068 raft_consensus.cc:515] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:48.876955  8976 raft_consensus.cc:493] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.877523  8976 raft_consensus.cc:515] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:48.879101  9068 leader_election.cc:290] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:48.879462  8976 leader_election.cc:290] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:48.887835   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:48.891311  9058 raft_consensus.cc:493] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:48.891837  9058 raft_consensus.cc:515] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:48.892161  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:48.896677  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.903411  9058 leader_election.cc:290] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.918913  9073 raft_consensus.cc:493] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.919215  9049 raft_consensus.cc:493] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.919549  9073 raft_consensus.cc:515] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.919783  9049 raft_consensus.cc:515] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:48.921778  9073 leader_election.cc:290] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.921983  9049 leader_election.cc:290] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687)
I20260709 13:03:48.922279  9073 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:48.926015  9073 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:48.931375  9073 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:48.946687  8072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:48.932264  9074 raft_consensus.cc:493] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.948185  9049 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.948284  9074 raft_consensus.cc:515] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } }
I20260709 13:03:48.948763  9049 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.952266  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.953743  9074 leader_election.cc:290] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.945145  8070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:48.955755  8041 leader_election.cc:304] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:48.957813  9049 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:48.945636  9069 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.965168  9069 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.967325  9069 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:48.959160  9074 raft_consensus.cc:2749] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.968034  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:48.968755  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:48.973392  9055 raft_consensus.cc:493] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.973932  9055 raft_consensus.cc:515] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:48.960726  8784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07c8df4352104870bd7c48c69566d909" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:48.974819  8001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.974947  7999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e6c27d5c454418af17931d298c320a" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.961330  8000 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5"
dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
mode: GRACEFUL
new_leader_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:41550
I20260709 13:03:48.975991  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.976222  8000 raft_consensus.cc:606] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Received request to transfer leadership to TS 2bb658b087424b87887d5bfef62d8084
I20260709 13:03:48.976317  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.976696  7995 raft_consensus.cc:2468] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 1.
I20260709 13:03:48.963346  8789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:48.978469   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:03:48.978746  9055 leader_election.cc:290] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:48.980154   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:48.980995  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.983183  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:48.986178  8739 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17; no voters: 
I20260709 13:03:48.962344  9066 raft_consensus.cc:493] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:48.987236  9071 raft_consensus.cc:2804] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:48.987694  9071 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ae54318e37b24e6085239e7e480d5d66)
I20260709 13:03:48.988091  9071 raft_consensus.cc:3060] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.988952  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d6403dabb047e1a41b15afba4737d8" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:48.989522  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:48.991837  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94e6f3b32be489795228057469a99d6" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:48.995699  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:48.995868  9071 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.987277  9066 raft_consensus.cc:515] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:48.999398  9066 leader_election.cc:290] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:49.001973  9071 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:49.016155  9034 raft_consensus.cc:493] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d1a4c5f7c52440a690a17ed2307b7b17)
I20260709 13:03:49.016921  9034 raft_consensus.cc:515] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } } peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } }
I20260709 13:03:49.019065  9034 leader_election.cc:290] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691), 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223)
I20260709 13:03:49.021657  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:49.024276  7996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:49.024763  8000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162410dd39f9414d830b658dbc8e7197" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:49.033921  8113 leader_election.cc:304] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.034853  9055 raft_consensus.cc:2749] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.037346  8150 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:49.037721  8148 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baaa499575414a72af0bd4560d1504c2" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:49.039224  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83dfbafc5e75431faaf8534237b14a40" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:49.039713  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3427f9a3804e8786b0e837c3187403" candidate_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:49.040722  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa189f7d78b742b79515eedbc3d2514d" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:49.042162  8073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ef14152466f47d692cf3b31d7045bf7" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:49.043540  8115 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:49.044381  9034 raft_consensus.cc:2749] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.046417  8113 leader_election.cc:304] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.046821  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f706220a9864dedb5c4b4b2039b744d" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:49.047453  8075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8e7be6d583414e048a2528f06bc9bb4f" is_pre_election: true
I20260709 13:03:49.048974  9076 raft_consensus.cc:2749] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.050827  8787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da0d5e0a15447eb99c08ec304ba960f" candidate_uuid: "8e7be6d583414e048a2528f06bc9bb4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2bb658b087424b87887d5bfef62d8084" is_pre_election: true
I20260709 13:03:49.051009  8113 leader_election.cc:304] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.051739  9034 raft_consensus.cc:2749] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.052930  8113 leader_election.cc:304] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.053629  9034 raft_consensus.cc:2749] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.055480  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbab94a274f84b2e954e7921a8ac73b3" candidate_uuid: "ae54318e37b24e6085239e7e480d5d66" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" is_pre_election: true
I20260709 13:03:49.056816  8113 leader_election.cc:304] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.057503  9034 raft_consensus.cc:2749] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.059381  8741 leader_election.cc:304] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.062937  8147 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:49.063594  9069 raft_consensus.cc:2749] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.064152  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cf568fbc40f4c588f6a1e5802c3fb35" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae54318e37b24e6085239e7e480d5d66" is_pre_election: true
I20260709 13:03:49.071849  8041 leader_election.cc:304] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.073040  9074 raft_consensus.cc:2749] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.073125  8041 leader_election.cc:304] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8e7be6d583414e048a2528f06bc9bb4f; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.073853  9074 raft_consensus.cc:2749] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.074808  7967 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:49.075592  9053 raft_consensus.cc:2749] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.075958  7967 leader_election.cc:304] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:49.076759  9053 raft_consensus.cc:2749] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.077445  8741 leader_election.cc:304] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.078140  7967 leader_election.cc:304] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1a4c5f7c52440a690a17ed2307b7b17; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:49.078176  9071 raft_consensus.cc:2749] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.078567  8741 leader_election.cc:304] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.078984  9053 raft_consensus.cc:2749] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.079406  9071 raft_consensus.cc:2749] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.079736  8741 leader_election.cc:304] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: 8e7be6d583414e048a2528f06bc9bb4f, ae54318e37b24e6085239e7e480d5d66
I20260709 13:03:49.080482  9071 raft_consensus.cc:2749] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.081679  8741 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084; no voters: ae54318e37b24e6085239e7e480d5d66, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:49.082342  9069 raft_consensus.cc:2749] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.115875  9032 raft_consensus.cc:993] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: : Instructing follower 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:49.116360  9053 raft_consensus.cc:1081] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Signalling peer 2bb658b087424b87887d5bfef62d8084 to start an election
I20260709 13:03:49.117827  8789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5"
dest_uuid: "2bb658b087424b87887d5bfef62d8084"
 from {username='slave'} at 127.0.0.1:33580
I20260709 13:03:49.118366  8789 raft_consensus.cc:493] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:49.118757  8789 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.124313  8789 raft_consensus.cc:515] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:49.126202  8789 leader_election.cc:290] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Requested vote from peers ae54318e37b24e6085239e7e480d5d66 (127.0.107.196:39687), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
I20260709 13:03:49.126943  8146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae54318e37b24e6085239e7e480d5d66"
I20260709 13:03:49.127285  7995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18529f21b404d6ea36647e7f98c61e5" candidate_uuid: "2bb658b087424b87887d5bfef62d8084" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d1a4c5f7c52440a690a17ed2307b7b17"
I20260709 13:03:49.127612  8146 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.127964  7995 raft_consensus.cc:3055] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.128273  7995 raft_consensus.cc:740] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d1a4c5f7c52440a690a17ed2307b7b17, State: Running, Role: LEADER
I20260709 13:03:49.128959  7995 consensus_queue.cc:260] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:49.129933  7995 raft_consensus.cc:3060] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.133561  8146 raft_consensus.cc:2468] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:49.134753  8741 leader_election.cc:304] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bb658b087424b87887d5bfef62d8084, ae54318e37b24e6085239e7e480d5d66; no voters: 
I20260709 13:03:49.135473  9069 raft_consensus.cc:2804] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:49.135432  7995 raft_consensus.cc:2468] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bb658b087424b87887d5bfef62d8084 in term 2.
I20260709 13:03:49.136214  9069 raft_consensus.cc:697] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Becoming Leader. State: Replica: 2bb658b087424b87887d5bfef62d8084, State: Running, Role: LEADER
I20260709 13:03:49.137074  9069 consensus_queue.cc:237] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:49.149360  7822 catalog_manager.cc:5697] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 reported cstate change: term changed from 1 to 2, leader changed from d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194) to 2bb658b087424b87887d5bfef62d8084 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2bb658b087424b87887d5bfef62d8084" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:49.239050  7856 debug-util.cc:398] Leaking SignalData structure 0x7b080024a120 after lost signal to thread 434
W20260709 13:03:49.241592  7856 debug-util.cc:398] Leaking SignalData structure 0x7b0800398120 after lost signal to thread 7859
W20260709 13:03:49.244587  7856 debug-util.cc:398] Leaking SignalData structure 0x7b080023afa0 after lost signal to thread 8026
W20260709 13:03:49.254941  7856 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb2c0 after lost signal to thread 8100
W20260709 13:03:49.260702  7856 debug-util.cc:398] Leaking SignalData structure 0x7b080036eb60 after lost signal to thread 8174
W20260709 13:03:49.262172  7856 debug-util.cc:398] Leaking SignalData structure 0x7b0800264820 after lost signal to thread 8821
I20260709 13:03:49.359375  8789 raft_consensus.cc:1240] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Rejecting Update request from peer ae54318e37b24e6085239e7e480d5d66 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:49.360888  9034 consensus_queue.cc:1059] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.361871  9055 raft_consensus.cc:3055] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.362200  9055 raft_consensus.cc:740] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae54318e37b24e6085239e7e480d5d66, State: Running, Role: LEADER
I20260709 13:03:49.363078  9055 consensus_queue.cc:260] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:49.364089  9055 raft_consensus.cc:3060] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.613777  8146 raft_consensus.cc:1275] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.615128  9067 consensus_queue.cc:1048] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.634474  7995 raft_consensus.cc:1275] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Refusing update from remote peer 2bb658b087424b87887d5bfef62d8084: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:49.636142  9065 consensus_queue.cc:1048] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.981182   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:50.028894   431 tablet_server.cc:179] TabletServer@127.0.107.193:38449 shutting down...
W20260709 13:03:50.075693  7967 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 92 similar messages]
I20260709 13:03:50.096184   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:50.097955   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.098979   431 raft_consensus.cc:2243] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.102995   431 raft_consensus.cc:2272] T 12cd5d1261c74e43bd9d09e591a5b6cd P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.101807  7967 consensus_peers.cc:597] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.109560   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.110755   431 raft_consensus.cc:2243] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.111421   431 raft_consensus.cc:2272] T a88bacd650e3448a85930d7b4d92ee0d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.114792   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:50.114957  7967 consensus_peers.cc:597] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.115796   431 raft_consensus.cc:2243] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.116422   431 raft_consensus.cc:2272] T 9ef14152466f47d692cf3b31d7045bf7 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.119791   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.120834   431 raft_consensus.cc:2243] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.121389   431 raft_consensus.cc:2272] T 79b2a47fe4a344828901bc5fdf6d45db P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.124396   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.125310   431 raft_consensus.cc:2243] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.125993   431 raft_consensus.cc:2272] T f05e192005fb424591cc4763fbafb9af P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.131781   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.132686   431 raft_consensus.cc:2243] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.133710   431 raft_consensus.cc:2272] T 8bd0103deb344096a33481aeda5d1d70 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.138500   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.139755   431 raft_consensus.cc:2243] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.140429   431 raft_consensus.cc:2272] T 254ebe75a90346379724aca3aad860e2 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.143846   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.144483   431 raft_consensus.cc:2243] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.145017   431 raft_consensus.cc:2272] T 3e361579718846d08eb4509a5caeeb3c P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.149370   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.150326   431 raft_consensus.cc:2243] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.150897   431 raft_consensus.cc:2272] T 4fa58a98b8994582a9cd95d99596f4ea P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.156982   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:50.158677  8041 consensus_peers.cc:597] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.161072   431 raft_consensus.cc:2243] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:50.162045  8041 consensus_peers.cc:597] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.163136   431 raft_consensus.cc:2272] T 377aa62f193a4388a82ea786f25ba033 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.166739   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.167826   431 raft_consensus.cc:2243] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.169000   431 raft_consensus.cc:2272] T 07c8df4352104870bd7c48c69566d909 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.171841   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.172475   431 raft_consensus.cc:2243] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.172946   431 raft_consensus.cc:2272] T 443d2e75298341fb8ac3a2a79d5bec05 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.175710   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.176348   431 raft_consensus.cc:2243] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.177335   431 raft_consensus.cc:2272] T 507f378c61374021afd81f65ffe484b2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.179798   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.180514   431 raft_consensus.cc:2243] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.181528   431 raft_consensus.cc:2272] T cf19d48029f343a1aa509c8e4ef726a6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.184062   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.184789   431 raft_consensus.cc:2243] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.185253   431 raft_consensus.cc:2272] T 0d3212e0a78a41fdb90d232921d72ea1 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.187603   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.188483   431 raft_consensus.cc:2243] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.189370   431 raft_consensus.cc:2272] T c94e6f3b32be489795228057469a99d6 P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.191866   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.192638   431 raft_consensus.cc:2243] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.193504   431 raft_consensus.cc:2272] T 8b0b2a413d084182b0f28a502f04dff2 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.196208   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.197129   431 raft_consensus.cc:2243] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.197674   431 raft_consensus.cc:2272] T 79f06a693fd84cf3b2eda8e179fd85dc P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.200647   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.201215   431 raft_consensus.cc:2243] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:50.201570  7967 consensus_peers.cc:597] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.201710   431 raft_consensus.cc:2272] T 0d38630e1dc34ceb9665dd2a25e61ddb P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.205035   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.205744   431 raft_consensus.cc:2243] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.206701   431 raft_consensus.cc:2272] T 4988500e3bc44817a1bd87f1c4979cca P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.209806   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.210786   431 raft_consensus.cc:2243] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.211419   431 raft_consensus.cc:2272] T ef50729a4ad94bf1b63e925aeb1f763b P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.214524   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.215287   431 raft_consensus.cc:2243] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.215759   431 raft_consensus.cc:2272] T 83dfbafc5e75431faaf8534237b14a40 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.218892   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.219776   431 raft_consensus.cc:2243] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.220353   431 raft_consensus.cc:2272] T c8ade0a1743d454eb241e68ef253f4e6 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.223286   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.223935   431 raft_consensus.cc:2243] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.224427   431 raft_consensus.cc:2272] T c5d6403dabb047e1a41b15afba4737d8 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.227371   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.228318   431 raft_consensus.cc:2243] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.229372   431 raft_consensus.cc:2272] T 1879a702e0ba41b7b0d96b56a99217de P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.230362  8115 consensus_peers.cc:597] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.232259   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.233247   431 raft_consensus.cc:2243] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.233796   431 raft_consensus.cc:2272] T 6cf568fbc40f4c588f6a1e5802c3fb35 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.236522   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.237311   431 raft_consensus.cc:2243] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.237869   431 raft_consensus.cc:2272] T fa189f7d78b742b79515eedbc3d2514d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.240690   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.241616   431 raft_consensus.cc:2243] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.242161   431 raft_consensus.cc:2272] T 117d9367cf76482abd217a33615ad4ef P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.245188   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.245843   431 raft_consensus.cc:2243] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.247083   431 raft_consensus.cc:2272] T 0d1af1b402194d8c90df94542ed85d63 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.249689   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.250437   431 raft_consensus.cc:2243] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.250967   431 raft_consensus.cc:2272] T ab4114d662304b8293dc9591163d2125 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.253768   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.254551   431 raft_consensus.cc:2243] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.255101   431 raft_consensus.cc:2272] T b05fd148ee7149088d25a5342739c87e P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.257967   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.258796   431 raft_consensus.cc:2243] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.261518   431 raft_consensus.cc:2272] T 0ab7e0f3150e480ea34f7b131978b028 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.264691   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.265440   431 raft_consensus.cc:2243] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.266047   431 raft_consensus.cc:2272] T ec88e145d9a940c9a732315fdcc27c53 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.269026   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.269657   431 raft_consensus.cc:2243] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.270256   431 raft_consensus.cc:2272] T 3f706220a9864dedb5c4b4b2039b744d P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.273969   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.274792   431 raft_consensus.cc:2243] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.275386   431 raft_consensus.cc:2272] T 0da0d5e0a15447eb99c08ec304ba960f P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.277726  8041 consensus_peers.cc:597] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.279151   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.280256   431 raft_consensus.cc:2243] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.281831   431 raft_consensus.cc:2272] T 55e6c27d5c454418af17931d298c320a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.284786   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.285645   431 raft_consensus.cc:2243] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.286262   431 raft_consensus.cc:2272] T 26d79363387a421ab0dd5c8ee4a99a9c P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.288784   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.289436   431 raft_consensus.cc:2243] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.289999   431 raft_consensus.cc:2272] T 1c57f47c624d4610b8a17b50701ede64 P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.291257  7967 consensus_peers.cc:597] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.292094  7967 consensus_peers.cc:597] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.292740   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.293560   431 raft_consensus.cc:2243] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.294652   431 raft_consensus.cc:2272] T ea00da638b4f45eea1984895448e1d37 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.296788  8041 consensus_peers.cc:597] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.297663   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.298504   431 raft_consensus.cc:2243] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.299065   431 raft_consensus.cc:2272] T a34bc926b47b4f1d886de1ccee78479a P 2bb658b087424b87887d5bfef62d8084 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.301282  8115 consensus_peers.cc:597] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.301992   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.302865   431 raft_consensus.cc:2243] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.303521   431 raft_consensus.cc:2272] T d0b865da0fa54a2f80b832869c24f96d P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.304348  7967 consensus_peers.cc:597] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.305963  8115 consensus_peers.cc:597] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.306445   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.307256   431 raft_consensus.cc:2243] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.308425   431 raft_consensus.cc:2272] T f1d3eb748fc547daa3c67446a34670fd P 2bb658b087424b87887d5bfef62d8084 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.307263  8115 consensus_peers.cc:597] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.311280   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:03:50.311292  8115 consensus_peers.cc:597] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.312238   431 raft_consensus.cc:2243] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.312799   431 raft_consensus.cc:2272] T e0b04470e6e2425e851b3269445fa374 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.318701   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.320061   431 raft_consensus.cc:2243] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.322472   431 raft_consensus.cc:2272] T b72bd45f8f674163bc3489db86c80c66 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.329002   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:03:50.330588   431 raft_consensus.cc:2243] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.333168   431 raft_consensus.cc:2272] T e18529f21b404d6ea36647e7f98c61e5 P 2bb658b087424b87887d5bfef62d8084 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.346248  8041 consensus_peers.cc:597] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.346916  7967 consensus_peers.cc:597] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.358923  8041 consensus_peers.cc:597] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.362386  7967 consensus_peers.cc:597] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.394181  7967 consensus_peers.cc:597] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.404093  8115 consensus_peers.cc:597] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.405010  8115 consensus_peers.cc:597] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.405652  8115 consensus_peers.cc:597] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.417593  8115 consensus_peers.cc:597] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.425509  7967 consensus_peers.cc:597] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.438225   431 tablet_server.cc:196] TabletServer@127.0.107.193:38449 shutdown complete.
W20260709 13:03:50.487097  8041 consensus_peers.cc:597] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.499818  8115 consensus_peers.cc:597] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.500856  8115 consensus_peers.cc:597] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.509442  7967 consensus_peers.cc:597] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.547865  7967 consensus_peers.cc:597] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 -> Peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Couldn't send request to peer 2bb658b087424b87887d5bfef62d8084. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.560182   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:50.582906  8039 consensus_peers.cc:597] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.628758  8039 consensus_peers.cc:597] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.634953  9055 raft_consensus.cc:493] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.635540  9055 raft_consensus.cc:515] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:50.637915  9055 leader_election.cc:290] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:50.639765  8113 consensus_peers.cc:597] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.645507  8113 leader_election.cc:336] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:50.646257  8115 leader_election.cc:336] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:50.647208  8115 leader_election.cc:304] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:50.648537  9055 raft_consensus.cc:2749] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:50.650851  8039 consensus_peers.cc:597] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.653817  8113 consensus_peers.cc:597] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.654116   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:50.655200   431 tablet_replica.cc:333] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.656242   431 raft_consensus.cc:2243] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.656862   431 raft_consensus.cc:2272] T 2d3427f9a3804e8786b0e837c3187403 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.659804   431 tablet_replica.cc:333] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.660696   431 raft_consensus.cc:2243] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.661201   431 raft_consensus.cc:2272] T 07c8df4352104870bd7c48c69566d909 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.663970   431 tablet_replica.cc:333] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.664842   431 raft_consensus.cc:2243] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.666002   431 raft_consensus.cc:2272] T fbab94a274f84b2e954e7921a8ac73b3 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.668946   431 tablet_replica.cc:333] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.669745   431 raft_consensus.cc:2243] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.670775   431 raft_consensus.cc:2272] T fa189f7d78b742b79515eedbc3d2514d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.673702   431 tablet_replica.cc:333] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.674592   431 raft_consensus.cc:2243] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.675773   431 raft_consensus.cc:2272] T ab4114d662304b8293dc9591163d2125 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.678819   431 tablet_replica.cc:333] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
W20260709 13:03:50.678947  8039 consensus_peers.cc:597] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.679613   431 raft_consensus.cc:2243] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.680742   431 raft_consensus.cc:2272] T 0ab7e0f3150e480ea34f7b131978b028 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.683920   431 tablet_replica.cc:333] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.684880   431 raft_consensus.cc:2243] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.685472   431 raft_consensus.cc:2272] T 6cf568fbc40f4c588f6a1e5802c3fb35 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.688694   431 tablet_replica.cc:333] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.689585   431 raft_consensus.cc:2243] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.690209   431 raft_consensus.cc:2272] T cc77641f1caf4b5aa4ad012540fbb5a5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.693452   431 tablet_replica.cc:333] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.694375   431 raft_consensus.cc:2243] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.695451   431 raft_consensus.cc:2272] T 3e361579718846d08eb4509a5caeeb3c P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.698664   431 tablet_replica.cc:333] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.699527   431 raft_consensus.cc:2243] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.700054   431 raft_consensus.cc:2272] T 4fa58a98b8994582a9cd95d99596f4ea P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.702898   431 tablet_replica.cc:333] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.703775   431 raft_consensus.cc:2243] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.704349   431 raft_consensus.cc:2272] T 95f1cdc967ed405b9586552899bd23fb P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.707149   431 tablet_replica.cc:333] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.708133   431 raft_consensus.cc:2243] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.708988   431 raft_consensus.cc:2272] T 26d79363387a421ab0dd5c8ee4a99a9c P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.712070   431 tablet_replica.cc:333] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
W20260709 13:03:50.712147  8039 consensus_peers.cc:597] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.713017   431 raft_consensus.cc:2243] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.713704   431 raft_consensus.cc:2272] T 55e6c27d5c454418af17931d298c320a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.716928   431 tablet_replica.cc:333] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.717970   431 raft_consensus.cc:2243] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.718604   431 raft_consensus.cc:2272] T 1c57f47c624d4610b8a17b50701ede64 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.721433   431 tablet_replica.cc:333] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.722184   431 raft_consensus.cc:2243] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.723279   431 raft_consensus.cc:2272] T 9445e4d228e048d79a4dc7e65bf17ce4 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.726168   431 tablet_replica.cc:333] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.727092   431 raft_consensus.cc:2243] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.727675   431 raft_consensus.cc:2272] T 8bd0103deb344096a33481aeda5d1d70 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.730705   431 tablet_replica.cc:333] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.731596   431 raft_consensus.cc:2243] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.732141   431 raft_consensus.cc:2272] T 74089dee1ade40d0a51a6bcb238fb462 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.734905   431 tablet_replica.cc:333] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.735718   431 raft_consensus.cc:2243] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.736722   431 raft_consensus.cc:2272] T 254ebe75a90346379724aca3aad860e2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.739658   431 tablet_replica.cc:333] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.740481   431 raft_consensus.cc:2243] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.741636   431 raft_consensus.cc:2272] T 3f706220a9864dedb5c4b4b2039b744d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.744845   431 tablet_replica.cc:333] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.745776   431 raft_consensus.cc:2243] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.747437   431 raft_consensus.cc:2272] T ec88e145d9a940c9a732315fdcc27c53 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.750767   431 tablet_replica.cc:333] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.751714   431 raft_consensus.cc:2243] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.752372   431 raft_consensus.cc:2272] T 1dd7f48731264748981e15dd47fb7bb6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.755456   431 tablet_replica.cc:333] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.756404   431 raft_consensus.cc:2243] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.757072   431 raft_consensus.cc:2272] T 0d3212e0a78a41fdb90d232921d72ea1 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.760056   431 tablet_replica.cc:333] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.760895   431 raft_consensus.cc:2243] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.762025   431 raft_consensus.cc:2272] T 162410dd39f9414d830b658dbc8e7197 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.764979   431 tablet_replica.cc:333] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.765895   431 raft_consensus.cc:2243] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.766556   431 raft_consensus.cc:2272] T 52fb0d48a61c4f3696f07f0e9f953dfa P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.769598   431 tablet_replica.cc:333] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.770430   431 raft_consensus.cc:2243] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.771112   431 raft_consensus.cc:2272] T e18529f21b404d6ea36647e7f98c61e5 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.774103   431 tablet_replica.cc:333] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.774974   431 raft_consensus.cc:2243] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.775537   431 raft_consensus.cc:2272] T 12cd5d1261c74e43bd9d09e591a5b6cd P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.778501   431 tablet_replica.cc:333] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.779417   431 raft_consensus.cc:2243] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.780361   431 raft_consensus.cc:2272] T ef50729a4ad94bf1b63e925aeb1f763b P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.783281   431 tablet_replica.cc:333] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.784137   431 raft_consensus.cc:2243] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.784834   431 raft_consensus.cc:2272] T 83dfbafc5e75431faaf8534237b14a40 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.787750   431 tablet_replica.cc:333] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.788568   431 raft_consensus.cc:2243] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.789161   431 raft_consensus.cc:2272] T baaa499575414a72af0bd4560d1504c2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.792346   431 tablet_replica.cc:333] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.793180   431 raft_consensus.cc:2243] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.793792   431 raft_consensus.cc:2272] T f8e6273fa02f47668768e36dda283b31 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.796663   431 tablet_replica.cc:333] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.797616   431 raft_consensus.cc:2243] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:50.797736  8039 consensus_peers.cc:597] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.798496   431 raft_consensus.cc:2272] T e0b04470e6e2425e851b3269445fa374 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.801614   431 tablet_replica.cc:333] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.802464   431 raft_consensus.cc:2243] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.804169   431 raft_consensus.cc:2272] T 01c49d9b38fd47608c90fc8e709332dc P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.806667  8113 consensus_peers.cc:597] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.807746   431 tablet_replica.cc:333] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.809516   431 raft_consensus.cc:2243] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.810273   431 raft_consensus.cc:2272] T 8b0b2a413d084182b0f28a502f04dff2 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.813277  8039 consensus_peers.cc:597] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.813418   431 tablet_replica.cc:333] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.814440   431 raft_consensus.cc:2243] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.815100   431 raft_consensus.cc:2272] T d0b865da0fa54a2f80b832869c24f96d P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.817317  8039 consensus_peers.cc:597] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.818099   431 tablet_replica.cc:333] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.819164   431 raft_consensus.cc:2243] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.820225   431 raft_consensus.cc:2272] T a34bc926b47b4f1d886de1ccee78479a P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.823457   431 tablet_replica.cc:333] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.824267   431 raft_consensus.cc:2243] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.824827   431 raft_consensus.cc:2272] T c65f361d07e44b12ae649ea71e589a3e P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.827622   431 tablet_replica.cc:333] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.828336   431 raft_consensus.cc:2243] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.828837   431 raft_consensus.cc:2272] T ec19762f6a5e40eea7215e9981f34f9f P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.831629   431 tablet_replica.cc:333] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.832332   431 raft_consensus.cc:2243] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.833248   431 raft_consensus.cc:2272] T c8ade0a1743d454eb241e68ef253f4e6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.835805   431 tablet_replica.cc:333] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.836536   431 raft_consensus.cc:2243] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:50.837695   431 raft_consensus.cc:2272] T c5d6403dabb047e1a41b15afba4737d8 P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.840883   431 tablet_replica.cc:333] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.841636   431 raft_consensus.cc:2243] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.842167   431 raft_consensus.cc:2272] T 1879a702e0ba41b7b0d96b56a99217de P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.845129   431 tablet_replica.cc:333] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.845875   431 raft_consensus.cc:2243] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.846343   431 raft_consensus.cc:2272] T 377aa62f193a4388a82ea786f25ba033 P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.849092   431 tablet_replica.cc:333] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.849839   431 raft_consensus.cc:2243] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.850457   431 raft_consensus.cc:2272] T cf19d48029f343a1aa509c8e4ef726a6 P d1a4c5f7c52440a690a17ed2307b7b17 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.853404   431 tablet_replica.cc:333] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.854100   431 raft_consensus.cc:2243] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:50.854658   431 raft_consensus.cc:2272] T a88bacd650e3448a85930d7b4d92ee0d P d1a4c5f7c52440a690a17ed2307b7b17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:50.857424   431 tablet_replica.cc:333] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17: stopping tablet replica
I20260709 13:03:50.858083   431 raft_consensus.cc:2243] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:50.858289  8039 consensus_peers.cc:597] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.859180   431 raft_consensus.cc:2272] T 0da0d5e0a15447eb99c08ec304ba960f P d1a4c5f7c52440a690a17ed2307b7b17 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:50.880173  8113 consensus_peers.cc:597] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.911026  8113 consensus_peers.cc:597] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.933782  8039 consensus_peers.cc:597] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:50.958379   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:50.982878  8113 consensus_peers.cc:597] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:50.989182  8039 consensus_peers.cc:597] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.015460  8039 consensus_peers.cc:597] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.036754  8039 consensus_peers.cc:597] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.041498  8039 consensus_peers.cc:597] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.063387   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:51.093410  8039 consensus_peers.cc:597] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f -> Peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Couldn't send request to peer d1a4c5f7c52440a690a17ed2307b7b17. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.118547   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.119580   431 tablet_replica.cc:333] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.120584   431 raft_consensus.cc:2243] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.121129   431 raft_consensus.cc:2272] T ea00da638b4f45eea1984895448e1d37 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.123229   431 tablet_replica.cc:333] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.123803   431 raft_consensus.cc:2243] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.124231   431 raft_consensus.cc:2272] T 2d3427f9a3804e8786b0e837c3187403 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.126222   431 tablet_replica.cc:333] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.126927   431 raft_consensus.cc:2243] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.127334   431 raft_consensus.cc:2272] T f05e192005fb424591cc4763fbafb9af P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.129390   431 tablet_replica.cc:333] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.129959   431 raft_consensus.cc:2243] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.130380   431 raft_consensus.cc:2272] T f1d3eb748fc547daa3c67446a34670fd P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.132239   431 tablet_replica.cc:333] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.132807   431 raft_consensus.cc:2243] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.133639   431 raft_consensus.cc:2272] T cc77641f1caf4b5aa4ad012540fbb5a5 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.135548   431 tablet_replica.cc:333] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.136059   431 raft_consensus.cc:2243] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.136813   431 raft_consensus.cc:2272] T 4fa58a98b8994582a9cd95d99596f4ea P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.138825   431 tablet_replica.cc:333] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.139475   431 raft_consensus.cc:2243] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.140039   431 raft_consensus.cc:2272] T c8ade0a1743d454eb241e68ef253f4e6 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.142704   431 tablet_replica.cc:333] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
W20260709 13:03:51.142760  8115 consensus_peers.cc:597] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.143533   431 raft_consensus.cc:2243] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.144512   431 raft_consensus.cc:2272] T 95f1cdc967ed405b9586552899bd23fb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.147456   431 tablet_replica.cc:333] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.148303   431 raft_consensus.cc:2243] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.149262   431 raft_consensus.cc:2272] T 26d79363387a421ab0dd5c8ee4a99a9c P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.152272   431 tablet_replica.cc:333] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.153105   431 raft_consensus.cc:2243] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.154109   431 raft_consensus.cc:2272] T 1c57f47c624d4610b8a17b50701ede64 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.156806   431 tablet_replica.cc:333] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.157603   431 raft_consensus.cc:2243] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.158545   431 raft_consensus.cc:2272] T 1dd7f48731264748981e15dd47fb7bb6 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.160552  8115 consensus_peers.cc:597] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.161345   431 tablet_replica.cc:333] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.162238   431 raft_consensus.cc:2243] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.163331   431 raft_consensus.cc:2272] T 0d3212e0a78a41fdb90d232921d72ea1 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.165318  8115 consensus_peers.cc:597] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.166062   431 tablet_replica.cc:333] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.166905   431 raft_consensus.cc:2243] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.167433   431 raft_consensus.cc:2272] T b05fd148ee7149088d25a5342739c87e P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.169978   431 tablet_replica.cc:333] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.170791   431 raft_consensus.cc:2243] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.171296   431 raft_consensus.cc:2272] T fbab94a274f84b2e954e7921a8ac73b3 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.173748   431 tablet_replica.cc:333] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.174499   431 raft_consensus.cc:2243] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.175052   431 raft_consensus.cc:2272] T fa189f7d78b742b79515eedbc3d2514d P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.177701   431 tablet_replica.cc:333] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.178429   431 raft_consensus.cc:2243] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.178987   431 raft_consensus.cc:2272] T 117d9367cf76482abd217a33615ad4ef P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.181577   431 tablet_replica.cc:333] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.182219   431 raft_consensus.cc:2243] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.182650   431 raft_consensus.cc:2272] T 0d1af1b402194d8c90df94542ed85d63 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.184686   431 tablet_replica.cc:333] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.185321   431 raft_consensus.cc:2243] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.185793   431 raft_consensus.cc:2272] T ef50729a4ad94bf1b63e925aeb1f763b P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.188207   431 tablet_replica.cc:333] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.189004   431 raft_consensus.cc:2243] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.189831   431 raft_consensus.cc:2272] T baaa499575414a72af0bd4560d1504c2 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.192116   431 tablet_replica.cc:333] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.192749   431 raft_consensus.cc:2243] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.193496   431 raft_consensus.cc:2272] T 83dfbafc5e75431faaf8534237b14a40 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.195587   431 tablet_replica.cc:333] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.196123   431 raft_consensus.cc:2243] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.196554   431 raft_consensus.cc:2272] T 162410dd39f9414d830b658dbc8e7197 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.198583   431 tablet_replica.cc:333] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.199616   431 raft_consensus.cc:2243] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.200601   431 raft_consensus.cc:2272] T 52fb0d48a61c4f3696f07f0e9f953dfa P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.202767   431 tablet_replica.cc:333] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.203364   431 raft_consensus.cc:2243] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.204034   431 raft_consensus.cc:2272] T 0d38630e1dc34ceb9665dd2a25e61ddb P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.206873   431 tablet_replica.cc:333] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.207726   431 raft_consensus.cc:2243] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.208297   431 raft_consensus.cc:2272] T 4988500e3bc44817a1bd87f1c4979cca P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.211135   431 tablet_replica.cc:333] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.211953   431 raft_consensus.cc:2243] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.212512   431 raft_consensus.cc:2272] T 79f06a693fd84cf3b2eda8e179fd85dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.214795   431 tablet_replica.cc:333] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.215365   431 raft_consensus.cc:2243] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.216311   431 raft_consensus.cc:2272] T 12cd5d1261c74e43bd9d09e591a5b6cd P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.219378   431 tablet_replica.cc:333] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.220153   431 raft_consensus.cc:2243] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.220768   431 raft_consensus.cc:2272] T c94e6f3b32be489795228057469a99d6 P 8e7be6d583414e048a2528f06bc9bb4f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.222468  8115 consensus_peers.cc:597] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.223232   431 tablet_replica.cc:333] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.223858   431 raft_consensus.cc:2243] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.224283   431 raft_consensus.cc:2272] T 01c49d9b38fd47608c90fc8e709332dc P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.226300   431 tablet_replica.cc:333] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.226939   431 raft_consensus.cc:2243] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.227375   431 raft_consensus.cc:2272] T 9ef14152466f47d692cf3b31d7045bf7 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.229835   431 tablet_replica.cc:333] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.230571   431 raft_consensus.cc:2243] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.231050   431 raft_consensus.cc:2272] T 07c8df4352104870bd7c48c69566d909 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.233338   431 tablet_replica.cc:333] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.234030   431 raft_consensus.cc:2243] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.234453   431 raft_consensus.cc:2272] T 443d2e75298341fb8ac3a2a79d5bec05 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.236557   431 tablet_replica.cc:333] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.237118   431 raft_consensus.cc:2243] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.237572   431 raft_consensus.cc:2272] T c65f361d07e44b12ae649ea71e589a3e P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.240123   431 tablet_replica.cc:333] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.240864   431 raft_consensus.cc:2243] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.241408   431 raft_consensus.cc:2272] T 79b2a47fe4a344828901bc5fdf6d45db P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.243790   431 tablet_replica.cc:333] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.244323   431 raft_consensus.cc:2243] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.244733   431 raft_consensus.cc:2272] T a34bc926b47b4f1d886de1ccee78479a P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.246932   431 tablet_replica.cc:333] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.247606   431 raft_consensus.cc:2243] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.248428   431 raft_consensus.cc:2272] T ec19762f6a5e40eea7215e9981f34f9f P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.251065   431 tablet_replica.cc:333] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.251784   431 raft_consensus.cc:2243] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.252358   431 raft_consensus.cc:2272] T 0da0d5e0a15447eb99c08ec304ba960f P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.254652   431 tablet_replica.cc:333] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.255183   431 raft_consensus.cc:2243] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.255589   431 raft_consensus.cc:2272] T b72bd45f8f674163bc3489db86c80c66 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.257642   431 tablet_replica.cc:333] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.258152   431 raft_consensus.cc:2243] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.258950   431 raft_consensus.cc:2272] T f8e6273fa02f47668768e36dda283b31 P 8e7be6d583414e048a2528f06bc9bb4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.261060   431 tablet_replica.cc:333] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.261577   431 raft_consensus.cc:2243] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.262538   431 raft_consensus.cc:2272] T e0b04470e6e2425e851b3269445fa374 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.264902   431 tablet_replica.cc:333] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.265425   431 raft_consensus.cc:2243] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.265827   431 raft_consensus.cc:2272] T 9445e4d228e048d79a4dc7e65bf17ce4 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.267823   431 tablet_replica.cc:333] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.268316   431 raft_consensus.cc:2243] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.269047   431 raft_consensus.cc:2272] T 74089dee1ade40d0a51a6bcb238fb462 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.270955   431 tablet_replica.cc:333] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.271423   431 raft_consensus.cc:2243] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.271828   431 raft_consensus.cc:2272] T 8bd0103deb344096a33481aeda5d1d70 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.274320   431 tablet_replica.cc:333] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.274976   431 raft_consensus.cc:2243] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.275662   431 raft_consensus.cc:2272] T 507f378c61374021afd81f65ffe484b2 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.278503   431 tablet_replica.cc:333] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f: stopping tablet replica
I20260709 13:03:51.279179   431 raft_consensus.cc:2243] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.279752   431 raft_consensus.cc:2272] T 377aa62f193a4388a82ea786f25ba033 P 8e7be6d583414e048a2528f06bc9bb4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.341470  9034 raft_consensus.cc:493] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.342892  9034 raft_consensus.cc:515] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:51.349509  9034 leader_election.cc:290] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:51.355345  8115 consensus_peers.cc:597] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.357327  8113 leader_election.cc:336] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111)
W20260709 13:03:51.365453  8115 leader_election.cc:336] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.365967  8115 leader_election.cc:304] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:51.368348  9090 raft_consensus.cc:2749] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:51.370108  8115 consensus_peers.cc:597] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.376829  9034 raft_consensus.cc:493] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.377491  9034 raft_consensus.cc:515] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:51.378556  9098 raft_consensus.cc:493] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.379176  9098 raft_consensus.cc:515] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:51.379757  9034 leader_election.cc:290] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:51.381418  9098 leader_election.cc:290] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:51.388675  8113 leader_election.cc:336] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111)
W20260709 13:03:51.389225  8115 leader_election.cc:336] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111)
I20260709 13:03:51.389523   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:03:51.389979  8115 leader_election.cc:336] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.390424  8115 leader_election.cc:304] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
W20260709 13:03:51.391451  8115 leader_election.cc:336] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.391535  9098 raft_consensus.cc:2749] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.391976  8115 leader_election.cc:304] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:51.393030  9098 raft_consensus.cc:2749] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:51.398342  8115 consensus_peers.cc:597] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.433993  8115 consensus_peers.cc:597] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.444594  9098 raft_consensus.cc:493] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.445269  9098 raft_consensus.cc:515] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:51.447855  9098 leader_election.cc:290] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:51.453629  9098 raft_consensus.cc:493] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.454282  9098 raft_consensus.cc:515] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:51.456688  9098 leader_election.cc:290] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:51.457602  8115 leader_election.cc:336] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111)
I20260709 13:03:51.467036  9090 raft_consensus.cc:493] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.467734  9090 raft_consensus.cc:515] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:51.470400  9090 leader_election.cc:290] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
W20260709 13:03:51.471717  8115 leader_election.cc:336] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.472213  8115 leader_election.cc:304] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:51.472965  9090 raft_consensus.cc:2749] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:51.485764  8115 leader_election.cc:336] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
W20260709 13:03:51.486610  8115 leader_election.cc:336] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111)
I20260709 13:03:51.487054  8115 leader_election.cc:304] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:51.487820  9090 raft_consensus.cc:2749] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:51.496155  8115 leader_election.cc:336] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.497130  9090 raft_consensus.cc:493] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.497215   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:03:51.497123  8115 leader_election.cc:336] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111)
I20260709 13:03:51.497994  8115 leader_election.cc:304] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:51.497821  9090 raft_consensus.cc:515] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } } peers { permanent_uuid: "d1a4c5f7c52440a690a17ed2307b7b17" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43691 } }
I20260709 13:03:51.501103  9098 raft_consensus.cc:2749] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.502398  9090 leader_election.cc:290] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449), d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691)
W20260709 13:03:51.504004  8115 consensus_peers.cc:597] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:51.505587  8113 leader_election.cc:336] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d1a4c5f7c52440a690a17ed2307b7b17 (127.0.107.194:43691): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43691: connect: Connection refused (error 111)
W20260709 13:03:51.509449  8115 leader_election.cc:336] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.509794  8115 leader_election.cc:304] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, d1a4c5f7c52440a690a17ed2307b7b17
I20260709 13:03:51.510490  9098 raft_consensus.cc:2749] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:51.531332  8115 consensus_peers.cc:597] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.554693   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:51.555576   431 tablet_replica.cc:333] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.556454   431 raft_consensus.cc:2243] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.557029   431 raft_consensus.cc:2272] T ea00da638b4f45eea1984895448e1d37 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.559521   431 tablet_replica.cc:333] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
W20260709 13:03:51.559779  8115 consensus_peers.cc:597] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 -> Peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Couldn't send request to peer 8e7be6d583414e048a2528f06bc9bb4f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:51.560343   431 raft_consensus.cc:2243] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.561163   431 raft_consensus.cc:2272] T d0b865da0fa54a2f80b832869c24f96d P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.563294   431 tablet_replica.cc:333] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.563874   431 raft_consensus.cc:2243] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.564620   431 raft_consensus.cc:2272] T f05e192005fb424591cc4763fbafb9af P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.566606   431 tablet_replica.cc:333] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.567206   431 raft_consensus.cc:2243] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.567629   431 raft_consensus.cc:2272] T f1d3eb748fc547daa3c67446a34670fd P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.569591   431 tablet_replica.cc:333] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.570142   431 raft_consensus.cc:2243] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.570927   431 raft_consensus.cc:2272] T 55e6c27d5c454418af17931d298c320a P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.572764   431 tablet_replica.cc:333] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.573343   431 raft_consensus.cc:2243] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.574034   431 raft_consensus.cc:2272] T 2d3427f9a3804e8786b0e837c3187403 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.576032   431 tablet_replica.cc:333] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.576579   431 raft_consensus.cc:2243] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.576984   431 raft_consensus.cc:2272] T cc77641f1caf4b5aa4ad012540fbb5a5 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.578929   431 tablet_replica.cc:333] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.579459   431 raft_consensus.cc:2243] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.579831   431 raft_consensus.cc:2272] T 3e361579718846d08eb4509a5caeeb3c P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.581836   431 tablet_replica.cc:333] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.582386   431 raft_consensus.cc:2243] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.582836   431 raft_consensus.cc:2272] T 6cf568fbc40f4c588f6a1e5802c3fb35 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.585122   431 tablet_replica.cc:333] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.585745   431 raft_consensus.cc:2243] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.586158   431 raft_consensus.cc:2272] T 95f1cdc967ed405b9586552899bd23fb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.588083   431 tablet_replica.cc:333] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.588621   431 raft_consensus.cc:2243] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.589022   431 raft_consensus.cc:2272] T 1dd7f48731264748981e15dd47fb7bb6 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.591055   431 tablet_replica.cc:333] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.591602   431 raft_consensus.cc:2243] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.592000   431 raft_consensus.cc:2272] T fbab94a274f84b2e954e7921a8ac73b3 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.593837   431 tablet_replica.cc:333] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.594384   431 raft_consensus.cc:2243] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.595199   431 raft_consensus.cc:2272] T 117d9367cf76482abd217a33615ad4ef P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.597147   431 tablet_replica.cc:333] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.597692   431 raft_consensus.cc:2243] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.598183   431 raft_consensus.cc:2272] T ab4114d662304b8293dc9591163d2125 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.600236   431 tablet_replica.cc:333] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.600807   431 raft_consensus.cc:2243] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.601213   431 raft_consensus.cc:2272] T 0d1af1b402194d8c90df94542ed85d63 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.603118   431 tablet_replica.cc:333] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.603724   431 raft_consensus.cc:2243] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.604156   431 raft_consensus.cc:2272] T 9445e4d228e048d79a4dc7e65bf17ce4 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.606030   431 tablet_replica.cc:333] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.606664   431 raft_consensus.cc:2243] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.607098   431 raft_consensus.cc:2272] T 74089dee1ade40d0a51a6bcb238fb462 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.609077   431 tablet_replica.cc:333] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.609609   431 raft_consensus.cc:2243] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.610038   431 raft_consensus.cc:2272] T 254ebe75a90346379724aca3aad860e2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.612193   431 tablet_replica.cc:333] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.612732   431 raft_consensus.cc:2243] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.613471   431 raft_consensus.cc:2272] T b05fd148ee7149088d25a5342739c87e P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.615473   431 tablet_replica.cc:333] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.615989   431 raft_consensus.cc:2243] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.616396   431 raft_consensus.cc:2272] T 0ab7e0f3150e480ea34f7b131978b028 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.618166   431 tablet_replica.cc:333] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.618770   431 raft_consensus.cc:2243] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.619196   431 raft_consensus.cc:2272] T 162410dd39f9414d830b658dbc8e7197 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.621134   431 tablet_replica.cc:333] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.621693   431 raft_consensus.cc:2243] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.622097   431 raft_consensus.cc:2272] T e18529f21b404d6ea36647e7f98c61e5 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.623901   431 tablet_replica.cc:333] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.624430   431 raft_consensus.cc:2243] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.624845   431 raft_consensus.cc:2272] T 52fb0d48a61c4f3696f07f0e9f953dfa P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.626729   431 tablet_replica.cc:333] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.627305   431 raft_consensus.cc:2243] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.628074   431 raft_consensus.cc:2272] T 0d38630e1dc34ceb9665dd2a25e61ddb P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.629170  9098 raft_consensus.cc:493] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2bb658b087424b87887d5bfef62d8084)
I20260709 13:03:51.629736  9098 raft_consensus.cc:515] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e7be6d583414e048a2528f06bc9bb4f" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45223 } } peers { permanent_uuid: "ae54318e37b24e6085239e7e480d5d66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 39687 } } peers { permanent_uuid: "2bb658b087424b87887d5bfef62d8084" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 38449 } }
I20260709 13:03:51.630276   431 tablet_replica.cc:333] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.631017   431 raft_consensus.cc:2243] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.631460   431 raft_consensus.cc:2272] T 4988500e3bc44817a1bd87f1c4979cca P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.632091  9098 leader_election.cc:290] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223), 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449)
I20260709 13:03:51.634075   431 tablet_replica.cc:333] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.634936   431 raft_consensus.cc:2243] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.635936   431 raft_consensus.cc:2272] T 79f06a693fd84cf3b2eda8e179fd85dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:51.638209  8115 leader_election.cc:336] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8e7be6d583414e048a2528f06bc9bb4f (127.0.107.195:45223): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45223: connect: Connection refused (error 111)
I20260709 13:03:51.638522   431 tablet_replica.cc:333] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
W20260709 13:03:51.639039  8115 leader_election.cc:336] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2bb658b087424b87887d5bfef62d8084 (127.0.107.193:38449): Network error: Client connection negotiation failed: client connection to 127.0.107.193:38449: connect: Connection refused (error 111)
I20260709 13:03:51.639375   431 raft_consensus.cc:2243] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.639456  8115 leader_election.cc:304] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae54318e37b24e6085239e7e480d5d66; no voters: 2bb658b087424b87887d5bfef62d8084, 8e7be6d583414e048a2528f06bc9bb4f
I20260709 13:03:51.640305  9098 raft_consensus.cc:2749] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.640409   431 raft_consensus.cc:2272] T 443d2e75298341fb8ac3a2a79d5bec05 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.642570   431 tablet_replica.cc:333] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.643204   431 raft_consensus.cc:2243] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.643653   431 raft_consensus.cc:2272] T 3f706220a9864dedb5c4b4b2039b744d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.645673   431 tablet_replica.cc:333] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.646206   431 raft_consensus.cc:2243] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.646596   431 raft_consensus.cc:2272] T ec88e145d9a940c9a732315fdcc27c53 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.648541   431 tablet_replica.cc:333] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.649068   431 raft_consensus.cc:2243] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.649478   431 raft_consensus.cc:2272] T c94e6f3b32be489795228057469a99d6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.651446   431 tablet_replica.cc:333] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.651952   431 raft_consensus.cc:2243] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.652707   431 raft_consensus.cc:2272] T 01c49d9b38fd47608c90fc8e709332dc P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.654580   431 tablet_replica.cc:333] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.655159   431 raft_consensus.cc:2243] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.655926   431 raft_consensus.cc:2272] T 9ef14152466f47d692cf3b31d7045bf7 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.657624   431 tablet_replica.cc:333] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.658131   431 raft_consensus.cc:2243] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.658540   431 raft_consensus.cc:2272] T 8b0b2a413d084182b0f28a502f04dff2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.660591   431 tablet_replica.cc:333] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.661134   431 raft_consensus.cc:2243] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.661567   431 raft_consensus.cc:2272] T b72bd45f8f674163bc3489db86c80c66 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.663430   431 tablet_replica.cc:333] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.663951   431 raft_consensus.cc:2243] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.664481   431 raft_consensus.cc:2272] T f8e6273fa02f47668768e36dda283b31 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.666491   431 tablet_replica.cc:333] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.667065   431 raft_consensus.cc:2243] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.667824   431 raft_consensus.cc:2272] T a88bacd650e3448a85930d7b4d92ee0d P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.669724   431 tablet_replica.cc:333] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.670215   431 raft_consensus.cc:2243] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.670680   431 raft_consensus.cc:2272] T cf19d48029f343a1aa509c8e4ef726a6 P ae54318e37b24e6085239e7e480d5d66 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.672477   431 tablet_replica.cc:333] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.672963   431 raft_consensus.cc:2243] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.673341   431 raft_consensus.cc:2272] T c5d6403dabb047e1a41b15afba4737d8 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.675313   431 tablet_replica.cc:333] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.675794   431 raft_consensus.cc:2243] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.676178   431 raft_consensus.cc:2272] T 1879a702e0ba41b7b0d96b56a99217de P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.677870   431 tablet_replica.cc:333] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.678337   431 raft_consensus.cc:2243] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.678833   431 raft_consensus.cc:2272] T ec19762f6a5e40eea7215e9981f34f9f P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.680624   431 tablet_replica.cc:333] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.681106   431 raft_consensus.cc:2243] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.681859   431 raft_consensus.cc:2272] T 79b2a47fe4a344828901bc5fdf6d45db P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.683773   431 tablet_replica.cc:333] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.684223   431 raft_consensus.cc:2243] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.684906   431 raft_consensus.cc:2272] T c65f361d07e44b12ae649ea71e589a3e P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.686808   431 tablet_replica.cc:333] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.687238   431 raft_consensus.cc:2243] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.687614   431 raft_consensus.cc:2272] T baaa499575414a72af0bd4560d1504c2 P ae54318e37b24e6085239e7e480d5d66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.689492   431 tablet_replica.cc:333] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66: stopping tablet replica
I20260709 13:03:51.689926   431 raft_consensus.cc:2243] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:51.690337   431 raft_consensus.cc:2272] T 507f378c61374021afd81f65ffe484b2 P ae54318e37b24e6085239e7e480d5d66 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.759080   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:03:51.834292   431 master.cc:562] Master@127.0.107.254:37283 shutting down...
I20260709 13:03:51.862767   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:51.863516   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:51.863988   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P f1ea50d70e5c40de9bfc737438605bf0: stopping tablet replica
W20260709 13:03:52.885634   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7856)
I20260709 13:03:53.046059   431 master.cc:584] Master@127.0.107.254:37283 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33371 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:03:53.141592   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39571
I20260709 13:03:53.145123   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.155224  9101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.155376  9100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.160439  9103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.160472   431 server_base.cc:1061] running on GCE node
I20260709 13:03:53.163408   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.163868   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.164112   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602233164075 us; error 0 us; skew 500 ppm
I20260709 13:03:53.164970   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.167997   431 webserver.cc:533] Webserver started at http://127.0.107.254:39317/ using document root <none> and password file <none>
I20260709 13:03:53.168526   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.168749   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.169109   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.170255   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "171f2dc59e294ba7b87c15c10077f376"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.174804   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:03:53.178380  9108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.179261   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:53.179646   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "171f2dc59e294ba7b87c15c10077f376"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.179929   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.209869   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.211216   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.249078   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39571
I20260709 13:03:53.249258  9159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39571 every 8 connection(s)
I20260709 13:03:53.252859  9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.263135  9160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376: Bootstrap starting.
I20260709 13:03:53.267925  9160 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.272058  9160 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376: No bootstrap required, opened a new log
I20260709 13:03:53.274201  9160 raft_consensus.cc:359] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER }
I20260709 13:03:53.274601  9160 raft_consensus.cc:385] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:53.274835  9160 raft_consensus.cc:740] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 171f2dc59e294ba7b87c15c10077f376, State: Initialized, Role: FOLLOWER
I20260709 13:03:53.275511  9160 consensus_queue.cc:260] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER }
I20260709 13:03:53.275983  9160 raft_consensus.cc:399] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:53.276206  9160 raft_consensus.cc:493] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:53.276463  9160 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:53.281944  9160 raft_consensus.cc:515] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER }
I20260709 13:03:53.282522  9160 leader_election.cc:304] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 171f2dc59e294ba7b87c15c10077f376; no voters: 
I20260709 13:03:53.283705  9160 leader_election.cc:290] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:53.284148  9163 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:53.285634  9163 raft_consensus.cc:697] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 1 LEADER]: Becoming Leader. State: Replica: 171f2dc59e294ba7b87c15c10077f376, State: Running, Role: LEADER
I20260709 13:03:53.286285  9163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER }
I20260709 13:03:53.286677  9160 sys_catalog.cc:565] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:53.290938  9165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 171f2dc59e294ba7b87c15c10077f376. Latest consensus state: current_term: 1 leader_uuid: "171f2dc59e294ba7b87c15c10077f376" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER } }
I20260709 13:03:53.291702  9165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:53.291393  9164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "171f2dc59e294ba7b87c15c10077f376" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "171f2dc59e294ba7b87c15c10077f376" member_type: VOTER } }
I20260709 13:03:53.292212  9164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:53.294837  9171 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:53.299656  9171 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:53.302505   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:53.308396  9171 catalog_manager.cc:1383] Generated new cluster ID: 2a6077d71b3c4dfa83da9d4dc523a835
I20260709 13:03:53.308663  9171 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:53.322448  9171 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:53.323691  9171 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:53.340121  9171 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376: Generated new TSK 0
I20260709 13:03:53.340711  9171 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:53.369719   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.375927  9181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.376840  9182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.378640   431 server_base.cc:1061] running on GCE node
W20260709 13:03:53.378669  9184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.379922   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.380110   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.380245   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602233380233 us; error 0 us; skew 500 ppm
I20260709 13:03:53.380736   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.383132   431 webserver.cc:533] Webserver started at http://127.0.107.193:44149/ using document root <none> and password file <none>
I20260709 13:03:53.383563   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.383723   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.383925   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.385015   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "32fbfed0f7424a3583a6b695c84ed8af"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.389528   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:03:53.393115  9189 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.393867   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:53.394291   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "32fbfed0f7424a3583a6b695c84ed8af"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.394593   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.412232   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.413491   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.415096   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.417784   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.418035   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.418279   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.418462   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.458634   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33513
I20260709 13:03:53.458827  9251 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33513 every 8 connection(s)
I20260709 13:03:53.463759   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.471413  9256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.474658  9257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.475379   431 server_base.cc:1061] running on GCE node
W20260709 13:03:53.475760  9259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.477123   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:53.477357   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.477547   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602233477531 us; error 0 us; skew 500 ppm
I20260709 13:03:53.478063  9252 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39571
I20260709 13:03:53.478163   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.478674  9252 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.479696  9252 heartbeater.cc:507] Master 127.0.107.254:39571 requested a full tablet report, sending...
I20260709 13:03:53.481463   431 webserver.cc:533] Webserver started at http://127.0.107.194:33251/ using document root <none> and password file <none>
I20260709 13:03:53.482103   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.482302   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.482299  9125 ts_manager.cc:194] Registered new tserver with Master: 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:03:53.482859   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.484081   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "d6e3a3c7671d451084d8d55da4236d2d"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.484639  9125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38522
I20260709 13:03:53.489478   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:53.492970  9264 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.493724   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:53.493969   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "d6e3a3c7671d451084d8d55da4236d2d"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.494213   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.519066   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.520174   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.521526   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.523779   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.523983   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.524247   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.524405   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.564075   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35731
I20260709 13:03:53.564195  9326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35731 every 8 connection(s)
I20260709 13:03:53.569188   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:53.576702  9330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.577879  9331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:53.580085  9333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:53.581164  9327 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39571
I20260709 13:03:53.581465   431 server_base.cc:1061] running on GCE node
I20260709 13:03:53.581646  9327 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.582561   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:53.582684  9327 heartbeater.cc:507] Master 127.0.107.254:39571 requested a full tablet report, sending...
W20260709 13:03:53.582899   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:53.583139   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602233583120 us; error 0 us; skew 500 ppm
I20260709 13:03:53.583897   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:53.585072  9125 ts_manager.cc:194] Registered new tserver with Master: d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:53.586484  9125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38536
I20260709 13:03:53.586845   431 webserver.cc:533] Webserver started at http://127.0.107.195:44639/ using document root <none> and password file <none>
I20260709 13:03:53.587507   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:53.587742   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:53.588017   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:53.589224   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "06e457ac2f704b48a600354fdbadc070"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.593641   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:53.597223  9338 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.598017   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:53.598354   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "06e457ac2f704b48a600354fdbadc070"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:03:53.598623   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:53.615324   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:53.616537   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:53.618003   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:53.620265   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:53.620501   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.620743   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:53.620920   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:53.661309   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37315
I20260709 13:03:53.661418  9400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37315 every 8 connection(s)
I20260709 13:03:53.675271  9401 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39571
I20260709 13:03:53.675706  9401 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:53.676445  9401 heartbeater.cc:507] Master 127.0.107.254:39571 requested a full tablet report, sending...
I20260709 13:03:53.678512  9125 ts_manager.cc:194] Registered new tserver with Master: 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:53.679162   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014433966s
I20260709 13:03:53.679977  9125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38552
I20260709 13:03:53.705595  9125 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38560:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:53.708426  9125 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:53.778080  9292 tablet_service.cc:1511] Processing CreateTablet for tablet b3a25c72353b4dfcbf595d999bc57b5b (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.779670  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a25c72353b4dfcbf595d999bc57b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.781759  9291 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb6bc6265884acda3807e353978d652 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.783386  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb6bc6265884acda3807e353978d652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.783613  9290 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9e8fa161544fd6a552836678e47983 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.785070  9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9e8fa161544fd6a552836678e47983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.789618  9366 tablet_service.cc:1511] Processing CreateTablet for tablet b3a25c72353b4dfcbf595d999bc57b5b (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.791080  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a25c72353b4dfcbf595d999bc57b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.794458  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb6bc6265884acda3807e353978d652 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.795945  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb6bc6265884acda3807e353978d652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.797087  9364 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9e8fa161544fd6a552836678e47983 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.798493  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9e8fa161544fd6a552836678e47983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.808068  9217 tablet_service.cc:1511] Processing CreateTablet for tablet b3a25c72353b4dfcbf595d999bc57b5b (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:03:53.809960  9217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3a25c72353b4dfcbf595d999bc57b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.812739  9289 tablet_service.cc:1511] Processing CreateTablet for tablet 05dce303327849fbae896dcfc8279679 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.813556  9363 tablet_service.cc:1511] Processing CreateTablet for tablet 05dce303327849fbae896dcfc8279679 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.815045  9363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dce303327849fbae896dcfc8279679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.817577  9215 tablet_service.cc:1511] Processing CreateTablet for tablet 5f9e8fa161544fd6a552836678e47983 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:03:53.823259  9362 tablet_service.cc:1511] Processing CreateTablet for tablet 77a0f360431645079234b361b4eb11ac (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.823802  9287 tablet_service.cc:1511] Processing CreateTablet for tablet 571bfc946ec34c5499313ff18d4f6582 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.824934  9362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a0f360431645079234b361b4eb11ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.825685  9216 tablet_service.cc:1511] Processing CreateTablet for tablet 6cb6bc6265884acda3807e353978d652 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:03:53.828377  9214 tablet_service.cc:1511] Processing CreateTablet for tablet 05dce303327849fbae896dcfc8279679 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:03:53.829126  9213 tablet_service.cc:1511] Processing CreateTablet for tablet 77a0f360431645079234b361b4eb11ac (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.831285  9212 tablet_service.cc:1511] Processing CreateTablet for tablet 571bfc946ec34c5499313ff18d4f6582 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.831634  9211 tablet_service.cc:1511] Processing CreateTablet for tablet b85bbc801ea44f0090613a7e259dcefc (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.831786  9361 tablet_service.cc:1511] Processing CreateTablet for tablet 571bfc946ec34c5499313ff18d4f6582 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:03:53.833376  9361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571bfc946ec34c5499313ff18d4f6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.822057  9288 tablet_service.cc:1511] Processing CreateTablet for tablet 77a0f360431645079234b361b4eb11ac (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:03:53.836342  9216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cb6bc6265884acda3807e353978d652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.839525  9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dce303327849fbae896dcfc8279679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.841738  9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571bfc946ec34c5499313ff18d4f6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.841718  9292 tablet_service.cc:1511] Processing CreateTablet for tablet b85bbc801ea44f0090613a7e259dcefc (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.843307  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85bbc801ea44f0090613a7e259dcefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.847548  9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a0f360431645079234b361b4eb11ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.847981  9212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 571bfc946ec34c5499313ff18d4f6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.848277  9415 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:53.850354  9215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9e8fa161544fd6a552836678e47983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.855268  9213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a0f360431645079234b361b4eb11ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.856586  9214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05dce303327849fbae896dcfc8279679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.859162  9211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85bbc801ea44f0090613a7e259dcefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.865041  9360 tablet_service.cc:1511] Processing CreateTablet for tablet b85bbc801ea44f0090613a7e259dcefc (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:03:53.866568  9360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85bbc801ea44f0090613a7e259dcefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.868436  9210 tablet_service.cc:1511] Processing CreateTablet for tablet a152c8f1bff8424b8c94cd98c7468b15 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.869880  9210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a152c8f1bff8424b8c94cd98c7468b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.883332  9286 tablet_service.cc:1511] Processing CreateTablet for tablet a152c8f1bff8424b8c94cd98c7468b15 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.884855  9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a152c8f1bff8424b8c94cd98c7468b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.894447  9359 tablet_service.cc:1511] Processing CreateTablet for tablet a152c8f1bff8424b8c94cd98c7468b15 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:03:53.895886  9359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a152c8f1bff8424b8c94cd98c7468b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.908171  9415 tablet_bootstrap.cc:654] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.937884  9416 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:53.948714  9212 tablet_service.cc:1511] Processing CreateTablet for tablet 9af7af18014248138af4416ac4433f09 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:53.950265  9212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af7af18014248138af4416ac4433f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.955404  9417 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:53.968712  9416 tablet_bootstrap.cc:654] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.968917  9365 tablet_service.cc:1511] Processing CreateTablet for tablet 9af7af18014248138af4416ac4433f09 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:53.970299  9365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af7af18014248138af4416ac4433f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.971444  9292 tablet_service.cc:1511] Processing CreateTablet for tablet ea297deccd4442e19cf30dd74f709bed (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:53.972723  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea297deccd4442e19cf30dd74f709bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.966382  9290 tablet_service.cc:1511] Processing CreateTablet for tablet 9af7af18014248138af4416ac4433f09 (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:03:53.978011  9417 tablet_bootstrap.cc:654] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:53.979218  9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9af7af18014248138af4416ac4433f09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.984555  9364 tablet_service.cc:1511] Processing CreateTablet for tablet ea297deccd4442e19cf30dd74f709bed (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:53.995213  9364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea297deccd4442e19cf30dd74f709bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:53.981655  9215 tablet_service.cc:1511] Processing CreateTablet for tablet ea297deccd4442e19cf30dd74f709bed (DEFAULT_TABLE table=test-workload [id=ac333fe11e174b6c92298f01d4de6c98]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:03:53.998323  9215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea297deccd4442e19cf30dd74f709bed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:54.016914  9415 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.017524  9415 ts_tablet_manager.cc:1403] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.170s	user 0.008s	sys 0.013s
I20260709 13:03:54.020738  9415 raft_consensus.cc:359] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.021494  9415 raft_consensus.cc:385] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.021772  9415 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.022698  9415 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.025215  9416 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.025784  9416 ts_tablet_manager.cc:1403] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.025s
I20260709 13:03:54.027436  9417 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.027573  9327 heartbeater.cc:499] Master 127.0.107.254:39571 was elected leader, sending a full tablet report...
I20260709 13:03:54.028201  9417 ts_tablet_manager.cc:1403] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.000s
I20260709 13:03:54.028226  9415 ts_tablet_manager.cc:1434] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.004s
I20260709 13:03:54.028913  9416 raft_consensus.cc:359] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.029471  9415 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.029706  9416 raft_consensus.cc:385] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.030068  9416 raft_consensus.cc:740] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.030838  9416 consensus_queue.cc:260] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.031816  9417 raft_consensus.cc:359] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.035755  9417 raft_consensus.cc:385] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.036098  9415 tablet_bootstrap.cc:654] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.036136  9417 raft_consensus.cc:740] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.037537  9417 consensus_queue.cc:260] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.040550  9401 heartbeater.cc:499] Master 127.0.107.254:39571 was elected leader, sending a full tablet report...
I20260709 13:03:54.041079  9416 ts_tablet_manager.cc:1434] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.011s
I20260709 13:03:54.044137  9416 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.044353  9252 heartbeater.cc:499] Master 127.0.107.254:39571 was elected leader, sending a full tablet report...
I20260709 13:03:54.046424  9417 ts_tablet_manager.cc:1434] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:03:54.049818  9417 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.050895  9416 tablet_bootstrap.cc:654] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.058459  9417 tablet_bootstrap.cc:654] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:54.068593  9328 tablet.cc:2406] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:54.079262  9417 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.081562  9417 ts_tablet_manager.cc:1403] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 13:03:54.087450  9417 raft_consensus.cc:359] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.089161  9417 raft_consensus.cc:385] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.091382  9417 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.092967  9417 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.094563  9416 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.095263  9416 ts_tablet_manager.cc:1403] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.040s
I20260709 13:03:54.095279  9417 ts_tablet_manager.cc:1434] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:03:54.097060  9417 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.099066  9416 raft_consensus.cc:359] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.099877  9416 raft_consensus.cc:385] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.100234  9416 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.102284  9415 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.101130  9416 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.102897  9415 ts_tablet_manager.cc:1403] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.032s
I20260709 13:03:54.104457  9416 ts_tablet_manager.cc:1434] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:54.105569  9416 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.105926  9415 raft_consensus.cc:359] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.106688  9415 raft_consensus.cc:385] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.106997  9415 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.107643  9417 tablet_bootstrap.cc:654] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.107810  9415 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.110173  9415 ts_tablet_manager.cc:1434] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:54.111186  9415 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.113266  9416 tablet_bootstrap.cc:654] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.118263  9415 tablet_bootstrap.cc:654] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.125424  9416 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.126005  9416 ts_tablet_manager.cc:1403] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:03:54.129020  9416 raft_consensus.cc:359] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.129457  9415 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.129771  9416 raft_consensus.cc:385] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.130116  9415 ts_tablet_manager.cc:1403] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:03:54.130324  9417 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.130126  9416 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.130975  9417 ts_tablet_manager.cc:1403] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.018s
I20260709 13:03:54.131382  9416 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.133471  9416 ts_tablet_manager.cc:1434] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:54.133317  9415 raft_consensus.cc:359] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.133734  9417 raft_consensus.cc:359] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.134439  9417 raft_consensus.cc:385] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.134456  9416 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.134089  9415 raft_consensus.cc:385] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.134847  9417 raft_consensus.cc:740] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.135115  9415 raft_consensus.cc:740] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.135776  9417 consensus_queue.cc:260] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.136065  9415 consensus_queue.cc:260] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.138652  9415 ts_tablet_manager.cc:1434] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:03:54.139604  9415 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.141779  9416 tablet_bootstrap.cc:654] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.141875  9417 ts_tablet_manager.cc:1434] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:54.143143  9417 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.146039  9415 tablet_bootstrap.cc:654] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.149487  9417 tablet_bootstrap.cc:654] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.169055  9415 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.169942  9415 ts_tablet_manager.cc:1403] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.004s
I20260709 13:03:54.171574  9416 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.172070  9416 ts_tablet_manager.cc:1403] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.017s
I20260709 13:03:54.173868  9415 raft_consensus.cc:359] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.174168  9416 raft_consensus.cc:359] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.175065  9415 raft_consensus.cc:385] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.175197  9416 raft_consensus.cc:385] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.175446  9415 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.175652  9416 raft_consensus.cc:740] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.176445  9416 consensus_queue.cc:260] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.176281  9415 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.177443  9417 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.177928  9417 ts_tablet_manager.cc:1403] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.026s
I20260709 13:03:54.178647  9416 ts_tablet_manager.cc:1434] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:54.180579  9416 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.180979  9415 ts_tablet_manager.cc:1434] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:03:54.181986  9415 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.182392  9417 raft_consensus.cc:359] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.183238  9417 raft_consensus.cc:385] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.183527  9417 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.184360  9417 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.187237  9416 tablet_bootstrap.cc:654] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.188866  9415 tablet_bootstrap.cc:654] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.189049  9417 ts_tablet_manager.cc:1434] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:54.190160  9417 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.194041  9422 raft_consensus.cc:493] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.194550  9422 raft_consensus.cc:515] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.200696  9415 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.201182  9417 tablet_bootstrap.cc:654] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.202572  9421 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.203141  9421 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.205742  9422 leader_election.cc:290] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.205760  9421 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.217530  9416 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.218222  9416 ts_tablet_manager.cc:1403] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.003s
I20260709 13:03:54.201267  9415 ts_tablet_manager.cc:1403] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:03:54.221240  9416 raft_consensus.cc:359] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.221390  9415 raft_consensus.cc:359] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.222020  9417 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.222044  9416 raft_consensus.cc:385] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.222801  9416 raft_consensus.cc:740] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.222923  9417 ts_tablet_manager.cc:1403] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.001s
I20260709 13:03:54.222340  9415 raft_consensus.cc:385] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.223738  9415 raft_consensus.cc:740] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.223701  9416 consensus_queue.cc:260] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.226155  9416 ts_tablet_manager.cc:1434] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:03:54.227186  9416 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.231513  9415 consensus_queue.cc:260] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.234304  9416 tablet_bootstrap.cc:654] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.235056  9424 raft_consensus.cc:493] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.234369  9415 ts_tablet_manager.cc:1434] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:03:54.237528  9415 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.238968  9417 raft_consensus.cc:359] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.239799  9417 raft_consensus.cc:385] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.240087  9417 raft_consensus.cc:740] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.241827  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.235586  9424 raft_consensus.cc:515] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.245461  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.246286  9227 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.246294  9302 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.248944  9342 leader_election.cc:304] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.249948  9422 raft_consensus.cc:2804] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.250325  9422 raft_consensus.cc:493] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.250684  9422 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.257153  9424 leader_election.cc:290] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.258780  9415 tablet_bootstrap.cc:654] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.261322  9421 raft_consensus.cc:493] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.262061  9421 raft_consensus.cc:515] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.264810  9421 leader_election.cc:290] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.265430  9422 raft_consensus.cc:515] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.268675  9417 consensus_queue.cc:260] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.274953  9417 ts_tablet_manager.cc:1434] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.005s
I20260709 13:03:54.276270  9417 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.283542  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.284297  9227 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 0.
I20260709 13:03:54.285176  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.285801  9302 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.287020  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.288635  9265 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.289522  9421 raft_consensus.cc:2804] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.290150  9421 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.290664  9421 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.291046  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.292548  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.293246  9375 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 0.
W20260709 13:03:54.289608  9265 leader_election.cc:343] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.299407  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.299278  9415 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.300279  9227 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.306957  9417 tablet_bootstrap.cc:654] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.317634  9302 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.311075  9415 ts_tablet_manager.cc:1403] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.000s
W20260709 13:03:54.311367  9265 leader_election.cc:343] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.320091  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.320334  9265 leader_election.cc:304] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 32fbfed0f7424a3583a6b695c84ed8af
I20260709 13:03:54.321765  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.312728  9227 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.294822  9422 leader_election.cc:290] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.314335  9421 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.323544  9415 raft_consensus.cc:359] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.323944  9339 leader_election.cc:304] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.324357  9415 raft_consensus.cc:385] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.324847  9421 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
W20260709 13:03:54.308594  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:54.325369  9446 raft_consensus.cc:2804] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.324896  9415 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.322600  9375 raft_consensus.cc:2393] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32fbfed0f7424a3583a6b695c84ed8af in current term 1: Already voted for candidate 06e457ac2f704b48a600354fdbadc070 in this term.
I20260709 13:03:54.325845  9446 raft_consensus.cc:493] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.326501  9422 raft_consensus.cc:2804] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.327268  9421 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.327479  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.327100  9190 leader_election.cc:304] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af; no voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:03:54.328071  9227 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.327803  9421 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.328456  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:54.328967  9424 raft_consensus.cc:2749] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.326210  9446 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:54.330117  9265 leader_election.cc:343] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.317449  9416 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.330550  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.331068  9416 ts_tablet_manager.cc:1403] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.053s
I20260709 13:03:54.334216  9416 raft_consensus.cc:359] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.334929  9416 raft_consensus.cc:385] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.335294  9416 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.335559  9227 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 1.
W20260709 13:03:54.335443  9265 leader_election.cc:343] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.338162  9265 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 06e457ac2f704b48a600354fdbadc070
I20260709 13:03:54.338790  9417 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.339331  9422 raft_consensus.cc:697] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:03:54.339398  9417 ts_tablet_manager.cc:1403] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.008s
I20260709 13:03:54.339403  9448 raft_consensus.cc:493] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.340345  9448 raft_consensus.cc:515] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.340477  9422 consensus_queue.cc:237] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.343075  9449 raft_consensus.cc:2804] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.342854  9417 raft_consensus.cc:359] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.343624  9417 raft_consensus.cc:385] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.343999  9417 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.344645  9448 leader_election.cc:290] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.345072  9227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.345250  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.345826  9227 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.345968  9302 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.346683  9421 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:03:54.347132  9339 leader_election.cc:304] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.341957  9446 raft_consensus.cc:515] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.348019  9448 raft_consensus.cc:2804] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.348953  9448 raft_consensus.cc:493] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.336748  9415 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.352195  9448 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.353466  9415 ts_tablet_manager.cc:1434] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:03:54.354198  9415 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.336104  9416 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.355257  9125 catalog_manager.cc:5697] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.356755  9416 ts_tablet_manager.cc:1434] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.002s
I20260709 13:03:54.357935  9416 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.349248  9226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.359009  9226 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 0.
I20260709 13:03:54.360399  9265 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 06e457ac2f704b48a600354fdbadc070
I20260709 13:03:54.360910  9415 tablet_bootstrap.cc:654] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.349251  9446 leader_election.cc:290] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.349689  9417 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.350666  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.351377  9449 raft_consensus.cc:697] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:03:54.351814  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:54.363099  9375 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.363618  9417 ts_tablet_manager.cc:1434] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:03:54.364682  9417 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.364969  9416 tablet_bootstrap.cc:654] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.371309  9417 tablet_bootstrap.cc:654] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.371272  9449 consensus_queue.cc:237] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.373588  9375 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 1.
I20260709 13:03:54.361685  9451 raft_consensus.cc:2804] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.375185  9451 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.375645  9451 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.361729  9448 raft_consensus.cc:515] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.383582  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.384366  9225 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.392302  9415 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.392956  9415 ts_tablet_manager.cc:1403] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.004s
I20260709 13:03:54.394842  9416 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.395385  9416 ts_tablet_manager.cc:1403] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.017s
I20260709 13:03:54.400141  9265 leader_election.cc:304] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.400480  9448 leader_election.cc:290] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
W20260709 13:03:54.401525  9265 leader_election.cc:343] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.406440  9225 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.409221  9339 leader_election.cc:304] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.408989  9416 raft_consensus.cc:359] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.396426  9415 raft_consensus.cc:359] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.410323  9448 raft_consensus.cc:2804] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.407223  9446 raft_consensus.cc:2804] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.410329  9416 raft_consensus.cc:385] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.410594  9415 raft_consensus.cc:385] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.410514  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.411123  9416 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.411305  9415 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.411484  9302 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.412109  9448 raft_consensus.cc:697] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:03:54.412179  9416 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.412374  9415 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.413015  9448 consensus_queue.cc:237] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.414556  9416 ts_tablet_manager.cc:1434] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:03:54.414755  9415 ts_tablet_manager.cc:1434] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:03:54.415640  9416 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.415880  9415 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.411156  9446 raft_consensus.cc:697] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:03:54.416929  9446 consensus_queue.cc:237] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.419217  9451 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.421452  9417 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.423583  9416 tablet_bootstrap.cc:654] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.424561  9417 ts_tablet_manager.cc:1403] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.019s
I20260709 13:03:54.436733  9302 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.445951  9451 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Requested vote from peers 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:03:54.445343  9417 raft_consensus.cc:359] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.447974  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:54.449321  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.449761  9415 tablet_bootstrap.cc:654] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.450007  9225 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:54.451093  9265 leader_election.cc:343] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:54.452857  9448 raft_consensus.cc:493] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.453341  9448 raft_consensus.cc:515] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.456095  9448 leader_election.cc:290] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.458040  9226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.460080  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.455093  9122 catalog_manager.cc:5697] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.460887  9302 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.462062  9342 leader_election.cc:304] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.463073  9448 raft_consensus.cc:2804] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.463500  9448 raft_consensus.cc:493] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.463878  9448 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.464958  9225 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 1.
I20260709 13:03:54.466051  9265 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 06e457ac2f704b48a600354fdbadc070
I20260709 13:03:54.446894  9417 raft_consensus.cc:385] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.467594  9417 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.468488  9417 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.469085  9446 raft_consensus.cc:2804] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.469455  9226 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.469873  9446 raft_consensus.cc:697] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:03:54.472380  9424 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.472645  9417 ts_tablet_manager.cc:1434] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:03:54.473031  9424 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.473793  9417 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.476011  9448 raft_consensus.cc:515] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.479343  9448 leader_election.cc:290] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.480605  9417 tablet_bootstrap.cc:654] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.480620  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.480955  9424 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.481482  9302 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 0.
I20260709 13:03:54.482872  9226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.483029  9193 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.483487  9226 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.486124  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.486975  9375 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 0.
I20260709 13:03:54.489344  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.490136  9302 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.492069  9417 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.492578  9417 ts_tablet_manager.cc:1403] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:03:54.493005  9226 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.494100  9339 leader_election.cc:304] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.495160  9448 raft_consensus.cc:2804] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.495571  9417 raft_consensus.cc:359] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.495864  9448 raft_consensus.cc:697] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:03:54.496436  9417 raft_consensus.cc:385] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.496731  9417 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.497054  9424 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.497560  9424 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.497577  9417 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.498153  9424 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.500296  9448 consensus_queue.cc:237] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.499558  9446 consensus_queue.cc:237] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.507550  9125 catalog_manager.cc:5697] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.509243  9424 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.512957  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.513723  9301 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.520323  9302 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.525072  9301 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 1.
I20260709 13:03:54.528445  9193 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.532685  9415 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.533262  9415 ts_tablet_manager.cc:1403] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.020s
I20260709 13:03:54.535720  9415 raft_consensus.cc:359] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.536154  9415 raft_consensus.cc:385] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.536315  9415 raft_consensus.cc:740] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.536804  9415 consensus_queue.cc:260] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.538193  9415 ts_tablet_manager.cc:1434] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:03:54.538992  9415 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.538240  9122 catalog_manager.cc:5697] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.544786  9415 tablet_bootstrap.cc:654] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.546787  9468 raft_consensus.cc:493] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.547310  9468 raft_consensus.cc:515] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.551097  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.551952  9375 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 0.
I20260709 13:03:54.553401  9416 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.553660  9190 leader_election.cc:304] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.554165  9416 ts_tablet_manager.cc:1403] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.139s	user 0.012s	sys 0.027s
I20260709 13:03:54.560155  9416 raft_consensus.cc:359] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.560370  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.561136  9416 raft_consensus.cc:385] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.561580  9416 raft_consensus.cc:740] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.561429  9301 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 0.
I20260709 13:03:54.562765  9416 consensus_queue.cc:260] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.565622  9416 ts_tablet_manager.cc:1434] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:54.566747  9470 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.567198  9416 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.568456  9467 raft_consensus.cc:2804] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.568856  9467 raft_consensus.cc:493] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.569201  9467 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.574994  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:54.575865  9375 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.585589  9125 catalog_manager.cc:5697] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.592689  9125 catalog_manager.cc:5697] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 0 to 1, leader changed from <none> to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.595618  9468 leader_election.cc:290] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.595839  9424 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 election: Requested vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.599361  9416 tablet_bootstrap.cc:654] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.603724  9417 ts_tablet_manager.cc:1434] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.109s	user 0.004s	sys 0.012s
I20260709 13:03:54.605070  9417 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.607577  9375 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 1.
I20260709 13:03:54.612120  9467 raft_consensus.cc:515] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.612550  9417 tablet_bootstrap.cc:654] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.615530  9416 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.615810  9415 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.616041  9416 ts_tablet_manager.cc:1403] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.011s
I20260709 13:03:54.616401  9415 ts_tablet_manager.cc:1403] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.052s
I20260709 13:03:54.613160  9465 raft_consensus.cc:493] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.617615  9465 raft_consensus.cc:515] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.600842  9470 raft_consensus.cc:697] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 LEADER]: Becoming Leader. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Running, Role: LEADER
I20260709 13:03:54.619361  9416 raft_consensus.cc:359] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.619580  9415 raft_consensus.cc:359] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.620154  9416 raft_consensus.cc:385] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.619851  9470 consensus_queue.cc:237] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.621712  9465 leader_election.cc:290] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.620352  9415 raft_consensus.cc:385] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.660555  9415 raft_consensus.cc:740] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.622574  9467 leader_election.cc:290] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 election: Requested vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:54.620550  9416 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.665133  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.667001  9416 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.668329  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.669518  9302 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.673133  9417 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.674642  9417 ts_tablet_manager.cc:1403] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.001s
I20260709 13:03:54.680512  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:54.681461  9376 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.683353  9375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "32fbfed0f7424a3583a6b695c84ed8af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:54.684439  9375 raft_consensus.cc:2393] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32fbfed0f7424a3583a6b695c84ed8af in current term 1: Already voted for candidate d6e3a3c7671d451084d8d55da4236d2d in this term.
I20260709 13:03:54.678081  9416 ts_tablet_manager.cc:1434] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 13:03:54.687608  9193 leader_election.cc:304] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af; no voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:03:54.689002  9467 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.665158  9415 consensus_queue.cc:260] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.705576  9416 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: Bootstrap starting.
I20260709 13:03:54.710206  9415 ts_tablet_manager.cc:1434] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.001s
I20260709 13:03:54.710338  9467 raft_consensus.cc:2749] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.712945  9415 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: Bootstrap starting.
I20260709 13:03:54.714313  9416 tablet_bootstrap.cc:654] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.702680  9376 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 1.
I20260709 13:03:54.699071  9302 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32fbfed0f7424a3583a6b695c84ed8af in term 1.
I20260709 13:03:54.718088  9448 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.718746  9193 leader_election.cc:304] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.719017  9448 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.720424  9467 raft_consensus.cc:2804] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.713078  9417 raft_consensus.cc:359] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.721695  9417 raft_consensus.cc:385] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.722074  9417 raft_consensus.cc:740] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.722190  9448 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.722518  9467 raft_consensus.cc:697] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 LEADER]: Becoming Leader. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Running, Role: LEADER
I20260709 13:03:54.724644  9226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.728545  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.729024  9226 raft_consensus.cc:2393] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06e457ac2f704b48a600354fdbadc070 in current term 1: Already voted for candidate d6e3a3c7671d451084d8d55da4236d2d in this term.
I20260709 13:03:54.730033  9415 tablet_bootstrap.cc:654] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.731809  9339 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070; no voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:03:54.733498  9448 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.726643  9417 consensus_queue.cc:260] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.743443  9125 catalog_manager.cc:5697] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af reported cstate change: term changed from 0 to 1, leader changed from <none> to 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32fbfed0f7424a3583a6b695c84ed8af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.746708  9422 consensus_queue.cc:1048] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.759249  9417 ts_tablet_manager.cc:1434] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.002s
I20260709 13:03:54.761381  9417 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:03:54.754513  9467 consensus_queue.cc:237] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.766096  9446 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.769086  9417 tablet_bootstrap.cc:654] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:54.770576  9422 raft_consensus.cc:493] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.771555  9416 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: No bootstrap required, opened a new log
I20260709 13:03:54.772079  9416 ts_tablet_manager.cc:1403] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.009s
I20260709 13:03:54.771675  9422 raft_consensus.cc:515] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.777145  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af7af18014248138af4416ac4433f09" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.779422  9416 raft_consensus.cc:359] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.781540  9416 raft_consensus.cc:385] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.781898  9416 raft_consensus.cc:740] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.782799  9415 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: No bootstrap required, opened a new log
I20260709 13:03:54.783264  9415 ts_tablet_manager.cc:1403] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.023s
I20260709 13:03:54.780599  9225 raft_consensus.cc:2468] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.784925  9416 consensus_queue.cc:260] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.786667  9339 leader_election.cc:304] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.787669  9416 ts_tablet_manager.cc:1434] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:54.789116  9447 raft_consensus.cc:2804] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.789577  9447 raft_consensus.cc:493] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.789976  9447 raft_consensus.cc:3060] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.790033  9422 leader_election.cc:290] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.791308  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af7af18014248138af4416ac4433f09" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.792146  9301 raft_consensus.cc:2468] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.793967  9448 raft_consensus.cc:2749] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.789237  9415 raft_consensus.cc:359] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.795413  9415 raft_consensus.cc:385] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.795648  9415 raft_consensus.cc:740] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.796510  9415 consensus_queue.cc:260] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.801258  9415 ts_tablet_manager.cc:1434] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:03:54.819386  9417 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: No bootstrap required, opened a new log
I20260709 13:03:54.819983  9417 ts_tablet_manager.cc:1403] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.002s
I20260709 13:03:54.822927  9417 raft_consensus.cc:359] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.824299  9417 raft_consensus.cc:385] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:54.824668  9417 raft_consensus.cc:740] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:03:54.825382  9417 consensus_queue.cc:260] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.827762  9417 ts_tablet_manager.cc:1434] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:54.833056  9124 catalog_manager.cc:5697] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af reported cstate change: term changed from 0 to 1, leader changed from <none> to 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193). New cstate: current_term: 1 leader_uuid: "32fbfed0f7424a3583a6b695c84ed8af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:54.808329  9447 raft_consensus.cc:515] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.836992  9447 leader_election.cc:290] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.843210  9446 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.843681  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af7af18014248138af4416ac4433f09" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.843852  9422 consensus_queue.cc:1048] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.844329  9302 raft_consensus.cc:3060] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.853549  9302 raft_consensus.cc:2468] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.854305  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9af7af18014248138af4416ac4433f09" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.855108  9225 raft_consensus.cc:3060] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.860157  9486 consensus_queue.cc:1048] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.863870  9342 leader_election.cc:304] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:03:54.864092  9225 raft_consensus.cc:2468] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.866892  9422 raft_consensus.cc:2804] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.867479  9422 raft_consensus.cc:697] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:03:54.868639  9422 consensus_queue.cc:237] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.877426  9449 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.888206  9125 catalog_manager.cc:5697] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:54.891925  9449 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.909111  9486 consensus_queue.cc:1048] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:54.918720  9448 raft_consensus.cc:493] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.919237  9448 raft_consensus.cc:515] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.921259  9448 leader_election.cc:290] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.922079  9448 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.922520  9448 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:03:54.922712  9226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea297deccd4442e19cf30dd74f709bed" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.923574  9226 raft_consensus.cc:2468] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.924547  9448 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:03:54.924736  9339 leader_election.cc:304] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.926498  9448 raft_consensus.cc:2804] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:54.926981  9448 raft_consensus.cc:493] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.927121  9302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea297deccd4442e19cf30dd74f709bed" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.926800  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af" is_pre_election: true
I20260709 13:03:54.927488  9448 raft_consensus.cc:3060] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.927759  9302 raft_consensus.cc:2468] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 0.
I20260709 13:03:54.921031  9422 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.928174  9225 raft_consensus.cc:2393] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06e457ac2f704b48a600354fdbadc070 in current term 1: Already voted for candidate d6e3a3c7671d451084d8d55da4236d2d in this term.
I20260709 13:03:54.926800  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d" is_pre_election: true
I20260709 13:03:54.930473  9342 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070; no voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:03:54.932188  9422 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.937625  9448 raft_consensus.cc:515] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.940578  9422 raft_consensus.cc:2749] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:54.941733  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea297deccd4442e19cf30dd74f709bed" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:03:54.942607  9301 raft_consensus.cc:3060] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.942704  9225 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea297deccd4442e19cf30dd74f709bed" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:03:54.943439  9225 raft_consensus.cc:3060] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:54.945722  9448 leader_election.cc:290] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:03:54.952138  9225 raft_consensus.cc:2468] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.954452  9339 leader_election.cc:304] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:03:54.955256  9486 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:54.956725  9486 raft_consensus.cc:2804] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:54.957252  9486 raft_consensus.cc:697] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:03:54.958112  9486 consensus_queue.cc:237] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:54.967803  9301 raft_consensus.cc:2468] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 1.
I20260709 13:03:54.968235  9125 catalog_manager.cc:5697] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.022894  9449 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:55.034278  9449 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.101649  9467 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.114401  9470 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:55.189237   431 ts_manager.cc:295] Set tserver state for 32fbfed0f7424a3583a6b695c84ed8af to MAINTENANCE_MODE
I20260709 13:03:55.190083   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:03:55.211731   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:55.214506   431 tablet_replica.cc:333] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.215629   431 raft_consensus.cc:2243] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.216305   431 raft_consensus.cc:2272] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.219673   431 tablet_replica.cc:333] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.220275   431 raft_consensus.cc:2243] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.221105   431 raft_consensus.cc:2272] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.223472   431 tablet_replica.cc:333] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.224030   431 raft_consensus.cc:2243] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.224439   431 raft_consensus.cc:2272] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.226881   431 tablet_replica.cc:333] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.227416   431 raft_consensus.cc:2243] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.227818   431 raft_consensus.cc:2272] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.230080   431 tablet_replica.cc:333] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.230603   431 raft_consensus.cc:2243] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.231040   431 raft_consensus.cc:2272] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.232932   431 tablet_replica.cc:333] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.233423   431 raft_consensus.cc:2243] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.233845   431 raft_consensus.cc:2272] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.236272   431 tablet_replica.cc:333] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.236781   431 raft_consensus.cc:2243] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.237138   431 raft_consensus.cc:2272] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.238977   431 tablet_replica.cc:333] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.239518   431 raft_consensus.cc:2243] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.239919   431 raft_consensus.cc:2272] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.242372   431 tablet_replica.cc:333] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.242949   431 raft_consensus.cc:2243] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:55.243356   431 raft_consensus.cc:2272] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:55.245718   431 tablet_replica.cc:333] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: stopping tablet replica
I20260709 13:03:55.246237   431 raft_consensus.cc:2243] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:55.246870   431 pending_rounds.cc:70] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Trying to abort 1 pending ops.
I20260709 13:03:55.247081   431 pending_rounds.cc:77] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634753599131648 op_type: NO_OP noop_request { }
I20260709 13:03:55.247373   431 raft_consensus.cc:2889] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:55.247661   431 raft_consensus.cc:2272] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:55.260761  9339 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 125 similar messages]
W20260709 13:03:55.264889  9339 consensus_peers.cc:597] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.273463   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:55.304912  9339 consensus_peers.cc:597] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.324661  9448 consensus_queue.cc:1048] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:55.326574  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:55.337859  9339 consensus_peers.cc:597] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.362313  9265 consensus_peers.cc:597] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.475571  9265 consensus_peers.cc:597] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.496048  9265 consensus_peers.cc:597] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:55.511907  9448 consensus_queue.cc:1048] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:55.512270  9339 consensus_peers.cc:597] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:55.524993  9339 consensus_peers.cc:597] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:56.327778  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:03:56.613034  9449 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32fbfed0f7424a3583a6b695c84ed8af)
I20260709 13:03:56.613651  9449 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.615803  9449 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:56.617268  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:56.617980  9376 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 1.
I20260709 13:03:56.619158  9265 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
W20260709 13:03:56.619849  9265 leader_election.cc:336] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111)
I20260709 13:03:56.619870  9449 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:56.620342  9449 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32fbfed0f7424a3583a6b695c84ed8af)
I20260709 13:03:56.620673  9449 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:56.626061  9449 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.627709  9449 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:56.629361  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:56.630024  9376 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:56.631961  9265 leader_election.cc:336] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111)
I20260709 13:03:56.636294  9376 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:03:56.637427  9265 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 32fbfed0f7424a3583a6b695c84ed8af
I20260709 13:03:56.638200  9449 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:56.639163  9449 raft_consensus.cc:697] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:03:56.640157  9449 consensus_queue.cc:237] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.647101  9125 catalog_manager.cc:5697] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 1 to 2, leader changed from 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.766113  9449 raft_consensus.cc:493] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.766654  9449 raft_consensus.cc:515] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.768455  9449 leader_election.cc:290] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:56.769809  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070" is_pre_election: true
I20260709 13:03:56.770483  9376 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 1.
W20260709 13:03:56.772248  9265 leader_election.cc:336] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111)
I20260709 13:03:56.772959  9265 leader_election.cc:304] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 32fbfed0f7424a3583a6b695c84ed8af
I20260709 13:03:56.773598  9449 raft_consensus.cc:2804] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:56.773949  9449 raft_consensus.cc:493] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.774293  9449 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:56.779875  9449 raft_consensus.cc:515] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.781806  9449 leader_election.cc:290] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:03:56.783910  9376 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:03:56.784538  9376 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:56.785686  9265 leader_election.cc:336] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111)
I20260709 13:03:56.789631  9376 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:03:56.790683  9265 leader_election.cc:304] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 32fbfed0f7424a3583a6b695c84ed8af
I20260709 13:03:56.791327  9449 raft_consensus.cc:2804] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:56.791726  9449 raft_consensus.cc:697] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:03:56.792593  9449 consensus_queue.cc:237] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:03:56.799240  9125 catalog_manager.cc:5697] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 1 to 2, leader changed from 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:57.116478  9376 raft_consensus.cc:1275] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.117779  9449 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:57.123617  9265 consensus_peers.cc:597] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:57.183736  9265 consensus_peers.cc:597] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:57.293964  9376 raft_consensus.cc:1275] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:57.295374  9449 consensus_queue.cc:1048] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:57.328732  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:57.586558  9339 consensus_peers.cc:597] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.801203  9339 consensus_peers.cc:597] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.804948  9339 consensus_peers.cc:597] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.912519  9339 consensus_peers.cc:597] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.952860  9265 consensus_peers.cc:597] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:57.953327  9265 consensus_peers.cc:597] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.009945  9265 consensus_peers.cc:597] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.075431  9339 consensus_peers.cc:597] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:58.329896  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:59.324929  9323 debug-util.cc:398] Leaking SignalData structure 0x7b08003edce0 after lost signal to thread 434
W20260709 13:03:59.326515  9323 debug-util.cc:398] Leaking SignalData structure 0x7b080003b960 after lost signal to thread 9159
W20260709 13:03:59.328291  9323 debug-util.cc:398] Leaking SignalData structure 0x7b080026c9a0 after lost signal to thread 9326
W20260709 13:03:59.352273  9323 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3720 after lost signal to thread 9400
W20260709 13:03:59.619472  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:03:59.645555  9339 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33513, user_credentials={real_user=slave}} blocked reactor thread for 279649us
W20260709 13:04:00.078723  9265 consensus_peers.cc:597] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.088186  9265 consensus_peers.cc:597] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:00.273051  9339 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111) [suppressed 89 similar messages]
W20260709 13:04:00.355754  9397 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2b20 after lost signal to thread 434
W20260709 13:04:00.357030  9397 debug-util.cc:398] Leaking SignalData structure 0x7b08002f01c0 after lost signal to thread 9159
W20260709 13:04:00.358491  9397 debug-util.cc:398] Leaking SignalData structure 0x7b0800224ea0 after lost signal to thread 9326
W20260709 13:04:00.359879  9397 debug-util.cc:398] Leaking SignalData structure 0x7b08002b36c0 after lost signal to thread 9400
W20260709 13:04:00.413102  9339 consensus_peers.cc:597] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:00.620649  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:04:00.841504  9265 consensus_peers.cc:597] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:00.859220  9265 consensus_peers.cc:597] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:00.874992   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:00.878069  9339 consensus_peers.cc:597] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:00.885747  9532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.886191  9533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:00.897482  9536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:00.898937   431 server_base.cc:1061] running on GCE node
I20260709 13:04:00.900485   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:00.900851   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:00.901088   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602240901072 us; error 0 us; skew 500 ppm
I20260709 13:04:00.901873   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:00.905655   431 webserver.cc:533] Webserver started at http://127.0.107.193:44149/ using document root <none> and password file <none>
I20260709 13:04:00.906363   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:00.906646   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:00.912386   431 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:00.918063  9540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:00.919158   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:00.919958   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "32fbfed0f7424a3583a6b695c84ed8af"
format_stamp: "Formatted at 2026-07-09 13:03:53 on dist-test-slave-n5kz"
I20260709 13:04:00.920548   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:04:00.944669  9265 consensus_peers.cc:597] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:00.954356   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:00.956574   431 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:04:00.961165  9339 consensus_peers.cc:597] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:00.962374   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:00.968142  9547 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:04:00.980841  9339 consensus_peers.cc:597] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:01.062381   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:04:01.062940   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.096s	user 0.003s	sys 0.000s
I20260709 13:04:01.063370   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:04:01.073625  9547 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.131834  9547 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.132961  9547 tablet_bootstrap.cc:492] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.133687  9547 ts_tablet_manager.cc:1403] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.016s
I20260709 13:04:01.136844  9547 raft_consensus.cc:359] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.137691  9547 raft_consensus.cc:740] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.138551  9547 consensus_queue.cc:260] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.157099   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:04:01.158461   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.095s	user 0.085s	sys 0.003s
I20260709 13:04:01.159272  9547 ts_tablet_manager.cc:1434] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.009s
I20260709 13:04:01.160388  9547 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.193554  9547 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.199222  9547 tablet_bootstrap.cc:492] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.200062  9547 ts_tablet_manager.cc:1403] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.015s
I20260709 13:04:01.203320  9547 raft_consensus.cc:359] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.204279  9547 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.205323  9547 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.207721  9547 ts_tablet_manager.cc:1434] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.208792  9547 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.244350  9547 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:04:01.246505  9547 tablet_bootstrap.cc:492] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.247589  9547 ts_tablet_manager.cc:1403] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.011s
I20260709 13:04:01.251433  9547 raft_consensus.cc:359] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.252782  9547 raft_consensus.cc:740] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.253998  9547 consensus_queue.cc:260] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.256935  9547 ts_tablet_manager.cc:1434] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:01.258077  9547 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.284691  9547 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.285916  9547 tablet_bootstrap.cc:492] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.286774  9547 ts_tablet_manager.cc:1403] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.029s	user 0.027s	sys 0.000s
I20260709 13:04:01.290271  9547 raft_consensus.cc:359] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.291258  9547 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.292451  9547 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.295176  9547 ts_tablet_manager.cc:1434] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:01.296311  9547 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.319567  9547 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.320796  9547 tablet_bootstrap.cc:492] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.321734  9547 ts_tablet_manager.cc:1403] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.026s	user 0.022s	sys 0.001s
I20260709 13:04:01.325176  9547 raft_consensus.cc:359] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.325932  9547 raft_consensus.cc:740] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.326800  9547 consensus_queue.cc:260] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.328948  9547 ts_tablet_manager.cc:1434] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:01.330049  9547 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
W20260709 13:04:01.337426  9339 consensus_peers.cc:597] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:01.359772  9547 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.360965  9547 tablet_bootstrap.cc:492] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.361737  9547 ts_tablet_manager.cc:1403] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 13:04:01.364768  9547 raft_consensus.cc:359] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.365585  9547 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.366483  9547 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.368901  9547 ts_tablet_manager.cc:1434] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.369783  9547 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.388592  9547 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.389603  9547 tablet_bootstrap.cc:492] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.390385  9547 ts_tablet_manager.cc:1403] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:04:01.393219  9547 raft_consensus.cc:359] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:01.394742  9547 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.395695  9547 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:01.398079  9547 ts_tablet_manager.cc:1434] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.398985  9547 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.415980  9547 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.417059  9547 tablet_bootstrap.cc:492] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.417785  9547 ts_tablet_manager.cc:1403] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:04:01.420529  9547 raft_consensus.cc:359] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.421337  9547 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.422983  9547 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.425537  9547 ts_tablet_manager.cc:1434] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:01.426462  9547 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.447484  9547 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.448463  9547 tablet_bootstrap.cc:492] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.449241  9547 ts_tablet_manager.cc:1403] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 13:04:01.452100  9547 raft_consensus.cc:359] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.452972  9547 raft_consensus.cc:740] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.453874  9547 consensus_queue.cc:260] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.456380  9547 ts_tablet_manager.cc:1434] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:01.457279  9547 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap starting.
I20260709 13:04:01.480079  9547 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:01.481228  9547 tablet_bootstrap.cc:492] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Bootstrap complete.
I20260709 13:04:01.482040  9547 ts_tablet_manager.cc:1403] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:04:01.484840  9547 raft_consensus.cc:359] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.485668  9547 raft_consensus.cc:740] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32fbfed0f7424a3583a6b695c84ed8af, State: Initialized, Role: FOLLOWER
I20260709 13:04:01.486438  9547 consensus_queue.cc:260] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.489058  9547 ts_tablet_manager.cc:1434] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:04:01.534475   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33513
I20260709 13:04:01.534593  9615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33513 every 8 connection(s)
I20260709 13:04:01.604427   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:01.621781  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:01.637310  9616 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39571
I20260709 13:04:01.637840  9616 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:01.639084  9616 heartbeater.cc:507] Master 127.0.107.254:39571 requested a full tablet report, sending...
I20260709 13:04:01.642462  9590 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.652136  9590 pending_rounds.cc:85] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Aborting all ops after (but not including) 0
I20260709 13:04:01.652498  9590 pending_rounds.cc:107] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:01.652861  9590 raft_consensus.cc:2889] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.674861  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05dce303327849fbae896dcfc8279679"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:01.675516  9373 raft_consensus.cc:606] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:01.678746  9125 ts_manager.cc:194] Re-registered known tserver with Master: 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:04:01.692376  9125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48604
I20260709 13:04:01.696615  9616 heartbeater.cc:499] Master 127.0.107.254:39571 was elected leader, sending a full tablet report...
I20260709 13:04:01.707384  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:01.708120  9301 raft_consensus.cc:606] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:01.713928  9302 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:01.714567  9302 raft_consensus.cc:606] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:01.716212   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:01.717056   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:01.720834  9520 raft_consensus.cc:993] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:01.721472  9520 raft_consensus.cc:1081] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:01.717855   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:01.726984  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05dce303327849fbae896dcfc8279679"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:01.727743  9301 raft_consensus.cc:493] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:01.728190  9301 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.737100  9301 raft_consensus.cc:515] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.741714  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:01.742445  9591 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.744869  9301 leader_election.cc:290] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:01.746076  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05dce303327849fbae896dcfc8279679" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:01.746806  9373 raft_consensus.cc:3055] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:01.747164  9373 raft_consensus.cc:740] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:01.748100  9373 consensus_queue.cc:260] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.749542  9373 raft_consensus.cc:3060] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.753348  9591 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:01.757982  9265 leader_election.cc:304] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:01.759008  9523 raft_consensus.cc:2804] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.764494  9373 raft_consensus.cc:2468] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:01.766636  9523 raft_consensus.cc:697] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:01.767869  9523 consensus_queue.cc:237] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:01.778160  9123 catalog_manager.cc:5697] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 1 to 2, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.780907  9523 raft_consensus.cc:993] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:01.781541  9628 raft_consensus.cc:1081] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:01.783468  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:01.784055  9373 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:01.784408  9373 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.797245  9373 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:01.800359  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:01.801009  9301 raft_consensus.cc:3055] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:01.801245  9373 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Requested vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:04:01.801376  9301 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:01.802524  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:01.802327  9301 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:01.803247  9591 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.803797  9301 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:01.811216  9591 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:01.811398  9301 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:01.812593  9339 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:01.813503  9572 raft_consensus.cc:2804] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:01.814008  9572 raft_consensus.cc:697] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:01.814883  9572 consensus_queue.cc:237] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:01.828521  9125 catalog_manager.cc:5697] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 1 to 2, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.009524  9591 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.042965  9628 raft_consensus.cc:993] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:02.043551  9523 raft_consensus.cc:1081] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:02.051389  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:02.052199  9373 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.052675  9373 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.062271  9373 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.065515  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:02.065732  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:02.066437  9591 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.066501  9301 raft_consensus.cc:3055] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:02.067019  9301 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:02.067873  9301 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.069042  9301 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.074764  9591 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:02.075349  9373 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:02.076237  9339 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:02.077498  9637 raft_consensus.cc:2804] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:02.078006  9637 raft_consensus.cc:697] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:02.079653  9301 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:02.079566  9637 consensus_queue.cc:237] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.089131  9125 catalog_manager.cc:5697] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 1 to 2, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.211613  9590 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.213485  9520 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:02.234004  9301 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.236007  9637 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:02.391250  9590 raft_consensus.cc:1275] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.392539  9373 raft_consensus.cc:1275] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.393041  9628 consensus_queue.cc:1048] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:02.397460  9628 consensus_queue.cc:1048] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:02.496387  9590 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.500909  9572 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:02.531898  9301 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:02.533836  9637 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:02.623195  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:02.733754   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:02.745532  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:02.746250  9373 raft_consensus.cc:606] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:02.749490  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77a0f360431645079234b361b4eb11ac"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:02.750272  9373 raft_consensus.cc:606] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:02.756817  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:02.757596  9301 raft_consensus.cc:606] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:02.760818   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:02.761600   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:02.762454   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:02.817828  9628 raft_consensus.cc:993] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:02.818504  9523 raft_consensus.cc:1081] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:02.820544  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:02.821236  9373 raft_consensus.cc:493] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.821691  9373 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:02.830953  9373 raft_consensus.cc:515] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.834205  9373 leader_election.cc:290] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:02.835414  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:02.836133  9301 raft_consensus.cc:3055] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:02.836472  9301 raft_consensus.cc:740] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:02.837306  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a152c8f1bff8424b8c94cd98c7468b15" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:02.838104  9590 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:02.837358  9301 consensus_queue.cc:260] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.840045  9301 raft_consensus.cc:3060] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:02.848492  9301 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:02.848587  9590 raft_consensus.cc:2468] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:02.850310  9342 leader_election.cc:304] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:02.851410  9520 raft_consensus.cc:2804] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:02.851965  9520 raft_consensus.cc:697] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:02.852985  9520 consensus_queue.cc:237] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.867971  9124 catalog_manager.cc:5697] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 2 to 3, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.926820  9572 raft_consensus.cc:993] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:02.927450  9520 raft_consensus.cc:1081] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:02.929567  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77a0f360431645079234b361b4eb11ac"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:02.930253  9301 raft_consensus.cc:493] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.930683  9301 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.938285  9301 raft_consensus.cc:515] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.940260  9301 leader_election.cc:290] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:02.941725  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:02.942510  9590 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.947031  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a0f360431645079234b361b4eb11ac" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:02.947751  9373 raft_consensus.cc:3055] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:02.948093  9373 raft_consensus.cc:740] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:02.949040  9373 consensus_queue.cc:260] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.950500  9373 raft_consensus.cc:3060] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:02.953896  9590 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:02.955523  9265 leader_election.cc:304] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:02.956808  9523 raft_consensus.cc:2804] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:02.957412  9523 raft_consensus.cc:697] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:02.959558  9523 consensus_queue.cc:237] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:02.960121  9373 raft_consensus.cc:2468] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:02.972788  9124 catalog_manager.cc:5697] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 1 to 2, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.140218  9637 raft_consensus.cc:993] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:03.141400  9520 raft_consensus.cc:1081] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:03.145744  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:03.147001  9301 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.147728  9301 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.161377  9301 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.163313  9301 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:03.164319  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:03.164891  9590 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.165064  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:03.165756  9373 raft_consensus.cc:3055] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:03.166101  9373 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:03.167023  9373 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.168403  9373 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.170341  9590 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:03.171471  9265 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:03.172128  9628 raft_consensus.cc:2804] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:03.172586  9628 raft_consensus.cc:697] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:03.173388  9628 consensus_queue.cc:237] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.176347  9373 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:03.180783  9124 catalog_manager.cc:5697] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 2 to 3, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.266695  9590 raft_consensus.cc:1275] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:03.267942  9637 consensus_queue.cc:1048] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.282919  9301 raft_consensus.cc:1275] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:03.285337  9520 consensus_queue.cc:1048] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.396051  9373 raft_consensus.cc:1275] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.397361  9628 consensus_queue.cc:1048] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.406538  9590 raft_consensus.cc:1275] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:03.408450  9628 consensus_queue.cc:1048] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:03.575783  9373 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:03.577178  9523 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:03.588712  9590 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:03.593387  9523 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:03.624318  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:03.773295   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.780632  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:03.781138  9301 raft_consensus.cc:606] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:03.783907  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb6bc6265884acda3807e353978d652"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:03.784350  9301 raft_consensus.cc:606] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:03.786571  9373 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:03.787096  9373 raft_consensus.cc:606] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:03.788260   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:03.788795   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:03.789346   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.908546  9628 raft_consensus.cc:993] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:03.909116  9523 raft_consensus.cc:1081] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:03.910763  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb6bc6265884acda3807e353978d652"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:03.911378  9373 raft_consensus.cc:493] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.911758  9373 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.919780  9373 raft_consensus.cc:515] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.922101  9373 leader_election.cc:290] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:03.922839  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:03.923230  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:03.923568  9591 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.923986  9301 raft_consensus.cc:3055] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.924355  9301 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:03.925225  9301 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.926471  9301 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.931208  9591 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:03.932533  9339 leader_election.cc:304] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:03.933367  9520 raft_consensus.cc:2804] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.933665  9301 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 2.
I20260709 13:04:03.933916  9520 raft_consensus.cc:697] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:03.935112  9520 consensus_queue.cc:237] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.943179  9123 catalog_manager.cc:5697] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 1 to 2, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.960304  9572 raft_consensus.cc:993] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:03.960793  9520 raft_consensus.cc:1081] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:03.962267  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:03.962854  9301 raft_consensus.cc:493] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.963203  9301 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.970476  9301 raft_consensus.cc:515] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.972513  9301 leader_election.cc:290] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:03.973780  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:03.974138  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:03.974478  9591 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.974784  9373 raft_consensus.cc:3055] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:03.977877  9373 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:03.978854  9628 raft_consensus.cc:993] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:03.978940  9373 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.979584  9523 raft_consensus.cc:1081] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:03.980453  9373 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:03.983017  9372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:03.983129  9591 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:03.983814  9372 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:03.984321  9372 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.984687  9265 leader_election.cc:304] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:03.985700  9523 raft_consensus.cc:2804] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:03.986402  9523 raft_consensus.cc:697] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:03.987762  9373 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 2.
I20260709 13:04:03.987464  9523 consensus_queue.cc:237] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.993322  9372 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.996233  9591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:03.996510  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:03.996948  9591 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.997092  9301 raft_consensus.cc:3055] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:03.996708  9123 catalog_manager.cc:5697] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 1 to 2, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:03.997452  9372 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:03.997481  9301 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:03.998670  9301 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:03.999668  9301 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.006479  9301 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:04.008025  9591 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:04.008358  9342 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:04.009400  9520 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:04.009928  9520 raft_consensus.cc:697] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:04.010775  9520 consensus_queue.cc:237] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:04.019165  9123 catalog_manager.cc:5697] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 2 to 3, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:04.367813  9301 raft_consensus.cc:1275] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.369275  9520 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.373689  9591 raft_consensus.cc:1275] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.376855  9523 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.383908  9590 raft_consensus.cc:1275] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.386974  9520 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.421674  9372 raft_consensus.cc:1275] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:04.423207  9628 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:04.515929  9301 raft_consensus.cc:1275] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:04.517392  9572 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:04.529832  9591 raft_consensus.cc:1275] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:04.531286  9682 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:04.625208  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:04.796929   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:04.807400  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:04.808218  9301 raft_consensus.cc:606] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:04.812752  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cb6bc6265884acda3807e353978d652"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:04.813417  9372 raft_consensus.cc:606] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:04.816207  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:04.816704  9372 raft_consensus.cc:606] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:04.817800   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:04.818354   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:04.819162   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:04.825559  9520 raft_consensus.cc:993] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:04.826244  9682 raft_consensus.cc:1081] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:04.828086  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:04.828584  9301 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.828920  9301 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.840147  9301 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:04.841833  9301 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Requested vote from peers 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:04:04.842932  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:04.843385  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:04.843698  9372 raft_consensus.cc:3055] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:04.844075  9372 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:04.844081  9590 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.845340  9372 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:04.846905  9372 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.851260  9590 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:04.852862  9265 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:04.853842  9628 raft_consensus.cc:2804] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:04.854318  9372 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:04.854327  9628 raft_consensus.cc:697] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:04.856017  9628 consensus_queue.cc:237] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:04.868363  9124 catalog_manager.cc:5697] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 2 to 3, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:04.967494  9662 raft_consensus.cc:993] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:04.967963  9628 raft_consensus.cc:1081] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:04.969434  9372 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:04.969868  9372 raft_consensus.cc:493] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:04.970125  9372 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.975359  9372 raft_consensus.cc:515] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:04.977260  9372 leader_election.cc:290] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 4 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:04.978158  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:04.978410  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "571bfc946ec34c5499313ff18d4f6582" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:04.978965  9590 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.978973  9301 raft_consensus.cc:3055] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:04.979562  9301 raft_consensus.cc:740] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:04.980774  9301 consensus_queue.cc:260] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:04.982462  9301 raft_consensus.cc:3060] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.986856  9590 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 4.
I20260709 13:04:04.988219  9339 leader_election.cc:304] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:04.989168  9682 raft_consensus.cc:2804] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:04.989715  9682 raft_consensus.cc:697] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 4 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:04.991010  9301 raft_consensus.cc:2468] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 4.
I20260709 13:04:04.990942  9682 consensus_queue.cc:237] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:04.999251  9124 catalog_manager.cc:5697] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 3 to 4, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.245702  9520 raft_consensus.cc:993] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:05.246129  9682 raft_consensus.cc:1081] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:05.247740  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cb6bc6265884acda3807e353978d652"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:05.248211  9301 raft_consensus.cc:493] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:05.248483  9301 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:05.254556  9301 raft_consensus.cc:515] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:05.256326  9301 leader_election.cc:290] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:05.257248  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:05.257396  9372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cb6bc6265884acda3807e353978d652" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:05.257911  9590 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:05.258026  9372 raft_consensus.cc:3055] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:05.258442  9372 raft_consensus.cc:740] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:05.259290  9372 consensus_queue.cc:260] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:05.260439  9372 raft_consensus.cc:3060] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:05.263727  9590 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:05.265020  9265 leader_election.cc:304] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:05.265918  9690 raft_consensus.cc:2804] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:05.266403  9372 raft_consensus.cc:2468] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 3.
I20260709 13:04:05.266412  9690 raft_consensus.cc:697] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:05.267652  9690 consensus_queue.cc:237] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:05.275576  9124 catalog_manager.cc:5697] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 2 to 3, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.313972  9590 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.315397  9690 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:05.328752  9372 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.330497  9690 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:05.373883  9301 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:05.375082  9682 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:05.387523  9590 raft_consensus.cc:1275] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:05.389647  9572 consensus_queue.cc:1048] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:05.626351  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:05.826713  9590 raft_consensus.cc:1275] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.827878   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:05.828075  9690 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:05.839520  9372 raft_consensus.cc:1275] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:05.841015  9628 consensus_queue.cc:1048] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:05.842355  9372 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
mode: GRACEFUL
new_leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:54436
I20260709 13:04:05.843086  9372 raft_consensus.cc:606] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Received request to transfer leadership to TS d6e3a3c7671d451084d8d55da4236d2d
I20260709 13:04:05.846248  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:05.847018  9301 raft_consensus.cc:606] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:05.850502  9301 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
mode: GRACEFUL
new_leader_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43436
I20260709 13:04:05.851032  9301 raft_consensus.cc:606] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Received request to transfer leadership to TS 06e457ac2f704b48a600354fdbadc070
I20260709 13:04:05.852284   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:05.852797   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:05.853439   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.015611  9628 raft_consensus.cc:993] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:06.016091  9662 raft_consensus.cc:1081] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:06.017692  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:06.018179  9373 raft_consensus.cc:493] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.018493  9373 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.024859  9373 raft_consensus.cc:515] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.026408  9373 leader_election.cc:290] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731)
I20260709 13:04:06.027380  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:06.027581  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85bbc801ea44f0090613a7e259dcefc" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:06.028029  9590 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.028128  9301 raft_consensus.cc:3055] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:06.028553  9301 raft_consensus.cc:740] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:06.029232  9301 consensus_queue.cc:260] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.030284  9301 raft_consensus.cc:3060] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.033281  9590 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:06.034476  9339 leader_election.cc:304] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:06.035274  9698 raft_consensus.cc:2804] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:06.035308  9301 raft_consensus.cc:2468] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 3.
I20260709 13:04:06.035854  9698 raft_consensus.cc:697] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:06.036832  9698 consensus_queue.cc:237] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.043960  9124 catalog_manager.cc:5697] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 2 to 3, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.091610  9572 raft_consensus.cc:993] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: : Instructing follower d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:06.092154  9698 raft_consensus.cc:1081] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Signalling peer d6e3a3c7671d451084d8d55da4236d2d to start an election
I20260709 13:04:06.093698  9301 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983"
dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
 from {username='slave'} at 127.0.0.1:57572
I20260709 13:04:06.094135  9301 raft_consensus.cc:493] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.094360  9301 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.098981  9301 raft_consensus.cc:515] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.100329  9301 leader_election.cc:290] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 4 election: Requested vote from peers 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513), 06e457ac2f704b48a600354fdbadc070 (127.0.107.195:37315)
I20260709 13:04:06.101272  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:06.101423  9373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f9e8fa161544fd6a552836678e47983" candidate_uuid: "d6e3a3c7671d451084d8d55da4236d2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "06e457ac2f704b48a600354fdbadc070"
I20260709 13:04:06.101868  9590 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.101989  9373 raft_consensus.cc:3055] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:06.102403  9373 raft_consensus.cc:740] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:06.103164  9373 consensus_queue.cc:260] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.104172  9373 raft_consensus.cc:3060] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.106938  9590 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 4.
I20260709 13:04:06.108244  9265 leader_election.cc:304] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32fbfed0f7424a3583a6b695c84ed8af, d6e3a3c7671d451084d8d55da4236d2d; no voters: 
I20260709 13:04:06.109027  9662 raft_consensus.cc:2804] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:06.109520  9662 raft_consensus.cc:697] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 4 LEADER]: Becoming Leader. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:06.110406  9373 raft_consensus.cc:2468] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6e3a3c7671d451084d8d55da4236d2d in term 4.
I20260709 13:04:06.110562  9662 consensus_queue.cc:237] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } }
I20260709 13:04:06.118988  9124 catalog_manager.cc:5697] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d reported cstate change: term changed from 3 to 4, leader changed from 06e457ac2f704b48a600354fdbadc070 (127.0.107.195) to d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194). New cstate: current_term: 4 leader_uuid: "d6e3a3c7671d451084d8d55da4236d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.213738  9628 raft_consensus.cc:993] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: : Instructing follower 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:06.214241  9662 raft_consensus.cc:1081] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Signalling peer 06e457ac2f704b48a600354fdbadc070 to start an election
I20260709 13:04:06.215847  9373 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b"
dest_uuid: "06e457ac2f704b48a600354fdbadc070"
 from {username='slave'} at 127.0.0.1:43534
I20260709 13:04:06.216349  9373 raft_consensus.cc:493] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:06.216640  9373 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.221662  9373 raft_consensus.cc:515] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:06.223133  9373 leader_election.cc:290] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 4 election: Requested vote from peers d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731), 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513)
I20260709 13:04:06.224632  9301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d6e3a3c7671d451084d8d55da4236d2d"
I20260709 13:04:06.224575  9590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3a25c72353b4dfcbf595d999bc57b5b" candidate_uuid: "06e457ac2f704b48a600354fdbadc070" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32fbfed0f7424a3583a6b695c84ed8af"
I20260709 13:04:06.225543  9301 raft_consensus.cc:3055] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:06.225594  9590 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.226087  9301 raft_consensus.cc:740] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d6e3a3c7671d451084d8d55da4236d2d, State: Running, Role: LEADER
I20260709 13:04:06.227002  9301 consensus_queue.cc:260] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:06.228368  9301 raft_consensus.cc:3060] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.233425  9590 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 4.
I20260709 13:04:06.234828  9339 leader_election.cc:304] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06e457ac2f704b48a600354fdbadc070, 32fbfed0f7424a3583a6b695c84ed8af; no voters: 
I20260709 13:04:06.235641  9698 raft_consensus.cc:2804] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:06.236191  9698 raft_consensus.cc:697] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 4 LEADER]: Becoming Leader. State: Replica: 06e457ac2f704b48a600354fdbadc070, State: Running, Role: LEADER
I20260709 13:04:06.236255  9301 raft_consensus.cc:2468] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06e457ac2f704b48a600354fdbadc070 in term 4.
I20260709 13:04:06.237512  9698 consensus_queue.cc:237] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } }
I20260709 13:04:06.244251  9124 catalog_manager.cc:5697] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 reported cstate change: term changed from 3 to 4, leader changed from d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194) to 06e457ac2f704b48a600354fdbadc070 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "06e457ac2f704b48a600354fdbadc070" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.454118  9590 raft_consensus.cc:1275] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:06.455649  9698 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:06.469110  9301 raft_consensus.cc:1275] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:06.470561  9572 consensus_queue.cc:1048] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:06.627563  9173 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:06.661445  9590 raft_consensus.cc:1275] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:06.662954  9662 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:06.672947  9373 raft_consensus.cc:1275] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Refusing update from remote peer d6e3a3c7671d451084d8d55da4236d2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:06.675567  9662 consensus_queue.cc:1048] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "06e457ac2f704b48a600354fdbadc070" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:06.818693  9301 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:06.820612  9710 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6e3a3c7671d451084d8d55da4236d2d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:06.822845  9590 raft_consensus.cc:1275] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Refusing update from remote peer 06e457ac2f704b48a600354fdbadc070: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:06.824020  9710 consensus_queue.cc:1048] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32fbfed0f7424a3583a6b695c84ed8af" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:06.863804   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:06.892961   431 tablet_server.cc:179] TabletServer@127.0.107.193:33513 shutting down...
W20260709 13:04:06.909085  9339 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 24 similar messages]
W20260709 13:04:06.912925  9339 consensus_peers.cc:597] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.919157   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:06.920153   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.921254   431 raft_consensus.cc:2243] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.921780   431 raft_consensus.cc:2272] T 05dce303327849fbae896dcfc8279679 P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.924544   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.925199   431 raft_consensus.cc:2243] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.925652   431 raft_consensus.cc:2272] T 6cb6bc6265884acda3807e353978d652 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.928217   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.928964   431 raft_consensus.cc:2243] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.929551   431 raft_consensus.cc:2272] T b3a25c72353b4dfcbf595d999bc57b5b P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:06.932987  9339 consensus_peers.cc:597] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:06.933310   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.934047   431 raft_consensus.cc:2243] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.934562   431 raft_consensus.cc:2272] T 5f9e8fa161544fd6a552836678e47983 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.937484   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.938081   431 raft_consensus.cc:2243] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.938584   431 raft_consensus.cc:2272] T 77a0f360431645079234b361b4eb11ac P 32fbfed0f7424a3583a6b695c84ed8af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.940984   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.941556   431 raft_consensus.cc:2243] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.942051   431 raft_consensus.cc:2272] T 9af7af18014248138af4416ac4433f09 P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.944837   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.945415   431 raft_consensus.cc:2243] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.945881   431 raft_consensus.cc:2272] T ea297deccd4442e19cf30dd74f709bed P 32fbfed0f7424a3583a6b695c84ed8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.948192   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.948693   431 raft_consensus.cc:2243] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.949132   431 raft_consensus.cc:2272] T b85bbc801ea44f0090613a7e259dcefc P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.951797   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.952364   431 raft_consensus.cc:2243] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.952823   431 raft_consensus.cc:2272] T 571bfc946ec34c5499313ff18d4f6582 P 32fbfed0f7424a3583a6b695c84ed8af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.954872   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:06.955358   431 raft_consensus.cc:2243] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:06.955832   431 raft_consensus.cc:2272] T a152c8f1bff8424b8c94cd98c7468b15 P 32fbfed0f7424a3583a6b695c84ed8af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:06.987875   431 tablet_server.cc:196] TabletServer@127.0.107.193:33513 shutdown complete.
I20260709 13:04:07.016412   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:07.041628   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:07.042400   431 tablet_replica.cc:333] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.043125   431 raft_consensus.cc:2243] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.043673   431 raft_consensus.cc:2272] T a152c8f1bff8424b8c94cd98c7468b15 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.045957   431 tablet_replica.cc:333] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.046551   431 raft_consensus.cc:2243] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.047385   431 raft_consensus.cc:2272] T 5f9e8fa161544fd6a552836678e47983 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.051065   431 tablet_replica.cc:333] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.051894   431 raft_consensus.cc:2243] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.052433   431 raft_consensus.cc:2272] T b3a25c72353b4dfcbf595d999bc57b5b P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.053113  9342 consensus_peers.cc:597] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 -> Peer d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731): Couldn't send request to peer d6e3a3c7671d451084d8d55da4236d2d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.056674   431 tablet_replica.cc:333] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.057431   431 raft_consensus.cc:2243] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.057984   431 raft_consensus.cc:2272] T 9af7af18014248138af4416ac4433f09 P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.060468   431 tablet_replica.cc:333] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.061081   431 raft_consensus.cc:2243] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.062008   431 raft_consensus.cc:2272] T 77a0f360431645079234b361b4eb11ac P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.064213   431 tablet_replica.cc:333] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.064774   431 raft_consensus.cc:2243] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.065227   431 raft_consensus.cc:2272] T ea297deccd4442e19cf30dd74f709bed P d6e3a3c7671d451084d8d55da4236d2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.067560   431 tablet_replica.cc:333] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.068099   431 raft_consensus.cc:2243] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.068501   431 raft_consensus.cc:2272] T b85bbc801ea44f0090613a7e259dcefc P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.071000   431 tablet_replica.cc:333] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.071558   431 raft_consensus.cc:2243] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.071977   431 raft_consensus.cc:2272] T 571bfc946ec34c5499313ff18d4f6582 P d6e3a3c7671d451084d8d55da4236d2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.074709   431 tablet_replica.cc:333] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.075218   431 raft_consensus.cc:2243] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.076181   431 raft_consensus.cc:2272] T 05dce303327849fbae896dcfc8279679 P d6e3a3c7671d451084d8d55da4236d2d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:07.076388  9342 consensus_peers.cc:597] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 -> Peer d6e3a3c7671d451084d8d55da4236d2d (127.0.107.194:35731): Couldn't send request to peer d6e3a3c7671d451084d8d55da4236d2d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.078491   431 tablet_replica.cc:333] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d: stopping tablet replica
I20260709 13:04:07.079116   431 raft_consensus.cc:2243] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.079784   431 raft_consensus.cc:2272] T 6cb6bc6265884acda3807e353978d652 P d6e3a3c7671d451084d8d55da4236d2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.127190   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:07.152177   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:07.156164  9339 consensus_peers.cc:597] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 -> Peer 32fbfed0f7424a3583a6b695c84ed8af (127.0.107.193:33513): Couldn't send request to peer 32fbfed0f7424a3583a6b695c84ed8af. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:07.184970   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:07.185734   431 tablet_replica.cc:333] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.186420   431 raft_consensus.cc:2243] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.187251   431 raft_consensus.cc:2272] T b3a25c72353b4dfcbf595d999bc57b5b P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.189755   431 tablet_replica.cc:333] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.190274   431 raft_consensus.cc:2243] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.190702   431 raft_consensus.cc:2272] T 5f9e8fa161544fd6a552836678e47983 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.193627   431 tablet_replica.cc:333] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.194130   431 raft_consensus.cc:2243] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.195017   431 raft_consensus.cc:2272] T ea297deccd4442e19cf30dd74f709bed P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.197068   431 tablet_replica.cc:333] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.197584   431 raft_consensus.cc:2243] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.198274   431 raft_consensus.cc:2272] T 571bfc946ec34c5499313ff18d4f6582 P 06e457ac2f704b48a600354fdbadc070 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.200304   431 tablet_replica.cc:333] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.200826   431 raft_consensus.cc:2243] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.201579   431 raft_consensus.cc:2272] T b85bbc801ea44f0090613a7e259dcefc P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.204602   431 tablet_replica.cc:333] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.205228   431 raft_consensus.cc:2243] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.206068   431 raft_consensus.cc:2272] T a152c8f1bff8424b8c94cd98c7468b15 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.208389   431 tablet_replica.cc:333] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.208916   431 raft_consensus.cc:2243] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.209854   431 raft_consensus.cc:2272] T 9af7af18014248138af4416ac4433f09 P 06e457ac2f704b48a600354fdbadc070 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.212110   431 tablet_replica.cc:333] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.212706   431 raft_consensus.cc:2243] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.213289   431 raft_consensus.cc:2272] T 77a0f360431645079234b361b4eb11ac P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.215660   431 tablet_replica.cc:333] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.216214   431 raft_consensus.cc:2243] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.216660   431 raft_consensus.cc:2272] T 6cb6bc6265884acda3807e353978d652 P 06e457ac2f704b48a600354fdbadc070 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.218947   431 tablet_replica.cc:333] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070: stopping tablet replica
I20260709 13:04:07.219494   431 raft_consensus.cc:2243] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:07.220032   431 raft_consensus.cc:2272] T 05dce303327849fbae896dcfc8279679 P 06e457ac2f704b48a600354fdbadc070 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.271268   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:07.296229   431 master.cc:562] Master@127.0.107.254:39571 shutting down...
I20260709 13:04:07.319850   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:07.320376   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:07.320657   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 171f2dc59e294ba7b87c15c10077f376: stopping tablet replica
I20260709 13:04:07.341013   431 master.cc:584] Master@127.0.107.254:39571 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14245 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:04:07.386694   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37125
I20260709 13:04:07.387822   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:07.393687  9724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.393682  9723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.394244  9726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.395062   431 server_base.cc:1061] running on GCE node
I20260709 13:04:07.396152   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:07.396382   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:07.396498   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602247396487 us; error 0 us; skew 500 ppm
I20260709 13:04:07.396977   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:07.399612   431 webserver.cc:533] Webserver started at http://127.0.107.254:33433/ using document root <none> and password file <none>
I20260709 13:04:07.400089   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:07.400251   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:07.400467   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:07.401576   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "0fe372d14a57426b9c96e0a39d3a0ee4"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.406095   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:07.409545  9731 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.410305   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:07.410599   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "0fe372d14a57426b9c96e0a39d3a0ee4"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.410985   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:07.424394   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:07.425643   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:07.463810   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37125
I20260709 13:04:07.463909  9782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37125 every 8 connection(s)
I20260709 13:04:07.468139  9783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:07.479173  9783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4: Bootstrap starting.
I20260709 13:04:07.484066  9783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:07.488269  9783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4: No bootstrap required, opened a new log
I20260709 13:04:07.490388  9783 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER }
I20260709 13:04:07.490849  9783 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:07.491076  9783 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe372d14a57426b9c96e0a39d3a0ee4, State: Initialized, Role: FOLLOWER
I20260709 13:04:07.491672  9783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER }
I20260709 13:04:07.492098  9783 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:07.492318  9783 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:07.492573  9783 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:07.497347  9783 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER }
I20260709 13:04:07.497838  9783 leader_election.cc:304] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fe372d14a57426b9c96e0a39d3a0ee4; no voters: 
I20260709 13:04:07.499053  9783 leader_election.cc:290] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:07.499423  9786 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:07.500874  9786 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 1 LEADER]: Becoming Leader. State: Replica: 0fe372d14a57426b9c96e0a39d3a0ee4, State: Running, Role: LEADER
I20260709 13:04:07.501510  9786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER }
I20260709 13:04:07.501961  9783 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:07.506461  9788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fe372d14a57426b9c96e0a39d3a0ee4. Latest consensus state: current_term: 1 leader_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER } }
I20260709 13:04:07.507222  9788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:07.507475  9787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fe372d14a57426b9c96e0a39d3a0ee4" member_type: VOTER } }
I20260709 13:04:07.508241  9787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:07.512216  9794 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:07.517642  9794 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:07.520032   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:07.527164  9794 catalog_manager.cc:1383] Generated new cluster ID: 28491df7ea994805811d765a6059fcc1
I20260709 13:04:07.527535  9794 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:07.548640  9794 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:07.550004  9794 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:07.565725  9794 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4: Generated new TSK 0
I20260709 13:04:07.566342  9794 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:07.586581   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:07.592634  9804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.593729  9805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.596640  9807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.597630   431 server_base.cc:1061] running on GCE node
I20260709 13:04:07.598860   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:07.599049   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:07.599363   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602247599336 us; error 0 us; skew 500 ppm
I20260709 13:04:07.599972   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:07.602442   431 webserver.cc:533] Webserver started at http://127.0.107.193:45115/ using document root <none> and password file <none>
I20260709 13:04:07.602977   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:07.603181   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:07.603458   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:07.604753   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.610139   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:04:07.614109  9812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.615023   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:04:07.615355   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.615669   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:07.631407   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:07.632670   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:07.634183   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:07.636547   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:07.636766   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.637018   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:07.637208   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.678129   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34943
I20260709 13:04:07.678229  9874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34943 every 8 connection(s)
I20260709 13:04:07.683383   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:07.690691  9879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.691304  9880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.694622   431 server_base.cc:1061] running on GCE node
W20260709 13:04:07.694851  9882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.696055   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:07.696352   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:07.696528   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602247696513 us; error 0 us; skew 500 ppm
I20260709 13:04:07.697227   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:07.697151  9875 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37125
I20260709 13:04:07.697852  9875 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:07.698848  9875 heartbeater.cc:507] Master 127.0.107.254:37125 requested a full tablet report, sending...
I20260709 13:04:07.700146   431 webserver.cc:533] Webserver started at http://127.0.107.194:43673/ using document root <none> and password file <none>
I20260709 13:04:07.700856   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:07.701094   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:07.701283  9748 ts_manager.cc:194] Registered new tserver with Master: 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943)
I20260709 13:04:07.701433   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:07.703598  9748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50918
I20260709 13:04:07.704311   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "4ec8311b39514cdb971be49a592801d1"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.709409   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:04:07.712998  9887 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.713908   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:04:07.714226   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "4ec8311b39514cdb971be49a592801d1"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.714529   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:07.726547   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:07.727892   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:07.729380   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:07.731909   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:07.732149   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.732404   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:07.732589   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.788339   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36011
I20260709 13:04:07.788658  9949 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36011 every 8 connection(s)
I20260709 13:04:07.798478   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:07.809592  9953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:07.810724  9954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.814179  9950 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37125
I20260709 13:04:07.814702  9950 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:07.815063   431 server_base.cc:1061] running on GCE node
W20260709 13:04:07.815538  9956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:07.815711  9950 heartbeater.cc:507] Master 127.0.107.254:37125 requested a full tablet report, sending...
I20260709 13:04:07.816684   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:07.816937   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:07.817152   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602247817135 us; error 0 us; skew 500 ppm
I20260709 13:04:07.817934   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:07.818205  9748 ts_manager.cc:194] Registered new tserver with Master: 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011)
I20260709 13:04:07.820031  9748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50926
I20260709 13:04:07.820590   431 webserver.cc:533] Webserver started at http://127.0.107.195:41203/ using document root <none> and password file <none>
I20260709 13:04:07.821321   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:07.821590   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:07.821906   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:07.823540   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "631c8b4968104018bc00c839cb4be800"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.830284   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:04:07.834510  9961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.835548   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:07.835891   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "631c8b4968104018bc00c839cb4be800"
format_stamp: "Formatted at 2026-07-09 13:04:07 on dist-test-slave-n5kz"
I20260709 13:04:07.836233   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:07.886564   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:07.887771   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:07.889228   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:07.891381   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:07.891587   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.891846   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:07.892004   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:07.934576   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42923
I20260709 13:04:07.934752 10023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42923 every 8 connection(s)
I20260709 13:04:07.948764 10024 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37125
I20260709 13:04:07.949275 10024 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:07.949980 10024 heartbeater.cc:507] Master 127.0.107.254:37125 requested a full tablet report, sending...
I20260709 13:04:07.952046  9748 ts_manager.cc:194] Registered new tserver with Master: 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:07.952837   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014952362s
I20260709 13:04:07.953716  9748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50942
I20260709 13:04:07.978960  9748 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50946:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:07.981105  9748 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:08.032459  9915 tablet_service.cc:1511] Processing CreateTablet for tablet fadcba10b7d949ada602b2786ae85a9b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.033710  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcba10b7d949ada602b2786ae85a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.035632  9839 tablet_service.cc:1511] Processing CreateTablet for tablet e97d54719ca84857ba155ed0d478dad6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.037017  9839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97d54719ca84857ba155ed0d478dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.037765  9989 tablet_service.cc:1511] Processing CreateTablet for tablet fadcba10b7d949ada602b2786ae85a9b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.038240  9988 tablet_service.cc:1511] Processing CreateTablet for tablet e97d54719ca84857ba155ed0d478dad6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.039187  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcba10b7d949ada602b2786ae85a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.039884  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97d54719ca84857ba155ed0d478dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.039652  9914 tablet_service.cc:1511] Processing CreateTablet for tablet e97d54719ca84857ba155ed0d478dad6 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.040999  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e97d54719ca84857ba155ed0d478dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.043439  9840 tablet_service.cc:1511] Processing CreateTablet for tablet fadcba10b7d949ada602b2786ae85a9b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=626dc5efb2c6475a97ac3e7830bcfb1f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.045122  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fadcba10b7d949ada602b2786ae85a9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.072985 10039 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: Bootstrap starting.
I20260709 13:04:08.074505 10041 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: Bootstrap starting.
I20260709 13:04:08.074004 10040 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: Bootstrap starting.
I20260709 13:04:08.080921 10041 tablet_bootstrap.cc:654] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.085805 10039 tablet_bootstrap.cc:654] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.087157 10040 tablet_bootstrap.cc:654] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.088372 10041 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: No bootstrap required, opened a new log
I20260709 13:04:08.089087 10041 ts_tablet_manager.cc:1403] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 13:04:08.090701 10039 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: No bootstrap required, opened a new log
I20260709 13:04:08.091271 10039 ts_tablet_manager.cc:1403] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:04:08.093245 10041 raft_consensus.cc:359] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.094347 10041 raft_consensus.cc:385] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.094357 10039 raft_consensus.cc:359] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.094712 10041 raft_consensus.cc:740] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.095263 10039 raft_consensus.cc:385] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.095621 10039 raft_consensus.cc:740] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.095752 10041 consensus_queue.cc:260] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.096395 10040 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: No bootstrap required, opened a new log
I20260709 13:04:08.097102 10040 ts_tablet_manager.cc:1403] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:04:08.096388 10039 consensus_queue.cc:260] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.098373  9950 heartbeater.cc:499] Master 127.0.107.254:37125 was elected leader, sending a full tablet report...
I20260709 13:04:08.099084 10041 ts_tablet_manager.cc:1434] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:04:08.100618 10041 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: Bootstrap starting.
I20260709 13:04:08.100543 10040 raft_consensus.cc:359] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.102396 10040 raft_consensus.cc:385] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.102742 10040 raft_consensus.cc:740] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.103051 10039 ts_tablet_manager.cc:1434] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.003s
I20260709 13:04:08.103565 10040 consensus_queue.cc:260] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.104274 10039 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: Bootstrap starting.
I20260709 13:04:08.105535  9875 heartbeater.cc:499] Master 127.0.107.254:37125 was elected leader, sending a full tablet report...
I20260709 13:04:08.109361 10041 tablet_bootstrap.cc:654] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.111681 10039 tablet_bootstrap.cc:654] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.114511 10045 raft_consensus.cc:493] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.115151 10045 raft_consensus.cc:515] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.116186 10041 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: No bootstrap required, opened a new log
I20260709 13:04:08.117031 10041 ts_tablet_manager.cc:1403] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:04:08.121511 10041 raft_consensus.cc:359] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.122512 10041 raft_consensus.cc:385] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.122922 10041 raft_consensus.cc:740] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.124003 10041 consensus_queue.cc:260] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.125840 10040 ts_tablet_manager.cc:1434] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.007s
I20260709 13:04:08.126765 10024 heartbeater.cc:499] Master 127.0.107.254:37125 was elected leader, sending a full tablet report...
I20260709 13:04:08.136853  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" is_pre_election: true
I20260709 13:04:08.137619  9850 raft_consensus.cc:2468] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 0.
I20260709 13:04:08.139483  9891 leader_election.cc:304] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.142686 10040 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: Bootstrap starting.
I20260709 13:04:08.151366 10040 tablet_bootstrap.cc:654] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.156143 10041 ts_tablet_manager.cc:1434] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.024s
I20260709 13:04:08.156788 10045 leader_election.cc:290] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.158318 10050 raft_consensus.cc:2804] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.166186 10050 raft_consensus.cc:493] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.163237  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800" is_pre_election: true
I20260709 13:04:08.166640 10050 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:08.168052  9888 leader_election.cc:343] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:08.169781 10039 tablet_bootstrap.cc:492] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: No bootstrap required, opened a new log
I20260709 13:04:08.170186 10039 ts_tablet_manager.cc:1403] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent bootstrapping tablet: real 0.066s	user 0.029s	sys 0.026s
I20260709 13:04:08.172933 10040 tablet_bootstrap.cc:492] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: No bootstrap required, opened a new log
I20260709 13:04:08.173548 10040 ts_tablet_manager.cc:1403] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:04:08.173146 10039 raft_consensus.cc:359] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.174070 10039 raft_consensus.cc:385] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.174458 10039 raft_consensus.cc:740] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.175259 10039 consensus_queue.cc:260] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.175724 10050 raft_consensus.cc:515] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.177490 10039 ts_tablet_manager.cc:1434] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:08.177659 10046 raft_consensus.cc:493] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.178228 10046 raft_consensus.cc:515] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.179986  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
I20260709 13:04:08.180272  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:08.180615  9850 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.176843 10040 raft_consensus.cc:359] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.181078 10040 raft_consensus.cc:385] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.181456 10040 raft_consensus.cc:740] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.183406 10040 consensus_queue.cc:260] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.184227 10046 leader_election.cc:290] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.185688 10050 leader_election.cc:290] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 election: Requested vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.185433 10040 ts_tablet_manager.cc:1434] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:04:08.184238  9999 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.194429  9999 raft_consensus.cc:2468] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 1.
I20260709 13:04:08.194597  9850 raft_consensus.cc:2468] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 1.
I20260709 13:04:08.196170  9891 leader_election.cc:304] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.197121 10050 raft_consensus.cc:2804] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.197656 10050 raft_consensus.cc:697] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Running, Role: LEADER
I20260709 13:04:08.198458 10050 consensus_queue.cc:237] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.206079  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec8311b39514cdb971be49a592801d1" is_pre_election: true
I20260709 13:04:08.206938  9925 raft_consensus.cc:2468] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 0.
I20260709 13:04:08.208058  9816 leader_election.cc:304] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.208928 10046 raft_consensus.cc:2804] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.209301 10046 raft_consensus.cc:493] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.209686 10046 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.209479  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800" is_pre_election: true
I20260709 13:04:08.210404  9999 raft_consensus.cc:2468] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 0.
I20260709 13:04:08.218286 10046 raft_consensus.cc:515] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.218603  9748 catalog_manager.cc:5697] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec8311b39514cdb971be49a592801d1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4ec8311b39514cdb971be49a592801d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.220976 10046 leader_election.cc:290] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 1 election: Requested vote from peers 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.221254  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:08.221606  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:08.221972  9925 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.222165  9999 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.229698  9925 raft_consensus.cc:2468] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 1.
I20260709 13:04:08.229698  9999 raft_consensus.cc:2468] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 1.
I20260709 13:04:08.231138  9816 leader_election.cc:304] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 631c8b4968104018bc00c839cb4be800, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.231916 10046 raft_consensus.cc:2804] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.232812 10046 raft_consensus.cc:697] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 LEADER]: Becoming Leader. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:08.233644 10046 consensus_queue.cc:237] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.240193  9748 catalog_manager.cc:5697] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.273859  9748 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50948:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:08.275851  9748 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:08.298346  9839 tablet_service.cc:1511] Processing CreateTablet for tablet 1662c1805a3142acb2f4abb5fd62b110 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.299767  9839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1662c1805a3142acb2f4abb5fd62b110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.299853  9914 tablet_service.cc:1511] Processing CreateTablet for tablet 1662c1805a3142acb2f4abb5fd62b110 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.301146  9914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1662c1805a3142acb2f4abb5fd62b110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.301730  9988 tablet_service.cc:1511] Processing CreateTablet for tablet 1662c1805a3142acb2f4abb5fd62b110 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:04:08.302923  9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1662c1805a3142acb2f4abb5fd62b110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.304508  9840 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd38f5c86494151b2eda8d4d2ded3ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.305822  9840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd38f5c86494151b2eda8d4d2ded3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.307209  9989 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd38f5c86494151b2eda8d4d2ded3ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.308514  9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd38f5c86494151b2eda8d4d2ded3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.308599  9915 tablet_service.cc:1511] Processing CreateTablet for tablet 4cd38f5c86494151b2eda8d4d2ded3ae (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=247540209b674d209e8c6361e9a8bc0e]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:04:08.309849  9915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cd38f5c86494151b2eda8d4d2ded3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:08.320784 10040 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: Bootstrap starting.
I20260709 13:04:08.325419 10039 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: Bootstrap starting.
I20260709 13:04:08.327244 10040 tablet_bootstrap.cc:654] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.331755 10039 tablet_bootstrap.cc:654] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.339641 10039 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: No bootstrap required, opened a new log
I20260709 13:04:08.340009 10040 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: No bootstrap required, opened a new log
I20260709 13:04:08.340204 10039 ts_tablet_manager.cc:1403] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:04:08.340622 10040 ts_tablet_manager.cc:1403] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:04:08.343827 10040 raft_consensus.cc:359] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.344079 10039 raft_consensus.cc:359] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.344604 10040 raft_consensus.cc:385] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.344916 10039 raft_consensus.cc:385] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.345009 10040 raft_consensus.cc:740] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.345372 10039 raft_consensus.cc:740] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.346580 10041 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: Bootstrap starting.
I20260709 13:04:08.346344 10039 consensus_queue.cc:260] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.346148 10040 consensus_queue.cc:260] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.351188 10039 ts_tablet_manager.cc:1434] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:08.352375 10039 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: Bootstrap starting.
I20260709 13:04:08.353101 10040 ts_tablet_manager.cc:1434] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:04:08.354986 10040 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Bootstrap starting.
I20260709 13:04:08.356181 10041 tablet_bootstrap.cc:654] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.377198 10039 tablet_bootstrap.cc:654] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.377250 10040 tablet_bootstrap.cc:654] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.391940 10039 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: No bootstrap required, opened a new log
I20260709 13:04:08.392552 10039 ts_tablet_manager.cc:1403] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.005s
I20260709 13:04:08.392630 10040 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: No bootstrap required, opened a new log
I20260709 13:04:08.393296 10040 ts_tablet_manager.cc:1403] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.026s
I20260709 13:04:08.395591 10039 raft_consensus.cc:359] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.396070 10040 raft_consensus.cc:359] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.396425 10039 raft_consensus.cc:385] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.396775 10040 raft_consensus.cc:385] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.396878 10039 raft_consensus.cc:740] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.397025 10041 tablet_bootstrap.cc:492] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: No bootstrap required, opened a new log
I20260709 13:04:08.397156 10040 raft_consensus.cc:740] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.397675 10041 ts_tablet_manager.cc:1403] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.022s
I20260709 13:04:08.397783 10039 consensus_queue.cc:260] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.398136 10040 consensus_queue.cc:260] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.400208 10039 ts_tablet_manager.cc:1434] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:08.400797 10041 raft_consensus.cc:359] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.401594 10041 raft_consensus.cc:385] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.401933 10041 raft_consensus.cc:740] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.402405 10040 ts_tablet_manager.cc:1434] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:08.402962 10041 consensus_queue.cc:260] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.405200 10041 ts_tablet_manager.cc:1434] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:08.406199 10041 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: Bootstrap starting.
I20260709 13:04:08.414587 10041 tablet_bootstrap.cc:654] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:08.419855 10041 tablet_bootstrap.cc:492] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: No bootstrap required, opened a new log
I20260709 13:04:08.420229 10041 ts_tablet_manager.cc:1403] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 13:04:08.422287 10041 raft_consensus.cc:359] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.422896 10041 raft_consensus.cc:385] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:08.423089 10041 raft_consensus.cc:740] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Initialized, Role: FOLLOWER
I20260709 13:04:08.423604 10041 consensus_queue.cc:260] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.425205 10050 raft_consensus.cc:493] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.425637 10041 ts_tablet_manager.cc:1434] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:08.425690 10050 raft_consensus.cc:515] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.428015 10050 leader_election.cc:290] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.429018  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" is_pre_election: true
I20260709 13:04:08.429018  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800" is_pre_election: true
I20260709 13:04:08.429934  9850 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 0.
I20260709 13:04:08.430496  9999 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 0.
I20260709 13:04:08.431097  9891 leader_election.cc:304] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.432006 10050 raft_consensus.cc:2804] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.432368 10050 raft_consensus.cc:493] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.433230 10050 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.439708 10050 raft_consensus.cc:515] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.441898 10050 leader_election.cc:290] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 election: Requested vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.442674  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
I20260709 13:04:08.443025  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:08.443424  9850 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.443608  9999 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.450646  9999 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 1.
I20260709 13:04:08.450646  9850 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 1.
I20260709 13:04:08.452023  9888 leader_election.cc:304] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 631c8b4968104018bc00c839cb4be800; no voters: 
I20260709 13:04:08.452791 10050 raft_consensus.cc:2804] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.453306 10050 raft_consensus.cc:697] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Running, Role: LEADER
I20260709 13:04:08.454030 10050 consensus_queue.cc:237] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.462113  9748 catalog_manager.cc:5697] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec8311b39514cdb971be49a592801d1 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4ec8311b39514cdb971be49a592801d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:08.515286  9796 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:08.550055 10047 raft_consensus.cc:493] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.551455 10047 raft_consensus.cc:515] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.555685 10047 leader_election.cc:290] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011)
I20260709 13:04:08.567334  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" is_pre_election: true
I20260709 13:04:08.567816  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec8311b39514cdb971be49a592801d1" is_pre_election: true
I20260709 13:04:08.568172  9850 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 0.
I20260709 13:04:08.568522  9925 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 0.
I20260709 13:04:08.569367  9965 leader_election.cc:304] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631c8b4968104018bc00c839cb4be800, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.570125 10047 raft_consensus.cc:2804] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:08.570523 10047 raft_consensus.cc:493] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.570843 10047 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.576545 10047 raft_consensus.cc:515] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.578233 10047 leader_election.cc:290] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 1 election: Requested vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011)
I20260709 13:04:08.579224  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
I20260709 13:04:08.579485  9925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:08.580003  9850 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.580099  9925 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:08.585803  9850 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 1.
I20260709 13:04:08.585806  9925 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 1.
I20260709 13:04:08.587294  9965 leader_election.cc:304] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 631c8b4968104018bc00c839cb4be800, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:08.588011 10047 raft_consensus.cc:2804] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:08.588984 10047 raft_consensus.cc:697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 LEADER]: Becoming Leader. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Running, Role: LEADER
I20260709 13:04:08.589802 10047 consensus_queue.cc:237] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.596500  9748 catalog_manager.cc:5697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 reported cstate change: term changed from 0 to 1, leader changed from <none> to 631c8b4968104018bc00c839cb4be800 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "631c8b4968104018bc00c839cb4be800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.653364  9925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b"
dest_uuid: "4ec8311b39514cdb971be49a592801d1"
mode: GRACEFUL
new_leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:04:08.654013  9925 raft_consensus.cc:606] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Received request to transfer leadership to TS 8c24452df1df4fa4a3f2f3a4944b06d4
I20260709 13:04:08.667212  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6"
dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
mode: GRACEFUL
new_leader_uuid: "4ec8311b39514cdb971be49a592801d1"
 from {username='slave'} at 127.0.0.1:60584
I20260709 13:04:08.667726  9850 raft_consensus.cc:606] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 LEADER]: Received request to transfer leadership to TS 4ec8311b39514cdb971be49a592801d1
I20260709 13:04:08.673595  9925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110"
dest_uuid: "4ec8311b39514cdb971be49a592801d1"
mode: GRACEFUL
new_leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:59190
I20260709 13:04:08.674100  9925 raft_consensus.cc:606] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Received request to transfer leadership to TS 8c24452df1df4fa4a3f2f3a4944b06d4
I20260709 13:04:08.679172 10050 consensus_queue.cc:1048] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.687830 10051 raft_consensus.cc:993] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: : Instructing follower 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:08.688717 10050 raft_consensus.cc:1081] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Signalling peer 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:08.692323  9849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b"
dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:60570
I20260709 13:04:08.692655  9999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae"
dest_uuid: "631c8b4968104018bc00c839cb4be800"
mode: GRACEFUL
new_leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:59158
I20260709 13:04:08.693282  9999 raft_consensus.cc:606] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 LEADER]: Received request to transfer leadership to TS 8c24452df1df4fa4a3f2f3a4944b06d4
I20260709 13:04:08.694579  9849 raft_consensus.cc:493] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.695075  9849 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.698881 10051 consensus_queue.cc:1048] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.704183 10046 consensus_queue.cc:1048] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.715379  9849 raft_consensus.cc:515] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.724584 10046 raft_consensus.cc:993] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: : Instructing follower 4ec8311b39514cdb971be49a592801d1 to start an election
I20260709 13:04:08.725076 10046 raft_consensus.cc:1081] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 LEADER]: Signalling peer 4ec8311b39514cdb971be49a592801d1 to start an election
I20260709 13:04:08.733729  9849 leader_election.cc:290] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.736646  9998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:08.738965  9924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6"
dest_uuid: "4ec8311b39514cdb971be49a592801d1"
 from {username='slave'} at 127.0.0.1:59172
I20260709 13:04:08.739645  9924 raft_consensus.cc:493] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:08.740033  9924 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.748696  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fadcba10b7d949ada602b2786ae85a9b" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:08.749528  9923 raft_consensus.cc:3055] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:08.749874  9923 raft_consensus.cc:740] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Running, Role: LEADER
I20260709 13:04:08.750634  9923 consensus_queue.cc:260] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.751808  9923 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.754873 10046 consensus_queue.cc:1048] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:08.765215  9924 raft_consensus.cc:515] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.767107  9923 raft_consensus.cc:2468] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 2.
I20260709 13:04:08.768862  9816 leader_election.cc:304] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 631c8b4968104018bc00c839cb4be800
I20260709 13:04:08.769029  9925 raft_consensus.cc:1240] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Rejecting Update request from peer 8c24452df1df4fa4a3f2f3a4944b06d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:08.771359  9849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
I20260709 13:04:08.772060  9849 raft_consensus.cc:3055] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:08.772008  9999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e97d54719ca84857ba155ed0d478dad6" candidate_uuid: "4ec8311b39514cdb971be49a592801d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:08.772526 10046 raft_consensus.cc:2804] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:08.772791  9849 raft_consensus.cc:740] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:08.773139 10046 raft_consensus.cc:697] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:08.773742  9849 consensus_queue.cc:260] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.774052 10046 consensus_queue.cc:237] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.774822  9849 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.775905  9924 leader_election.cc:290] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 2 election: Requested vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:08.788456  9746 catalog_manager.cc:5697] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 reported cstate change: term changed from 1 to 2, leader changed from 4ec8311b39514cdb971be49a592801d1 (127.0.107.194) to 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.790465  9849 raft_consensus.cc:2468] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec8311b39514cdb971be49a592801d1 in term 2.
I20260709 13:04:08.797724  9891 leader_election.cc:304] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 631c8b4968104018bc00c839cb4be800
I20260709 13:04:08.798591 10051 raft_consensus.cc:2804] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:08.799088 10051 raft_consensus.cc:697] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 LEADER]: Becoming Leader. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Running, Role: LEADER
I20260709 13:04:08.799885 10051 consensus_queue.cc:237] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:08.807138  9748 catalog_manager.cc:5697] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 reported cstate change: term changed from 1 to 2, leader changed from 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193) to 4ec8311b39514cdb971be49a592801d1 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4ec8311b39514cdb971be49a592801d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:08.997932 10051 consensus_queue.cc:1048] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.008667 10075 consensus_queue.cc:1048] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.016772 10050 raft_consensus.cc:993] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: : Instructing follower 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:09.017254 10050 raft_consensus.cc:1081] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Signalling peer 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:09.018949  9849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110"
dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:60570
I20260709 13:04:09.019629  9849 raft_consensus.cc:493] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.020006  9849 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.026691  9849 raft_consensus.cc:515] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.028800  9849 leader_election.cc:290] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:09.029521  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:09.030058  9998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1662c1805a3142acb2f4abb5fd62b110" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:09.030194  9924 raft_consensus.cc:3055] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:09.030745  9924 raft_consensus.cc:740] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ec8311b39514cdb971be49a592801d1, State: Running, Role: LEADER
I20260709 13:04:09.030757  9998 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.031615  9924 consensus_queue.cc:260] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.032771  9924 raft_consensus.cc:3060] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.039461  9998 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 2.
I20260709 13:04:09.039731  9924 raft_consensus.cc:2468] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 2.
I20260709 13:04:09.040738  9816 leader_election.cc:304] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:09.041435 10081 raft_consensus.cc:2804] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:09.041872 10081 raft_consensus.cc:697] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:09.042738 10081 consensus_queue.cc:237] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.048640  9748 catalog_manager.cc:5697] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 reported cstate change: term changed from 1 to 2, leader changed from 4ec8311b39514cdb971be49a592801d1 (127.0.107.194) to 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.081131 10047 consensus_queue.cc:1048] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:09.087628 10071 raft_consensus.cc:993] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: : Instructing follower 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:09.088528 10047 raft_consensus.cc:1081] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 LEADER]: Signalling peer 8c24452df1df4fa4a3f2f3a4944b06d4 to start an election
I20260709 13:04:09.090762  9850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae"
dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
 from {username='slave'} at 127.0.0.1:60580
I20260709 13:04:09.091661  9850 raft_consensus.cc:493] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.092084  9850 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.094331 10086 consensus_queue.cc:1048] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:09.099723  9850 raft_consensus.cc:515] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.103037  9998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "631c8b4968104018bc00c839cb4be800"
I20260709 13:04:09.103772  9850 leader_election.cc:290] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011), 631c8b4968104018bc00c839cb4be800 (127.0.107.195:42923)
I20260709 13:04:09.103859  9998 raft_consensus.cc:3055] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:09.104482  9998 raft_consensus.cc:740] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Running, Role: LEADER
I20260709 13:04:09.103178  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:09.105450  9924 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.106014  9998 consensus_queue.cc:260] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.107256  9998 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.111181  9924 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 2.
I20260709 13:04:09.112223  9998 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c24452df1df4fa4a3f2f3a4944b06d4 in term 2.
I20260709 13:04:09.112296  9816 leader_election.cc:304] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 8c24452df1df4fa4a3f2f3a4944b06d4; no voters: 
I20260709 13:04:09.113401 10081 raft_consensus.cc:2804] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:09.113862 10081 raft_consensus.cc:697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Becoming Leader. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:09.114671 10081 consensus_queue.cc:237] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.121318  9747 catalog_manager.cc:5697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 reported cstate change: term changed from 1 to 2, leader changed from 631c8b4968104018bc00c839cb4be800 (127.0.107.195) to 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:09.184239   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:04:09.186156   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:04:09.186578   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:04:09.198689  9850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae"
dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
mode: GRACEFUL
new_leader_uuid: "631c8b4968104018bc00c839cb4be800"
 from {username='slave'} at 127.0.0.1:60598
I20260709 13:04:09.199246  9850 raft_consensus.cc:606] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Received request to transfer leadership to TS 631c8b4968104018bc00c839cb4be800
I20260709 13:04:09.200372   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:04:09.219224  9998 raft_consensus.cc:3060] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.225035  9998 raft_consensus.cc:1275] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.226532 10081 consensus_queue.cc:1048] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.234777  9924 raft_consensus.cc:1275] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.236589 10055 consensus_queue.cc:1048] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.247687  9998 raft_consensus.cc:3060] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:09.254426  9998 raft_consensus.cc:1275] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Refusing update from remote peer 4ec8311b39514cdb971be49a592801d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.255780 10050 consensus_queue.cc:1048] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.265172  9850 raft_consensus.cc:1275] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Refusing update from remote peer 4ec8311b39514cdb971be49a592801d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.267177 10051 consensus_queue.cc:1048] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.564630  9924 raft_consensus.cc:1275] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.565897 10055 consensus_queue.cc:1048] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.573634  9998 raft_consensus.cc:1275] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.575390 10081 consensus_queue.cc:1048] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.581632 10046 raft_consensus.cc:993] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: : Instructing follower 631c8b4968104018bc00c839cb4be800 to start an election
I20260709 13:04:09.582109 10081 raft_consensus.cc:1081] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Signalling peer 631c8b4968104018bc00c839cb4be800 to start an election
I20260709 13:04:09.583695  9998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae"
dest_uuid: "631c8b4968104018bc00c839cb4be800"
 from {username='slave'} at 127.0.0.1:59142
I20260709 13:04:09.584295  9998 raft_consensus.cc:493] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.584678  9998 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:09.590147  9998 raft_consensus.cc:515] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.592204  9998 leader_election.cc:290] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 3 election: Requested vote from peers 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943), 4ec8311b39514cdb971be49a592801d1 (127.0.107.194:36011)
I20260709 13:04:09.593892  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ec8311b39514cdb971be49a592801d1"
I20260709 13:04:09.594084  9850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cd38f5c86494151b2eda8d4d2ded3ae" candidate_uuid: "631c8b4968104018bc00c839cb4be800" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4"
I20260709 13:04:09.594714  9924 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:09.594883  9850 raft_consensus.cc:3055] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:09.595350  9850 raft_consensus.cc:740] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c24452df1df4fa4a3f2f3a4944b06d4, State: Running, Role: LEADER
I20260709 13:04:09.596132  9850 consensus_queue.cc:260] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.597311  9850 raft_consensus.cc:3060] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:09.600914  9924 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 3.
I20260709 13:04:09.601504  9925 raft_consensus.cc:1275] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.602063  9965 leader_election.cc:304] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec8311b39514cdb971be49a592801d1, 631c8b4968104018bc00c839cb4be800; no voters: 
I20260709 13:04:09.602965 10086 raft_consensus.cc:2804] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:09.603085 10081 consensus_queue.cc:1048] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.603935  9850 raft_consensus.cc:2468] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 631c8b4968104018bc00c839cb4be800 in term 3.
I20260709 13:04:09.604189 10086 raft_consensus.cc:697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 LEADER]: Becoming Leader. State: Replica: 631c8b4968104018bc00c839cb4be800, State: Running, Role: LEADER
I20260709 13:04:09.605129 10086 consensus_queue.cc:237] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } }
I20260709 13:04:09.612660  9746 catalog_manager.cc:5697] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 reported cstate change: term changed from 2 to 3, leader changed from 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193) to 631c8b4968104018bc00c839cb4be800 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "631c8b4968104018bc00c839cb4be800" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c24452df1df4fa4a3f2f3a4944b06d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ec8311b39514cdb971be49a592801d1" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:09.615249  9998 raft_consensus.cc:1275] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Refusing update from remote peer 8c24452df1df4fa4a3f2f3a4944b06d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:09.617022 10081 consensus_queue.cc:1048] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "631c8b4968104018bc00c839cb4be800" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:09.828524   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:09.852623   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:09.853317   431 tablet_replica.cc:333] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4: stopping tablet replica
I20260709 13:04:09.854036   431 raft_consensus.cc:2243] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.854553   431 raft_consensus.cc:2272] T e97d54719ca84857ba155ed0d478dad6 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.856855   431 tablet_replica.cc:333] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4: stopping tablet replica
I20260709 13:04:09.857407   431 raft_consensus.cc:2243] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.857848   431 raft_consensus.cc:2272] T 4cd38f5c86494151b2eda8d4d2ded3ae P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.860562   431 tablet_replica.cc:333] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4: stopping tablet replica
I20260709 13:04:09.861136   431 raft_consensus.cc:2243] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.861948   431 raft_consensus.cc:2272] T 1662c1805a3142acb2f4abb5fd62b110 P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.864310   431 tablet_replica.cc:333] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4: stopping tablet replica
I20260709 13:04:09.864811   431 raft_consensus.cc:2243] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.865561   431 raft_consensus.cc:2272] T fadcba10b7d949ada602b2786ae85a9b P 8c24452df1df4fa4a3f2f3a4944b06d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.891139   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:09.903146   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:04:09.922544   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:09.923243   431 tablet_replica.cc:333] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1: stopping tablet replica
I20260709 13:04:09.923816   431 raft_consensus.cc:2243] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:09.924614   431 raft_consensus.cc:2272] T e97d54719ca84857ba155ed0d478dad6 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.927206   431 tablet_replica.cc:333] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1: stopping tablet replica
I20260709 13:04:09.927753   431 raft_consensus.cc:2243] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.928174   431 raft_consensus.cc:2272] T 4cd38f5c86494151b2eda8d4d2ded3ae P 4ec8311b39514cdb971be49a592801d1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.930430   431 tablet_replica.cc:333] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1: stopping tablet replica
I20260709 13:04:09.931586   431 raft_consensus.cc:2243] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.932595   431 raft_consensus.cc:2272] T 1662c1805a3142acb2f4abb5fd62b110 P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.937136   431 tablet_replica.cc:333] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1: stopping tablet replica
I20260709 13:04:09.938380   431 raft_consensus.cc:2243] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:09.939638   431 raft_consensus.cc:2272] T fadcba10b7d949ada602b2786ae85a9b P 4ec8311b39514cdb971be49a592801d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:09.978093   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:09.991129   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:10.010728  9965 consensus_peers.cc:597] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 -> Peer 8c24452df1df4fa4a3f2f3a4944b06d4 (127.0.107.193:34943): Couldn't send request to peer 8c24452df1df4fa4a3f2f3a4944b06d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34943: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:10.013634   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:10.014355   431 tablet_replica.cc:333] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: stopping tablet replica
I20260709 13:04:10.014933   431 raft_consensus.cc:2243] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:10.015607   431 pending_rounds.cc:70] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Trying to abort 1 pending ops.
I20260709 13:04:10.015774   431 pending_rounds.cc:77] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634814391889920 op_type: NO_OP noop_request { }
I20260709 13:04:10.016018   431 raft_consensus.cc:2889] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:10.016254   431 raft_consensus.cc:2272] T 4cd38f5c86494151b2eda8d4d2ded3ae P 631c8b4968104018bc00c839cb4be800 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.018290   431 tablet_replica.cc:333] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800: stopping tablet replica
I20260709 13:04:10.018847   431 raft_consensus.cc:2243] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.019304   431 raft_consensus.cc:2272] T 1662c1805a3142acb2f4abb5fd62b110 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.021790   431 tablet_replica.cc:333] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800: stopping tablet replica
I20260709 13:04:10.022248   431 raft_consensus.cc:2243] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.022604   431 raft_consensus.cc:2272] T fadcba10b7d949ada602b2786ae85a9b P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.024777   431 tablet_replica.cc:333] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800: stopping tablet replica
I20260709 13:04:10.025228   431 raft_consensus.cc:2243] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:10.025584   431 raft_consensus.cc:2272] T e97d54719ca84857ba155ed0d478dad6 P 631c8b4968104018bc00c839cb4be800 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.038035   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:10.049922   431 master.cc:562] Master@127.0.107.254:37125 shutting down...
I20260709 13:04:10.064929   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:10.065479   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:10.065811   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0fe372d14a57426b9c96e0a39d3a0ee4: stopping tablet replica
I20260709 13:04:10.084213   431 master.cc:584] Master@127.0.107.254:37125 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2726 ms)
[----------] 6 tests from LeaderRebalancerTest (295158 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:04:10.113250   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:42665
I20260709 13:04:10.114356   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.119482 10093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.119653 10094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.120615 10096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.121978   431 server_base.cc:1061] running on GCE node
I20260709 13:04:10.122773   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:10.122987   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.123139   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250123109 us; error 0 us; skew 500 ppm
I20260709 13:04:10.123677   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.125969   431 webserver.cc:533] Webserver started at http://127.0.107.254:42387/ using document root <none> and password file <none>
I20260709 13:04:10.126492   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.126708   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.126963   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.128010   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "536d8b6de2c240ad9c68ae58f306bdc2"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.132576   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:10.135949 10101 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.136736   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:10.137032   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "536d8b6de2c240ad9c68ae58f306bdc2"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.137336   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.153620   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.155229   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.193204   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:42665
I20260709 13:04:10.193327 10152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:42665 every 8 connection(s)
I20260709 13:04:10.197065 10153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.208123 10153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: Bootstrap starting.
I20260709 13:04:10.212814 10153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.217085 10153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: No bootstrap required, opened a new log
I20260709 13:04:10.219337 10153 raft_consensus.cc:359] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER }
I20260709 13:04:10.219789 10153 raft_consensus.cc:385] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.219978 10153 raft_consensus.cc:740] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 536d8b6de2c240ad9c68ae58f306bdc2, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.220583 10153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER }
I20260709 13:04:10.221035 10153 raft_consensus.cc:399] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:10.221271 10153 raft_consensus.cc:493] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:10.221657 10153 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:10.227035 10153 raft_consensus.cc:515] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER }
I20260709 13:04:10.227599 10153 leader_election.cc:304] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 536d8b6de2c240ad9c68ae58f306bdc2; no voters: 
I20260709 13:04:10.228729 10153 leader_election.cc:290] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:10.229070 10156 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:10.230506 10156 raft_consensus.cc:697] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 1 LEADER]: Becoming Leader. State: Replica: 536d8b6de2c240ad9c68ae58f306bdc2, State: Running, Role: LEADER
I20260709 13:04:10.231194 10156 consensus_queue.cc:237] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER }
I20260709 13:04:10.231817 10153 sys_catalog.cc:565] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:10.234249 10157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER } }
I20260709 13:04:10.234305 10158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 536d8b6de2c240ad9c68ae58f306bdc2. Latest consensus state: current_term: 1 leader_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "536d8b6de2c240ad9c68ae58f306bdc2" member_type: VOTER } }
I20260709 13:04:10.235212 10158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:10.237208 10157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:10.238430 10162 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:10.243269 10162 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:10.247704   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:10.252301 10162 catalog_manager.cc:1383] Generated new cluster ID: edd8574decd443f2ac053c5e7388f9b1
I20260709 13:04:10.252601 10162 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:10.288322 10162 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:10.289723 10162 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:10.301465 10162 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: Generated new TSK 0
I20260709 13:04:10.302085 10162 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:10.314167   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.319741 10174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.321084 10175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.327394 10177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.327967   431 server_base.cc:1061] running on GCE node
I20260709 13:04:10.328826   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:10.329012   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.329144   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250329132 us; error 0 us; skew 500 ppm
I20260709 13:04:10.329639   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.331930   431 webserver.cc:533] Webserver started at http://127.0.107.193:43511/ using document root <none> and password file <none>
I20260709 13:04:10.332389   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.332544   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.332753   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.333846   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "42d00e433fe04ce580a148a86dcf281b"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.338214   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:04:10.341746 10182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.342711   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:10.343385   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "42d00e433fe04ce580a148a86dcf281b"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.343670   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.368707   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.369961   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.371531   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:10.373986   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:10.374230   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.374503   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:10.374709   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:04:10.415267   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:46429
I20260709 13:04:10.415381 10244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:46429 every 8 connection(s)
I20260709 13:04:10.420351   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.427482 10249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.435535 10245 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42665
I20260709 13:04:10.436511 10245 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.438205 10245 heartbeater.cc:507] Master 127.0.107.254:42665 requested a full tablet report, sending...
W20260709 13:04:10.439972 10250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.441186 10252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.441870   431 server_base.cc:1061] running on GCE node
I20260709 13:04:10.442565 10118 ts_manager.cc:194] Registered new tserver with Master: 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429)
I20260709 13:04:10.442927   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:10.443214   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.443399   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250443370 us; error 0 us; skew 500 ppm
I20260709 13:04:10.444043   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.444737 10118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41836
I20260709 13:04:10.446894   431 webserver.cc:533] Webserver started at http://127.0.107.194:33805/ using document root <none> and password file <none>
I20260709 13:04:10.447484   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.447680   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.447969   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.449071   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "f098e27608234644a1b6db69669b56aa"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.453729   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:10.457046 10257 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.457825   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:10.458132   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "f098e27608234644a1b6db69669b56aa"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.458416   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.481302   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.482425   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.483906   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:10.486162   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:10.486397   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.486677   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:10.486846   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.524922   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38797
I20260709 13:04:10.525028 10319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38797 every 8 connection(s)
I20260709 13:04:10.530313   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:10.537607 10323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:10.539921 10324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.540999 10320 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42665
I20260709 13:04:10.541668 10320 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.542785 10320 heartbeater.cc:507] Master 127.0.107.254:42665 requested a full tablet report, sending...
W20260709 13:04:10.543907 10326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:10.543968   431 server_base.cc:1061] running on GCE node
I20260709 13:04:10.545282 10118 ts_manager.cc:194] Registered new tserver with Master: f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:10.545385   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:10.545905   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:10.546089   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602250546070 us; error 0 us; skew 500 ppm
I20260709 13:04:10.546754   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:10.547088 10118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41840
I20260709 13:04:10.549861   431 webserver.cc:533] Webserver started at http://127.0.107.195:35611/ using document root <none> and password file <none>
I20260709 13:04:10.550495   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:10.550751   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:10.551124   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:10.552296   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "9ee15fcabc434c99b5b217b8e42532ee"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.557014   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:10.560667 10331 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.561491   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:10.561800   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "9ee15fcabc434c99b5b217b8e42532ee"
format_stamp: "Formatted at 2026-07-09 13:04:10 on dist-test-slave-n5kz"
I20260709 13:04:10.562110   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:10.587395   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:10.588479   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:10.589982   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:10.592351   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:10.592581   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.592823   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:10.592994   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:10.632699   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:39243
I20260709 13:04:10.632858 10393 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:39243 every 8 connection(s)
I20260709 13:04:10.648072 10394 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42665
I20260709 13:04:10.648563 10394 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:10.649355 10394 heartbeater.cc:507] Master 127.0.107.254:42665 requested a full tablet report, sending...
I20260709 13:04:10.651443 10118 ts_manager.cc:194] Registered new tserver with Master: 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:10.652088   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015858817s
I20260709 13:04:10.652940 10118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53606
I20260709 13:04:10.678831 10118 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53610:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:10.681560 10118 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:10.761178 10210 tablet_service.cc:1511] Processing CreateTablet for tablet bf8e615842634124997ca8211901f400 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.763682 10284 tablet_service.cc:1511] Processing CreateTablet for tablet 031fee577f9a46b9aa14554d568b46dd (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.763823 10209 tablet_service.cc:1511] Processing CreateTablet for tablet 031fee577f9a46b9aa14554d568b46dd (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.765260 10284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031fee577f9a46b9aa14554d568b46dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.766250 10208 tablet_service.cc:1511] Processing CreateTablet for tablet 3da1181467ed4c8b99957cd060be2268 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.767663 10283 tablet_service.cc:1511] Processing CreateTablet for tablet 3da1181467ed4c8b99957cd060be2268 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.769042 10283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da1181467ed4c8b99957cd060be2268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.768877 10207 tablet_service.cc:1511] Processing CreateTablet for tablet e3ffc156c6b0498d9220972a5133e828 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.771231 10359 tablet_service.cc:1511] Processing CreateTablet for tablet bf8e615842634124997ca8211901f400 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.771677 10282 tablet_service.cc:1511] Processing CreateTablet for tablet e3ffc156c6b0498d9220972a5133e828 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.772619 10359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8e615842634124997ca8211901f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.773067 10282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ffc156c6b0498d9220972a5133e828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.775581 10285 tablet_service.cc:1511] Processing CreateTablet for tablet bf8e615842634124997ca8211901f400 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:10.775718 10358 tablet_service.cc:1511] Processing CreateTablet for tablet 031fee577f9a46b9aa14554d568b46dd (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:10.776811 10353 tablet_service.cc:1511] Processing CreateTablet for tablet ee9963e3378a40fc84c508b8bf5ebbc6 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.777456 10358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031fee577f9a46b9aa14554d568b46dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.778236 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9963e3378a40fc84c508b8bf5ebbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.777494 10285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8e615842634124997ca8211901f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.780066 10354 tablet_service.cc:1511] Processing CreateTablet for tablet 54dfba76264541fdbf057a630b483873 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.781119 10281 tablet_service.cc:1511] Processing CreateTablet for tablet 7420363ee2eb409ab03d230170f75f6a (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.783035 10355 tablet_service.cc:1511] Processing CreateTablet for tablet 7420363ee2eb409ab03d230170f75f6a (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.784080 10280 tablet_service.cc:1511] Processing CreateTablet for tablet 54dfba76264541fdbf057a630b483873 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.785856 10281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7420363ee2eb409ab03d230170f75f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.785996 10356 tablet_service.cc:1511] Processing CreateTablet for tablet e3ffc156c6b0498d9220972a5133e828 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:10.787487 10280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dfba76264541fdbf057a630b483873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.789060 10357 tablet_service.cc:1511] Processing CreateTablet for tablet 3da1181467ed4c8b99957cd060be2268 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:10.792027 10206 tablet_service.cc:1511] Processing CreateTablet for tablet 7420363ee2eb409ab03d230170f75f6a (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:10.792744 10204 tablet_service.cc:1511] Processing CreateTablet for tablet ee9963e3378a40fc84c508b8bf5ebbc6 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.793149 10205 tablet_service.cc:1511] Processing CreateTablet for tablet 54dfba76264541fdbf057a630b483873 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:10.795351 10203 tablet_service.cc:1511] Processing CreateTablet for tablet f22af50d2b3b4b819f11f59036321bd5 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.795862 10210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8e615842634124997ca8211901f400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.796679 10203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22af50d2b3b4b819f11f59036321bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.797245 10207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ffc156c6b0498d9220972a5133e828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.798430 10205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dfba76264541fdbf057a630b483873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.799062 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9963e3378a40fc84c508b8bf5ebbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.802392 10279 tablet_service.cc:1511] Processing CreateTablet for tablet ee9963e3378a40fc84c508b8bf5ebbc6 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:10.802932 10206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7420363ee2eb409ab03d230170f75f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.803601 10279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9963e3378a40fc84c508b8bf5ebbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.806335 10209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 031fee577f9a46b9aa14554d568b46dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.807116 10352 tablet_service.cc:1511] Processing CreateTablet for tablet f22af50d2b3b4b819f11f59036321bd5 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.809712 10278 tablet_service.cc:1511] Processing CreateTablet for tablet f22af50d2b3b4b819f11f59036321bd5 (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:10.811033 10278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22af50d2b3b4b819f11f59036321bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.811275 10357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da1181467ed4c8b99957cd060be2268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.812079 10202 tablet_service.cc:1511] Processing CreateTablet for tablet b9bce3c0627744739bc72425c6f14c6f (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.813570 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f22af50d2b3b4b819f11f59036321bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.814961 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54dfba76264541fdbf057a630b483873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.816085 10277 tablet_service.cc:1511] Processing CreateTablet for tablet b9bce3c0627744739bc72425c6f14c6f (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.816583 10355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7420363ee2eb409ab03d230170f75f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.817694 10277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bce3c0627744739bc72425c6f14c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.817783 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ffc156c6b0498d9220972a5133e828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.810971 10208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da1181467ed4c8b99957cd060be2268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.819525 10202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bce3c0627744739bc72425c6f14c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.822780 10351 tablet_service.cc:1511] Processing CreateTablet for tablet b9bce3c0627744739bc72425c6f14c6f (DEFAULT_TABLE table=test-workload [id=3c6963c4ade949dab1c68570e524d269]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:10.824085 10351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9bce3c0627744739bc72425c6f14c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:10.929888 10409 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:10.951020 10410 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:10.977334 10409 tablet_bootstrap.cc:654] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.980906 10411 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:10.986186 10409 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:10.986836 10409 ts_tablet_manager.cc:1403] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.033s
I20260709 13:04:10.989069 10410 tablet_bootstrap.cc:654] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.989660 10409 raft_consensus.cc:359] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:10.990311 10411 tablet_bootstrap.cc:654] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:10.990437 10409 raft_consensus.cc:385] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:10.990989 10409 raft_consensus.cc:740] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:10.991703 10409 consensus_queue.cc:260] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:10.994807 10409 ts_tablet_manager.cc:1434] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:10.995368 10320 heartbeater.cc:499] Master 127.0.107.254:42665 was elected leader, sending a full tablet report...
I20260709 13:04:10.995635 10411 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:10.995671 10409 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:10.996234 10411 ts_tablet_manager.cc:1403] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.016s	user 0.004s	sys 0.007s
I20260709 13:04:10.999328 10411 raft_consensus.cc:359] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.009166 10410 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.001408 10409 tablet_bootstrap.cc:654] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.010728 10411 raft_consensus.cc:385] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.011032 10410 ts_tablet_manager.cc:1403] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.000s
I20260709 13:04:11.011171 10411 raft_consensus.cc:740] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.012118 10411 consensus_queue.cc:260] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.015158 10410 raft_consensus.cc:359] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.015884 10409 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.016067 10410 raft_consensus.cc:385] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.016522 10410 raft_consensus.cc:740] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.016628 10409 ts_tablet_manager.cc:1403] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.007s
I20260709 13:04:11.017407 10410 consensus_queue.cc:260] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.020328 10409 raft_consensus.cc:359] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.021351 10409 raft_consensus.cc:385] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.021720 10409 raft_consensus.cc:740] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.022109 10245 heartbeater.cc:499] Master 127.0.107.254:42665 was elected leader, sending a full tablet report...
I20260709 13:04:11.022486 10410 ts_tablet_manager.cc:1434] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:04:11.022848 10409 consensus_queue.cc:260] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.023654 10410 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.025431 10409 ts_tablet_manager.cc:1434] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:04:11.025457 10394 heartbeater.cc:499] Master 127.0.107.254:42665 was elected leader, sending a full tablet report...
I20260709 13:04:11.026563 10409 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.026697 10411 ts_tablet_manager.cc:1434] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.010s
I20260709 13:04:11.027923 10411 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.029785 10410 tablet_bootstrap.cc:654] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.034569 10411 tablet_bootstrap.cc:654] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.034749 10409 tablet_bootstrap.cc:654] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.045734 10411 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.045866 10410 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.046416 10411 ts_tablet_manager.cc:1403] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.011s
I20260709 13:04:11.046780 10410 ts_tablet_manager.cc:1403] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.010s
I20260709 13:04:11.049993 10411 raft_consensus.cc:359] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.050905 10410 raft_consensus.cc:359] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.052480 10410 raft_consensus.cc:385] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.052943 10410 raft_consensus.cc:740] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.050946 10411 raft_consensus.cc:385] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.053951 10411 raft_consensus.cc:740] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.055065 10411 consensus_queue.cc:260] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.057101 10411 ts_tablet_manager.cc:1434] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:11.057245 10409 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.056813 10410 consensus_queue.cc:260] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.057842 10409 ts_tablet_manager.cc:1403] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.016s
I20260709 13:04:11.058296 10411 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.060166 10410 ts_tablet_manager.cc:1434] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:04:11.061332 10410 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.060994 10409 raft_consensus.cc:359] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.061925 10409 raft_consensus.cc:385] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.062300 10409 raft_consensus.cc:740] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.063122 10409 consensus_queue.cc:260] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.065227 10411 tablet_bootstrap.cc:654] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.065828 10409 ts_tablet_manager.cc:1434] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:11.066978 10409 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.068586 10410 tablet_bootstrap.cc:654] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.074503 10409 tablet_bootstrap.cc:654] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.076848 10411 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.077509 10411 ts_tablet_manager.cc:1403] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:04:11.081619 10411 raft_consensus.cc:359] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.083993 10411 raft_consensus.cc:385] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.084362 10411 raft_consensus.cc:740] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.085309 10411 consensus_queue.cc:260] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.086539 10410 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.087374 10410 ts_tablet_manager.cc:1403] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 13:04:11.087953 10411 ts_tablet_manager.cc:1434] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:11.089092 10411 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.091423 10410 raft_consensus.cc:359] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.092502 10410 raft_consensus.cc:385] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.092947 10410 raft_consensus.cc:740] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.094161 10410 consensus_queue.cc:260] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.095709 10411 tablet_bootstrap.cc:654] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.097988 10410 ts_tablet_manager.cc:1434] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:11.099356 10410 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.101336 10409 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.101938 10409 ts_tablet_manager.cc:1403] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.012s
I20260709 13:04:11.104857 10409 raft_consensus.cc:359] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.105674 10409 raft_consensus.cc:385] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.106046 10409 raft_consensus.cc:740] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.105319 10410 tablet_bootstrap.cc:654] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.109867 10409 consensus_queue.cc:260] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.113535 10411 tablet_bootstrap.cc:492] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.114148 10411 ts_tablet_manager.cc:1403] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:04:11.116214 10410 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.116761 10410 ts_tablet_manager.cc:1403] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 13:04:11.117156 10411 raft_consensus.cc:359] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.117954 10411 raft_consensus.cc:385] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.118251 10411 raft_consensus.cc:740] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.119048 10411 consensus_queue.cc:260] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.119413 10410 raft_consensus.cc:359] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.120136 10410 raft_consensus.cc:385] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.120464 10410 raft_consensus.cc:740] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.121162 10410 consensus_queue.cc:260] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.123049 10413 raft_consensus.cc:493] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.123431 10410 ts_tablet_manager.cc:1434] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:11.121443 10411 ts_tablet_manager.cc:1434] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:11.123510 10409 ts_tablet_manager.cc:1434] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:04:11.123579 10413 raft_consensus.cc:515] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.124709 10411 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.124787 10409 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.129166 10410 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.132072 10409 tablet_bootstrap.cc:654] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.136154 10410 tablet_bootstrap.cc:654] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.149523 10418 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.150354 10418 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.157678 10418 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.148428 10413 leader_election.cc:290] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.168069 10411 tablet_bootstrap.cc:654] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.193554 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
W20260709 13:04:11.197487 10260 leader_election.cc:343] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.203404 10417 raft_consensus.cc:493] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.203994 10417 raft_consensus.cc:515] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.204660 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.205361 10369 raft_consensus.cc:2468] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.206852 10259 leader_election.cc:304] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.209264 10417 leader_election.cc:290] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.219913 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
W20260709 13:04:11.221376 10186 leader_election.cc:343] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.212383 10411 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.213668 10413 raft_consensus.cc:2804] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.222164 10413 raft_consensus.cc:493] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.222424 10413 raft_consensus.cc:3060] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.223027 10411 ts_tablet_manager.cc:1403] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.005s
I20260709 13:04:11.223371 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
W20260709 13:04:11.225566 10184 leader_election.cc:343] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.216393 10409 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.227010 10409 ts_tablet_manager.cc:1403] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.102s	user 0.038s	sys 0.032s
I20260709 13:04:11.215785 10410 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.226193 10184 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.227960 10410 ts_tablet_manager.cc:1403] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.027s
I20260709 13:04:11.228574 10418 raft_consensus.cc:2749] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.231122 10410 raft_consensus.cc:359] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.231897 10410 raft_consensus.cc:385] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.232010 10413 raft_consensus.cc:515] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.232299 10410 raft_consensus.cc:740] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.232187 10409 raft_consensus.cc:359] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.234838 10409 raft_consensus.cc:385] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.234550 10410 consensus_queue.cc:260] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.236140 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.236459 10413 leader_election.cc:290] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.235221 10409 raft_consensus.cc:740] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.226459 10411 raft_consensus.cc:359] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:11.237673 10260 leader_election.cc:343] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.237905 10411 raft_consensus.cc:385] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.238258 10411 raft_consensus.cc:740] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.237699 10409 consensus_queue.cc:260] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.240970 10409 ts_tablet_manager.cc:1434] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:11.240233 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.243245 10369 raft_consensus.cc:3060] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:11.244396 10166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:11.244918 10409 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.248304 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.249320 10295 raft_consensus.cc:2393] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:11.249855 10418 raft_consensus.cc:493] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.250406 10418 raft_consensus.cc:515] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.250982 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.239220 10411 consensus_queue.cc:260] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.253153 10409 tablet_bootstrap.cc:654] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.253480 10334 leader_election.cc:343] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.254045 10334 leader_election.cc:304] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.256208 10410 ts_tablet_manager.cc:1434] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.028s	user 0.000s	sys 0.008s
I20260709 13:04:11.256072 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da1181467ed4c8b99957cd060be2268" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.257448 10368 raft_consensus.cc:2468] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:11.256855 10411 ts_tablet_manager.cc:1434] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:04:11.259697 10411 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.262272 10184 leader_election.cc:304] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:11.262255 10410 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.263518 10413 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.264490 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da1181467ed4c8b99957cd060be2268" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.264603 10413 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.252656 10418 leader_election.cc:290] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.266667 10418 raft_consensus.cc:493] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.267190 10418 raft_consensus.cc:515] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.269438 10418 leader_election.cc:290] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.273840 10418 raft_consensus.cc:2804] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.278519 10418 raft_consensus.cc:493] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.280320 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.281320 10411 tablet_bootstrap.cc:654] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:11.282585 10259 leader_election.cc:343] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.265184 10295 raft_consensus.cc:2468] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:11.279834 10418 raft_consensus.cc:3060] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.286361 10427 raft_consensus.cc:493] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.286798 10410 tablet_bootstrap.cc:654] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.287066 10427 raft_consensus.cc:515] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.289289 10427 leader_election.cc:290] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.286279 10413 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.291440 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.292160 10368 raft_consensus.cc:2468] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.292305 10409 tablet_bootstrap.cc:492] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.293357 10409 ts_tablet_manager.cc:1403] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.022s
I20260709 13:04:11.293299 10259 leader_election.cc:304] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.294381 10413 raft_consensus.cc:2804] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.294790 10413 raft_consensus.cc:493] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.295132 10413 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.296679 10409 raft_consensus.cc:359] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.297222 10410 tablet_bootstrap.cc:492] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.297451 10409 raft_consensus.cc:385] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.296890 10418 raft_consensus.cc:515] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.297876 10410 ts_tablet_manager.cc:1403] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260709 13:04:11.297874 10409 raft_consensus.cc:740] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.299072 10409 consensus_queue.cc:260] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.299537 10418 leader_election.cc:290] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.301786 10410 raft_consensus.cc:359] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.272034 10369 raft_consensus.cc:2468] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.304958 10409 ts_tablet_manager.cc:1434] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:11.305227 10417 raft_consensus.cc:2749] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.306161 10409 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.302994 10410 raft_consensus.cc:385] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.308303 10259 leader_election.cc:304] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.309835 10413 raft_consensus.cc:515] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.319043 10411 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.319644 10411 ts_tablet_manager.cc:1403] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.019s
W20260709 13:04:11.312281 10184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:39243, user_credentials={real_user=slave}} blocked reactor thread for 50089.7us
I20260709 13:04:11.313751 10409 tablet_bootstrap.cc:654] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.315408 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.320921 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.316236 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da1181467ed4c8b99957cd060be2268" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.321568 10369 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.321647 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.321915 10294 raft_consensus.cc:3060] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:11.321966 10186 leader_election.cc:343] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.322427 10220 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.323485 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.323792 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.324000 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.324631 10410 raft_consensus.cc:740] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.324150 10413 leader_election.cc:290] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.325203 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da1181467ed4c8b99957cd060be2268" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.325639 10260 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.325851 10367 raft_consensus.cc:3060] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.317958 10427 raft_consensus.cc:2804] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.327539 10413 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.327975 10413 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.328325 10413 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:11.330726 10184 leader_election.cc:343] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.331365 10184 leader_election.cc:304] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.332401 10439 raft_consensus.cc:2749] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.334637 10411 raft_consensus.cc:359] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.335171 10367 raft_consensus.cc:2468] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:11.325878 10410 consensus_queue.cc:260] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.336052 10427 raft_consensus.cc:697] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.337698 10220 raft_consensus.cc:2468] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.335249 10294 raft_consensus.cc:2468] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:11.337771 10411 raft_consensus.cc:385] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.339210 10184 leader_election.cc:304] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:11.338111 10427 consensus_queue.cc:237] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.341586 10413 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.344558 10410 ts_tablet_manager.cc:1434] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.005s
I20260709 13:04:11.344978 10413 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.345733 10410 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.345647 10439 raft_consensus.cc:2804] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.346866 10439 raft_consensus.cc:697] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:11.340433 10411 raft_consensus.cc:740] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.347705 10439 consensus_queue.cc:237] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.347787 10411 consensus_queue.cc:260] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.348735 10409 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.348861 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.349331 10409 ts_tablet_manager.cc:1403] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:04:11.349963 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.342321 10369 raft_consensus.cc:2468] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.350548 10220 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.352640 10409 raft_consensus.cc:359] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.353434 10409 raft_consensus.cc:385] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.353734 10409 raft_consensus.cc:740] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.354691 10409 consensus_queue.cc:260] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:11.355391 10259 leader_election.cc:343] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.356263 10259 leader_election.cc:304] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.357165 10411 ts_tablet_manager.cc:1434] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:04:11.357630 10413 raft_consensus.cc:2804] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.358698 10413 raft_consensus.cc:697] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.359501 10413 consensus_queue.cc:237] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.365108 10411 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.365557 10409 ts_tablet_manager.cc:1434] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:04:11.364992 10220 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.366734 10409 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.368085 10260 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.369549 10444 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.384682 10115 catalog_manager.cc:5697] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.388137 10411 tablet_bootstrap.cc:654] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.389918 10410 tablet_bootstrap.cc:654] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.397365 10409 tablet_bootstrap.cc:654] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.398888 10444 raft_consensus.cc:697] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.400920 10439 raft_consensus.cc:493] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.400655 10444 consensus_queue.cc:237] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.401276 10118 catalog_manager.cc:5697] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.401880 10439 raft_consensus.cc:515] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.405337 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.406195 10294 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:11.406911 10439 leader_election.cc:290] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.410689 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.411587 10369 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:11.411821 10439 raft_consensus.cc:493] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.412326 10439 raft_consensus.cc:515] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.409672 10186 leader_election.cc:304] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.413906 10441 raft_consensus.cc:2804] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.414305 10441 raft_consensus.cc:493] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.414814 10441 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.421765 10439 leader_election.cc:290] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.422472 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.424021 10411 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.424582 10411 ts_tablet_manager.cc:1403] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.018s
I20260709 13:04:11.425423 10441 raft_consensus.cc:515] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.423862 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.428301 10411 raft_consensus.cc:359] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:11.428586 10184 leader_election.cc:343] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.429118 10411 raft_consensus.cc:385] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.429538 10411 raft_consensus.cc:740] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.429904 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.430153 10411 consensus_queue.cc:260] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.430536 10295 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.431067 10410 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.431593 10410 ts_tablet_manager.cc:1403] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.005s
I20260709 13:04:11.432447 10411 ts_tablet_manager.cc:1434] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:04:11.433503 10411 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.433957 10449 raft_consensus.cc:493] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.434535 10449 raft_consensus.cc:515] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.434988 10410 raft_consensus.cc:359] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.435683 10294 raft_consensus.cc:2468] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:11.435837 10410 raft_consensus.cc:385] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.436321 10410 raft_consensus.cc:740] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.437245 10410 consensus_queue.cc:260] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.439016 10186 leader_election.cc:304] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.439706 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.440021 10410 ts_tablet_manager.cc:1434] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:04:11.440261 10439 raft_consensus.cc:2804] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.440668 10439 raft_consensus.cc:493] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.440701 10411 tablet_bootstrap.cc:654] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.441139 10439 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.441146 10410 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.441735 10417 raft_consensus.cc:493] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.442432 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.442229 10417 raft_consensus.cc:515] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:11.443938 10259 leader_election.cc:343] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.444525 10417 leader_election.cc:290] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.445400 10418 raft_consensus.cc:493] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.445906 10418 raft_consensus.cc:515] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.446178 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.446870 10219 raft_consensus.cc:2468] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 0.
I20260709 13:04:11.447999 10418 leader_election.cc:290] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.444578 10449 leader_election.cc:290] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.449113 10334 leader_election.cc:304] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:11.450344 10417 raft_consensus.cc:2804] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.450760 10417 raft_consensus.cc:493] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.451128 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.451541 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.452008 10410 tablet_bootstrap.cc:654] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.451121 10417 raft_consensus.cc:3060] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.452476 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
W20260709 13:04:11.454221 10335 leader_election.cc:343] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.458847 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
W20260709 13:04:11.459233 10186 leader_election.cc:343] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.459753 10367 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.461575 10417 raft_consensus.cc:515] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.462936 10369 raft_consensus.cc:2393] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:11.463572 10410 tablet_bootstrap.cc:492] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.463945 10417 leader_election.cc:290] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.464108 10410 ts_tablet_manager.cc:1403] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:04:11.465317 10184 leader_election.cc:304] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.466435 10418 raft_consensus.cc:3060] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.467067 10449 raft_consensus.cc:493] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.467561 10449 raft_consensus.cc:515] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.469049 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.470441 10449 leader_election.cc:290] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
W20260709 13:04:11.471343 10335 leader_election.cc:343] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.471915 10441 leader_election.cc:290] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.472838 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.473532 10418 raft_consensus.cc:2749] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.473598 10369 raft_consensus.cc:2468] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.475481 10411 tablet_bootstrap.cc:492] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.475245 10410 raft_consensus.cc:359] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.475869 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.475987 10411 ts_tablet_manager.cc:1403] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 13:04:11.475988 10410 raft_consensus.cc:385] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.476080 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.476689 10410 raft_consensus.cc:740] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.477268 10259 leader_election.cc:304] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.477525 10410 consensus_queue.cc:260] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:11.478494 10260 leader_election.cc:343] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.479676 10449 raft_consensus.cc:2804] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.479938 10410 ts_tablet_manager.cc:1434] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:11.480260 10449 raft_consensus.cc:493] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.480782 10449 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.481040 10410 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:11.483978 10218 raft_consensus.cc:2468] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 1.
I20260709 13:04:11.486405 10409 tablet_bootstrap.cc:492] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.487175 10409 ts_tablet_manager.cc:1403] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.012s
I20260709 13:04:11.486377 10417 raft_consensus.cc:493] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.487782 10367 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:11.487907 10417 raft_consensus.cc:515] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.489079 10184 leader_election.cc:304] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:11.489120 10449 raft_consensus.cc:515] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.490026 10418 raft_consensus.cc:2804] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.489956 10409 raft_consensus.cc:359] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.490607 10418 raft_consensus.cc:697] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:11.490819 10409 raft_consensus.cc:385] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.491118 10409 raft_consensus.cc:740] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.491521 10418 consensus_queue.cc:237] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.491811 10409 consensus_queue.cc:260] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.492877 10411 raft_consensus.cc:359] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.493556 10411 raft_consensus.cc:385] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.493834 10411 raft_consensus.cc:740] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.494138 10409 ts_tablet_manager.cc:1434] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:11.495193 10409 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:11.495741 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.496624 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.497400 10294 raft_consensus.cc:2393] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
W20260709 13:04:11.497437 10334 leader_election.cc:343] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.495627 10417 leader_election.cc:290] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.498796 10335 leader_election.cc:304] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.495311 10411 consensus_queue.cc:260] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.501732 10417 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.500886 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.503047 10449 leader_election.cc:290] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.501919 10334 leader_election.cc:304] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.503077 10295 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
W20260709 13:04:11.504451 10260 leader_election.cc:343] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.501051 10410 tablet_bootstrap.cc:654] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.504696 10460 raft_consensus.cc:2804] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.505237 10460 raft_consensus.cc:697] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:11.506264 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.486708 10439 raft_consensus.cc:515] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.508140 10411 ts_tablet_manager.cc:1434] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:04:11.509240 10220 raft_consensus.cc:2393] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f098e27608234644a1b6db69669b56aa in current term 1: Already voted for candidate 42d00e433fe04ce580a148a86dcf281b in this term.
I20260709 13:04:11.509475 10411 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:11.513720 10439 leader_election.cc:290] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.514883 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.516043 10295 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.515758 10260 leader_election.cc:304] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.516933 10409 tablet_bootstrap.cc:654] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.506102 10460 consensus_queue.cc:237] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.524446 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.524652 10411 tablet_bootstrap.cc:654] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:11.525671 10295 raft_consensus.cc:2468] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
W20260709 13:04:11.525914 10184 leader_election.cc:343] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:11.526302 10449 raft_consensus.cc:2749] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.527094 10186 leader_election.cc:304] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.528174 10439 raft_consensus.cc:2804] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.528633 10439 raft_consensus.cc:697] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:11.529460 10439 consensus_queue.cc:237] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.531932 10417 raft_consensus.cc:2749] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.541985 10410 tablet_bootstrap.cc:492] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:11.542560 10410 ts_tablet_manager.cc:1403] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.009s
I20260709 13:04:11.545516 10410 raft_consensus.cc:359] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.546161 10410 raft_consensus.cc:385] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.546433 10410 raft_consensus.cc:740] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.550910 10410 consensus_queue.cc:260] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.551482 10409 tablet_bootstrap.cc:492] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:11.552260 10409 ts_tablet_manager.cc:1403] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.005s
I20260709 13:04:11.552958 10410 ts_tablet_manager.cc:1434] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:04:11.554701 10409 raft_consensus.cc:359] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.555284 10409 raft_consensus.cc:385] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.555596 10411 tablet_bootstrap.cc:492] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:11.555454 10409 raft_consensus.cc:740] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.556126 10411 ts_tablet_manager.cc:1403] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 13:04:11.556439 10409 consensus_queue.cc:260] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.557190 10367 raft_consensus.cc:2468] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.558717 10409 ts_tablet_manager.cc:1434] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:11.559180 10259 leader_election.cc:304] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.559059 10411 raft_consensus.cc:359] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.559808 10411 raft_consensus.cc:385] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:11.560050 10449 raft_consensus.cc:2804] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.560199 10411 raft_consensus.cc:740] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:11.560670 10449 raft_consensus.cc:697] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.561072 10411 consensus_queue.cc:260] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.561401 10449 consensus_queue.cc:237] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.563154 10411 ts_tablet_manager.cc:1434] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:11.570231 10116 catalog_manager.cc:5697] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:11.580091 10115 catalog_manager.cc:5697] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.581748 10115 catalog_manager.cc:5697] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.586215 10439 raft_consensus.cc:493] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.586769 10439 raft_consensus.cc:515] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.588647 10439 leader_election.cc:290] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.589253 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.589612 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.590396 10367 raft_consensus.cc:2393] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:11.591413 10184 leader_election.cc:304] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.592304 10439 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.594494 10117 catalog_manager.cc:5697] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.595989 10117 catalog_manager.cc:5697] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.599552 10439 raft_consensus.cc:2749] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.602524 10449 raft_consensus.cc:493] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.603124 10449 raft_consensus.cc:515] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.605687 10449 leader_election.cc:290] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.606082 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.606429 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.606825 10220 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.607100 10367 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:11.608180 10260 leader_election.cc:304] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.608981 10449 raft_consensus.cc:2804] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:11.609366 10449 raft_consensus.cc:493] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.609683 10449 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.609478 10115 catalog_manager.cc:5697] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.615676 10449 raft_consensus.cc:515] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.618040 10449 leader_election.cc:290] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.618544 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.618597 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.619591 10220 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.619621 10367 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.627030 10220 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.627027 10367 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:11.628423 10259 leader_election.cc:304] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.629241 10449 raft_consensus.cc:2804] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:11.629755 10449 raft_consensus.cc:697] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.630455 10449 consensus_queue.cc:237] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.637988 10115 catalog_manager.cc:5697] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.680797 10439 raft_consensus.cc:493] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.681289 10439 raft_consensus.cc:515] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.683131 10439 leader_election.cc:290] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.683677 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.684144 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7420363ee2eb409ab03d230170f75f6a" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.684816 10367 raft_consensus.cc:2393] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:11.685658 10184 leader_election.cc:304] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.686362 10439 raft_consensus.cc:3060] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.691190 10439 raft_consensus.cc:2749] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.758051 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf8e615842634124997ca8211901f400"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:11.758719 10295 raft_consensus.cc:606] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.763835 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:11.764349 10295 raft_consensus.cc:606] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.772269 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:11.772799 10295 raft_consensus.cc:606] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:11.788012 10220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54dfba76264541fdbf057a630b483873"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:44374
I20260709 13:04:11.788519 10220 raft_consensus.cc:606] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Received request to transfer leadership to TS f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.793603 10367 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.797015 10220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:44374
I20260709 13:04:11.797719 10220 raft_consensus.cc:606] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Received request to transfer leadership to TS f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.800576 10417 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.801249 10417 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.801568 10449 consensus_queue.cc:1048] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.805183 10417 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.806768 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.807091 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.807823 10220 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 1.
I20260709 13:04:11.808888 10439 consensus_queue.cc:1048] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.811373 10334 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.813006 10417 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:11.813419 10417 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader f098e27608234644a1b6db69669b56aa)
I20260709 13:04:11.813853 10417 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.814420 10449 consensus_queue.cc:1048] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.818207 10460 raft_consensus.cc:493] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.818718 10460 raft_consensus.cc:515] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.821514 10460 leader_election.cc:290] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.822496 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:11.823446 10295 raft_consensus.cc:2393] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate 42d00e433fe04ce580a148a86dcf281b in this term.
I20260709 13:04:11.822537 10220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.826481 10334 leader_election.cc:304] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.827462 10460 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.830837 10444 consensus_queue.cc:1048] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.835429 10444 raft_consensus.cc:493] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.835949 10444 raft_consensus.cc:515] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.837237 10460 raft_consensus.cc:2749] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.839567 10218 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.843240 10444 leader_election.cc:290] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.843577 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:11.844455 10217 raft_consensus.cc:2393] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f098e27608234644a1b6db69669b56aa in current term 1: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:11.847642 10417 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.848874 10369 raft_consensus.cc:1240] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Rejecting Update request from peer f098e27608234644a1b6db69669b56aa for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:11.850064 10417 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:11.851449 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9bce3c0627744739bc72425c6f14c6f" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:11.851938 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.853925 10427 consensus_queue.cc:1059] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.855413 10444 raft_consensus.cc:3055] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.855950 10444 raft_consensus.cc:740] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.857223 10444 consensus_queue.cc:260] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.859112 10259 leader_election.cc:304] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:11.863787 10427 raft_consensus.cc:3060] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:11.867038 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.868043 10413 consensus_queue.cc:1048] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.869597 10444 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.875219 10334 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:11.876446 10460 raft_consensus.cc:2749] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:11.881318 10439 consensus_queue.cc:1048] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.889441 10427 raft_consensus.cc:2749] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:11.891434 10449 consensus_queue.cc:1048] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:11.898525 10480 consensus_queue.cc:1048] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.910359 10444 raft_consensus.cc:993] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:11.910887 10480 raft_consensus.cc:1081] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:11.912413 10218 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf8e615842634124997ca8211901f400"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44364
I20260709 13:04:11.912907 10218 raft_consensus.cc:493] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.913334 10218 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.918596 10218 raft_consensus.cc:515] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.920464 10218 leader_election.cc:290] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.921377 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:11.921691 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8e615842634124997ca8211901f400" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.922037 10295 raft_consensus.cc:3055] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.922390 10369 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.922479 10295 raft_consensus.cc:740] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.923574 10295 consensus_queue.cc:260] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.924572 10295 raft_consensus.cc:3060] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.929934 10295 raft_consensus.cc:2468] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:11.930085 10369 raft_consensus.cc:2468] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:11.931092 10186 leader_election.cc:304] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.932291 10418 raft_consensus.cc:2804] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.932766 10418 raft_consensus.cc:697] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:11.933583 10418 consensus_queue.cc:237] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.934839 10439 consensus_queue.cc:1048] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.941439 10115 catalog_manager.cc:5697] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.947206 10418 consensus_queue.cc:1048] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.957232 10418 raft_consensus.cc:993] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:11.957729 10418 raft_consensus.cc:1081] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Signalling peer f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:11.959451 10439 consensus_queue.cc:1048] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.959591 10295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:36420
I20260709 13:04:11.960453 10295 raft_consensus.cc:493] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.960857 10295 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.968314 10441 raft_consensus.cc:993] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:11.968123 10295 raft_consensus.cc:515] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.968938 10441 raft_consensus.cc:1081] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Signalling peer f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:11.972091 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:11.972772 10218 raft_consensus.cc:3055] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.973122 10218 raft_consensus.cc:740] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:11.973922 10295 leader_election.cc:290] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.973996 10218 consensus_queue.cc:260] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.975531 10218 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.975450 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f22af50d2b3b4b819f11f59036321bd5" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:11.976251 10369 raft_consensus.cc:3060] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.979218 10417 consensus_queue.cc:1048] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.979256 10439 consensus_queue.cc:1048] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:11.980391 10294 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54dfba76264541fdbf057a630b483873"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:36420
I20260709 13:04:11.980981 10294 raft_consensus.cc:493] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.981390 10294 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.984062 10369 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:11.985775 10259 leader_election.cc:304] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:11.986744 10480 raft_consensus.cc:2804] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.987262 10480 raft_consensus.cc:697] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:11.988148 10480 consensus_queue.cc:237] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.988590 10218 raft_consensus.cc:2468] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:11.995926 10294 raft_consensus.cc:515] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:11.998021 10417 consensus_queue.cc:1048] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:11.998968 10294 leader_election.cc:290] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:11.999684 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:12.000306 10367 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.001289 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54dfba76264541fdbf057a630b483873" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:12.001909 10218 raft_consensus.cc:3055] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.002264 10218 raft_consensus.cc:740] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:12.003819 10218 consensus_queue.cc:260] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.005671 10218 raft_consensus.cc:3060] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.008766 10367 raft_consensus.cc:2468] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:12.009873 10259 leader_election.cc:304] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:12.010799 10480 raft_consensus.cc:2804] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.011289 10480 raft_consensus.cc:697] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:12.011270 10115 catalog_manager.cc:5697] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 1 to 2, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.012707 10480 consensus_queue.cc:237] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.015332 10218 raft_consensus.cc:2468] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:12.020840 10480 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.032800 10117 catalog_manager.cc:5697] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 1 to 2, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.036624 10480 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.047084 10427 raft_consensus.cc:993] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:12.047554 10427 raft_consensus.cc:1081] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:12.049304 10217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44364
I20260709 13:04:12.049789 10217 raft_consensus.cc:493] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.050153 10217 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.057562 10217 raft_consensus.cc:515] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.060083 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:12.060469 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:12.060755 10295 raft_consensus.cc:3055] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.061038 10367 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.061161 10295 raft_consensus.cc:740] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:12.062000 10295 consensus_queue.cc:260] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.062740 10217 leader_election.cc:290] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:12.062963 10295 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.067492 10367 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:12.068625 10184 leader_election.cc:304] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:12.068738 10295 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:12.069517 10439 raft_consensus.cc:2804] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.069993 10439 raft_consensus.cc:697] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:12.070756 10439 consensus_queue.cc:237] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.076831 10116 catalog_manager.cc:5697] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.096170 10480 consensus_queue.cc:1048] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.106510 10480 consensus_queue.cc:1048] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:12.114993 10427 raft_consensus.cc:993] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:12.115453 10480 raft_consensus.cc:1081] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:12.116971 10217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44364
I20260709 13:04:12.117444 10217 raft_consensus.cc:493] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:12.117743 10217 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.122573 10217 raft_consensus.cc:515] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.124259 10217 leader_election.cc:290] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:12.125274 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:12.125406 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "031fee577f9a46b9aa14554d568b46dd" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:12.125988 10295 raft_consensus.cc:3055] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:12.126077 10367 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.126390 10295 raft_consensus.cc:740] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:12.127288 10295 consensus_queue.cc:260] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.128575 10295 raft_consensus.cc:3060] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:12.131860 10367 raft_consensus.cc:2468] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:12.132931 10184 leader_election.cc:304] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:12.133666 10439 raft_consensus.cc:2804] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:12.133906 10295 raft_consensus.cc:2468] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:12.134088 10439 raft_consensus.cc:697] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:12.134997 10439 consensus_queue.cc:237] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:12.140880 10115 catalog_manager.cc:5697] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:12.387360 10295 raft_consensus.cc:1275] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.388547 10439 consensus_queue.cc:1048] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.398350 10367 raft_consensus.cc:1275] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.399995 10439 consensus_queue.cc:1048] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.425612 10217 raft_consensus.cc:1275] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.428632 10480 consensus_queue.cc:1048] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:12.446058 10367 raft_consensus.cc:1275] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.449038 10427 consensus_queue.cc:1048] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:12.484223 10367 raft_consensus.cc:1275] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.485495 10439 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.492602 10295 raft_consensus.cc:1275] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.494263 10418 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.510845 10367 raft_consensus.cc:1275] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.512056 10444 consensus_queue.cc:1048] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.521238 10217 raft_consensus.cc:1275] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.522768 10444 consensus_queue.cc:1048] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.721836 10367 raft_consensus.cc:1275] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.723203 10418 consensus_queue.cc:1048] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:12.731079 10295 raft_consensus.cc:1275] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:12.733601 10439 consensus_queue.cc:1048] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.336547 10418 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f098e27608234644a1b6db69669b56aa)
I20260709 13:04:13.337013 10418 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.338588 10418 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:13.339341 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:13.339481 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:13.339999 10295 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:13.340220 10367 raft_consensus.cc:2393] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 2: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:13.341125 10186 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:13.341853 10418 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:13.342227 10418 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election (detected failure of leader f098e27608234644a1b6db69669b56aa)
I20260709 13:04:13.342482 10418 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:13.347512 10418 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.349056 10418 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:13.350077 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:13.350160 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:13.350940 10367 raft_consensus.cc:2393] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 2: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:13.356575 10295 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:13.357901 10186 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:13.358577 10418 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:13.359030 10418 raft_consensus.cc:697] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:13.359658 10418 consensus_queue.cc:237] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.366753 10115 catalog_manager.cc:5697] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:13.400532 10461 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.401155 10461 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.403251 10461 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:13.404292 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:13.404659 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:13.405023 10295 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 2.
I20260709 13:04:13.406054 10335 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:13.406900 10461 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:13.407312 10461 raft_consensus.cc:493] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.407621 10461 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.413307 10461 raft_consensus.cc:515] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.415230 10461 leader_election.cc:290] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:13.415854 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:13.416250 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9963e3378a40fc84c508b8bf5ebbc6" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:13.416834 10295 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.421671 10295 raft_consensus.cc:2468] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 3.
I20260709 13:04:13.422536 10335 leader_election.cc:304] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:13.423272 10461 raft_consensus.cc:2804] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:13.424248 10461 raft_consensus.cc:697] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:13.425007 10461 consensus_queue.cc:237] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.432463 10115 catalog_manager.cc:5697] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 2 to 3, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:13.759986 10295 raft_consensus.cc:1240] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Rejecting Update request from peer 42d00e433fe04ce580a148a86dcf281b for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:13.761356 10418 consensus_queue.cc:1059] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.762068 10441 raft_consensus.cc:3055] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:13.762563 10441 raft_consensus.cc:740] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:13.763347 10441 consensus_queue.cc:260] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:13.764268 10441 raft_consensus.cc:3060] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:13.892174 10295 raft_consensus.cc:1275] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:13.893630 10461 consensus_queue.cc:1048] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:13.905194 10217 raft_consensus.cc:1275] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:04:13.905929 10217 pending_rounds.cc:85] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Aborting all ops after (but not including) 1
I20260709 13:04:13.906193 10217 pending_rounds.cc:107] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:04:13.906453 10217 raft_consensus.cc:2889] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:13.908147 10461 consensus_queue.cc:1048] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:14.841400 10115 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53616:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:14.846114 10115 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:14.910763 10206 tablet_service.cc:1511] Processing CreateTablet for tablet ba54f163134a4a16be45e65928c15958 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.912117 10277 tablet_service.cc:1511] Processing CreateTablet for tablet ba54f163134a4a16be45e65928c15958 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.912954 10206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba54f163134a4a16be45e65928c15958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.914183 10277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba54f163134a4a16be45e65928c15958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.916440 10354 tablet_service.cc:1511] Processing CreateTablet for tablet ba54f163134a4a16be45e65928c15958 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:14.918203 10282 tablet_service.cc:1511] Processing CreateTablet for tablet 166d3bd751364091b22d95b017795885 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:14.919723 10282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166d3bd751364091b22d95b017795885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.919411 10353 tablet_service.cc:1511] Processing CreateTablet for tablet 166d3bd751364091b22d95b017795885 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:14.922925 10209 tablet_service.cc:1511] Processing CreateTablet for tablet 166d3bd751364091b22d95b017795885 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:14.923862 10285 tablet_service.cc:1511] Processing CreateTablet for tablet 383670c920be4d5fa86cea3298d31445 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:14.924414 10209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166d3bd751364091b22d95b017795885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.925289 10285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383670c920be4d5fa86cea3298d31445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.927884 10359 tablet_service.cc:1511] Processing CreateTablet for tablet 383670c920be4d5fa86cea3298d31445 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:14.929850 10202 tablet_service.cc:1511] Processing CreateTablet for tablet 8470d0cb03d045d6a0e4c6e153f7ee98 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:14.931547 10202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8470d0cb03d045d6a0e4c6e153f7ee98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.927888 10203 tablet_service.cc:1511] Processing CreateTablet for tablet 383670c920be4d5fa86cea3298d31445 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:14.934077 10356 tablet_service.cc:1511] Processing CreateTablet for tablet 8470d0cb03d045d6a0e4c6e153f7ee98 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:14.935972 10203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383670c920be4d5fa86cea3298d31445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.918182 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba54f163134a4a16be45e65928c15958. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.940739 10280 tablet_service.cc:1511] Processing CreateTablet for tablet 8470d0cb03d045d6a0e4c6e153f7ee98 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:14.943011 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8470d0cb03d045d6a0e4c6e153f7ee98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.945627 10353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 166d3bd751364091b22d95b017795885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.945799 10280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8470d0cb03d045d6a0e4c6e153f7ee98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.947046 10359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 383670c920be4d5fa86cea3298d31445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.946681 10281 tablet_service.cc:1511] Processing CreateTablet for tablet e0ddddb2f9f04bf2b9f223301953d221 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:14.948128 10281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ddddb2f9f04bf2b9f223301953d221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.944209 10210 tablet_service.cc:1511] Processing CreateTablet for tablet e0ddddb2f9f04bf2b9f223301953d221 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:14.952955 10210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ddddb2f9f04bf2b9f223301953d221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.957386 10358 tablet_service.cc:1511] Processing CreateTablet for tablet e0ddddb2f9f04bf2b9f223301953d221 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:14.959040 10358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0ddddb2f9f04bf2b9f223301953d221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.968626 10204 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb683f78d64958a59794e1a79589a7 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:14.970505 10204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb683f78d64958a59794e1a79589a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.983566 10278 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb683f78d64958a59794e1a79589a7 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:14.985327 10278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb683f78d64958a59794e1a79589a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.988168 10352 tablet_service.cc:1511] Processing CreateTablet for tablet 0cdb683f78d64958a59794e1a79589a7 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:14.989645 10352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cdb683f78d64958a59794e1a79589a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.011550 10208 tablet_service.cc:1511] Processing CreateTablet for tablet 05b9530f6976439ea8ccfbfd2efa5842 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.013036 10208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b9530f6976439ea8ccfbfd2efa5842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.021939 10277 tablet_service.cc:1511] Processing CreateTablet for tablet 05b9530f6976439ea8ccfbfd2efa5842 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.024482 10277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b9530f6976439ea8ccfbfd2efa5842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.053186 10522 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.063699 10522 tablet_bootstrap.cc:654] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.072424 10523 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.078930 10202 tablet_service.cc:1511] Processing CreateTablet for tablet 75c291a253e8452fb6a9ec89542f0f77 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.080101 10202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c291a253e8452fb6a9ec89542f0f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.091393 10524 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.100114 10209 tablet_service.cc:1511] Processing CreateTablet for tablet 6d561f53cd4342b4a80acad350b5c333 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.101699 10209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d561f53cd4342b4a80acad350b5c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.117895 10278 tablet_service.cc:1511] Processing CreateTablet for tablet 75c291a253e8452fb6a9ec89542f0f77 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.118479 10280 tablet_service.cc:1511] Processing CreateTablet for tablet 6d561f53cd4342b4a80acad350b5c333 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.122532 10356 tablet_service.cc:1511] Processing CreateTablet for tablet 05b9530f6976439ea8ccfbfd2efa5842 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:15.122864 10358 tablet_service.cc:1511] Processing CreateTablet for tablet 6d561f53cd4342b4a80acad350b5c333 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:15.124078 10356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05b9530f6976439ea8ccfbfd2efa5842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.124938 10358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d561f53cd4342b4a80acad350b5c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.135010 10522 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.135483 10278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c291a253e8452fb6a9ec89542f0f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.135711 10522 ts_tablet_manager.cc:1403] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.083s	user 0.034s	sys 0.021s
I20260709 13:04:15.138521 10280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d561f53cd4342b4a80acad350b5c333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.139195 10522 raft_consensus.cc:359] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.140180 10522 raft_consensus.cc:385] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.140491 10522 raft_consensus.cc:740] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.142853 10524 tablet_bootstrap.cc:654] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.118407 10523 tablet_bootstrap.cc:654] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.148386 10522 consensus_queue.cc:260] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.148859 10354 tablet_service.cc:1511] Processing CreateTablet for tablet 75c291a253e8452fb6a9ec89542f0f77 (DEFAULT_TABLE table=soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:15.150288 10354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c291a253e8452fb6a9ec89542f0f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.166010 10522 ts_tablet_manager.cc:1434] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:04:15.171059 10523 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.175330 10523 ts_tablet_manager.cc:1403] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.003s
I20260709 13:04:15.174693 10522 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.182291 10524 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.182919 10524 ts_tablet_manager.cc:1403] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.006s
I20260709 13:04:15.185220 10523 raft_consensus.cc:359] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.185905 10523 raft_consensus.cc:385] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.186160 10523 raft_consensus.cc:740] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.186086 10524 raft_consensus.cc:359] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.187137 10524 raft_consensus.cc:385] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.187187 10523 consensus_queue.cc:260] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.190457 10522 tablet_bootstrap.cc:654] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.187542 10524 raft_consensus.cc:740] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.191992 10523 ts_tablet_manager.cc:1434] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:15.192406 10524 consensus_queue.cc:260] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.193274 10523 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.195524 10524 ts_tablet_manager.cc:1434] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:15.202912 10523 tablet_bootstrap.cc:654] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.206681 10524 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.215499 10523 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.215878 10524 tablet_bootstrap.cc:654] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.216130 10523 ts_tablet_manager.cc:1403] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.016s
I20260709 13:04:15.217109 10522 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.217661 10522 ts_tablet_manager.cc:1403] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.043s	user 0.000s	sys 0.031s
I20260709 13:04:15.220767 10522 raft_consensus.cc:359] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.219591 10523 raft_consensus.cc:359] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.221717 10522 raft_consensus.cc:385] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.221944 10523 raft_consensus.cc:385] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.222144 10522 raft_consensus.cc:740] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.222536 10523 raft_consensus.cc:740] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.223152 10522 consensus_queue.cc:260] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.223693 10523 consensus_queue.cc:260] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.225473 10522 ts_tablet_manager.cc:1434] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:15.226651 10522 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.227197 10523 ts_tablet_manager.cc:1434] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:04:15.229435 10523 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.230203 10524 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.230849 10524 ts_tablet_manager.cc:1403] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:04:15.237778 10524 raft_consensus.cc:359] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.238564 10524 raft_consensus.cc:385] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.238898 10524 raft_consensus.cc:740] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.239784 10524 consensus_queue.cc:260] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.242720 10523 tablet_bootstrap.cc:654] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.248414 10522 tablet_bootstrap.cc:654] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.253046 10524 ts_tablet_manager.cc:1434] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:04:15.254671 10524 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.265149 10523 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.265769 10523 ts_tablet_manager.cc:1403] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.018s
I20260709 13:04:15.265847 10524 tablet_bootstrap.cc:654] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.268517 10522 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.268997 10522 ts_tablet_manager.cc:1403] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.011s
I20260709 13:04:15.269415 10523 raft_consensus.cc:359] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.270464 10523 raft_consensus.cc:385] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.270980 10523 raft_consensus.cc:740] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.271790 10523 consensus_queue.cc:260] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.272168 10522 raft_consensus.cc:359] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.272871 10522 raft_consensus.cc:385] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.273183 10522 raft_consensus.cc:740] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.273245 10524 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.273849 10524 ts_tablet_manager.cc:1403] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:04:15.274326 10523 ts_tablet_manager.cc:1434] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.002s
I20260709 13:04:15.273983 10522 consensus_queue.cc:260] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.275730 10523 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.276615 10522 ts_tablet_manager.cc:1434] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:15.277711 10522 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.281303 10524 raft_consensus.cc:359] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.282121 10524 raft_consensus.cc:385] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.282475 10524 raft_consensus.cc:740] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.284011 10523 tablet_bootstrap.cc:654] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.284446 10522 tablet_bootstrap.cc:654] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.283485 10524 consensus_queue.cc:260] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:15.284571 10166 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:15.289390 10524 ts_tablet_manager.cc:1434] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 13:04:15.290545 10524 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.290596 10522 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.291204 10522 ts_tablet_manager.cc:1403] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:04:15.294149 10522 raft_consensus.cc:359] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.294974 10522 raft_consensus.cc:385] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.295383 10522 raft_consensus.cc:740] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.296303 10522 consensus_queue.cc:260] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.298945 10522 ts_tablet_manager.cc:1434] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:15.300192 10522 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.302136 10524 tablet_bootstrap.cc:654] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.305135 10523 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.305660 10523 ts_tablet_manager.cc:1403] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:04:15.307739 10522 tablet_bootstrap.cc:654] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.308790 10523 raft_consensus.cc:359] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.310086 10523 raft_consensus.cc:385] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.310379 10523 raft_consensus.cc:740] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.311364 10523 consensus_queue.cc:260] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.313753 10523 ts_tablet_manager.cc:1434] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:15.315876 10523 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.318683 10524 tablet_bootstrap.cc:492] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.319604 10524 ts_tablet_manager.cc:1403] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.000s
I20260709 13:04:15.322688 10523 tablet_bootstrap.cc:654] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.324119 10524 raft_consensus.cc:359] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.326535 10524 raft_consensus.cc:385] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.326928 10524 raft_consensus.cc:740] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.328006 10522 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.327764 10524 consensus_queue.cc:260] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.328594 10522 ts_tablet_manager.cc:1403] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.013s
I20260709 13:04:15.330753 10524 ts_tablet_manager.cc:1434] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:15.332399 10524 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.332682 10522 raft_consensus.cc:359] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.333614 10522 raft_consensus.cc:385] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.333911 10522 raft_consensus.cc:740] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.334693 10522 consensus_queue.cc:260] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.337158 10522 ts_tablet_manager.cc:1434] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:15.338204 10522 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.340631 10523 tablet_bootstrap.cc:492] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.341171 10523 ts_tablet_manager.cc:1403] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.009s
I20260709 13:04:15.344231 10523 raft_consensus.cc:359] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.344772 10522 tablet_bootstrap.cc:654] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.345009 10523 raft_consensus.cc:385] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.345394 10523 raft_consensus.cc:740] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.346217 10523 consensus_queue.cc:260] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.349474 10524 tablet_bootstrap.cc:654] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.351015 10523 ts_tablet_manager.cc:1434] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.008s
I20260709 13:04:15.352259 10523 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.358987 10523 tablet_bootstrap.cc:654] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.360155 10510 raft_consensus.cc:493] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.360857 10510 raft_consensus.cc:515] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.364136 10522 tablet_bootstrap.cc:492] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.364941 10522 ts_tablet_manager.cc:1403] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:04:15.365322 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.369459 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.370328 10367 raft_consensus.cc:2468] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
W20260709 13:04:15.369524 10260 leader_election.cc:343] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.369565 10510 leader_election.cc:290] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.369407 10522 raft_consensus.cc:359] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.372815 10522 raft_consensus.cc:385] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.373184 10522 raft_consensus.cc:740] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.374330 10522 consensus_queue.cc:260] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.375372 10259 leader_election.cc:304] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:15.380123 10522 ts_tablet_manager.cc:1434] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:04:15.380167 10524 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.380970 10524 ts_tablet_manager.cc:1403] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.006s
I20260709 13:04:15.380903 10510 raft_consensus.cc:2804] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.381397 10522 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.381745 10510 raft_consensus.cc:493] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.382180 10510 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.388329 10522 tablet_bootstrap.cc:654] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.391330 10526 raft_consensus.cc:493] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.391842 10526 raft_consensus.cc:515] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.393606 10523 tablet_bootstrap.cc:492] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.396559 10526 leader_election.cc:290] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.395872 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba54f163134a4a16be45e65928c15958" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.399477 10523 ts_tablet_manager.cc:1403] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.030s
W20260709 13:04:15.400902 10184 leader_election.cc:343] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.397351 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba54f163134a4a16be45e65928c15958" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.401829 10510 raft_consensus.cc:515] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.401955 10295 raft_consensus.cc:2468] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.402721 10523 raft_consensus.cc:359] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.398525 10524 raft_consensus.cc:359] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.403615 10523 raft_consensus.cc:385] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.403774 10524 raft_consensus.cc:385] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.404006 10523 raft_consensus.cc:740] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.404035 10186 leader_election.cc:304] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:15.404306 10524 raft_consensus.cc:740] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.404956 10523 consensus_queue.cc:260] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.405896 10526 raft_consensus.cc:2804] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.406383 10526 raft_consensus.cc:493] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.406736 10526 raft_consensus.cc:3060] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.407624 10523 ts_tablet_manager.cc:1434] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:15.412843 10510 leader_election.cc:290] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.413015 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.414454 10523 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.414687 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
W20260709 13:04:15.414953 10260 leader_election.cc:343] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.415602 10367 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.417328 10526 raft_consensus.cc:515] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.420853 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba54f163134a4a16be45e65928c15958" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.421491 10295 raft_consensus.cc:3060] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.425933 10522 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.426596 10522 ts_tablet_manager.cc:1403] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.001s
I20260709 13:04:15.428295 10523 tablet_bootstrap.cc:654] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.430043 10295 raft_consensus.cc:2468] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:15.430188 10526 leader_election.cc:290] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.430542 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba54f163134a4a16be45e65928c15958" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.431257 10369 raft_consensus.cc:3060] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.430068 10522 raft_consensus.cc:359] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.405814 10524 consensus_queue.cc:260] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.431757 10522 raft_consensus.cc:385] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.432152 10522 raft_consensus.cc:740] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.433037 10522 consensus_queue.cc:260] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.435428 10367 raft_consensus.cc:2468] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.435921 10524 ts_tablet_manager.cc:1434] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:04:15.437178 10524 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.437073 10259 leader_election.cc:304] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:15.438542 10522 ts_tablet_manager.cc:1434] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:04:15.439759 10522 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.440210 10186 leader_election.cc:304] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.441334 10418 raft_consensus.cc:2804] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.441421 10510 raft_consensus.cc:2804] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.441906 10418 raft_consensus.cc:697] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:15.446446 10524 tablet_bootstrap.cc:654] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.449361 10522 tablet_bootstrap.cc:654] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.449491 10523 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.450348 10523 ts_tablet_manager.cc:1403] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.006s
I20260709 13:04:15.447657 10418 consensus_queue.cc:237] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.454226 10510 raft_consensus.cc:697] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:15.455564 10510 consensus_queue.cc:237] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.460359 10523 raft_consensus.cc:359] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.461208 10523 raft_consensus.cc:385] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.461512 10523 raft_consensus.cc:740] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.461701 10524 tablet_bootstrap.cc:492] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.462270 10524 ts_tablet_manager.cc:1403] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.009s
I20260709 13:04:15.462306 10523 consensus_queue.cc:260] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.464293 10369 raft_consensus.cc:2468] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:15.467526 10522 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.468164 10522 ts_tablet_manager.cc:1403] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.013s
I20260709 13:04:15.468918 10523 ts_tablet_manager.cc:1434] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:04:15.470060 10523 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.471127 10522 raft_consensus.cc:359] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.471853 10522 raft_consensus.cc:385] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.472131 10522 raft_consensus.cc:740] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.472801 10522 consensus_queue.cc:260] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.475536 10524 raft_consensus.cc:359] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.476650 10524 raft_consensus.cc:385] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.477043 10524 raft_consensus.cc:740] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.478057 10524 consensus_queue.cc:260] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.481307 10524 ts_tablet_manager.cc:1434] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:04:15.482486 10524 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.484676 10523 tablet_bootstrap.cc:654] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.492786 10524 tablet_bootstrap.cc:654] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.493921 10522 ts_tablet_manager.cc:1434] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:04:15.495081 10522 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: Bootstrap starting.
I20260709 13:04:15.499723 10545 raft_consensus.cc:493] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.500944 10545 raft_consensus.cc:515] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.507174 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.508399 10217 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.510514 10116 catalog_manager.cc:5697] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.522732 10260 leader_election.cc:304] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.525192 10550 raft_consensus.cc:2804] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.535535 10550 raft_consensus.cc:493] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.536367 10550 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.533391 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.524237 10522 tablet_bootstrap.cc:654] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.540910 10367 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.525825 10545 leader_election.cc:290] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.547435 10524 tablet_bootstrap.cc:492] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.548139 10524 ts_tablet_manager.cc:1403] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.014s
I20260709 13:04:15.554289 10523 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.555001 10523 ts_tablet_manager.cc:1403] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.006s
I20260709 13:04:15.556394 10550 raft_consensus.cc:515] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.560266 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.560770 10550 leader_election.cc:290] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.560921 10217 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.558447 10523 raft_consensus.cc:359] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.560115 10524 raft_consensus.cc:359] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.561849 10523 raft_consensus.cc:385] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.562183 10523 raft_consensus.cc:740] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.563139 10523 consensus_queue.cc:260] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.564060 10522 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: No bootstrap required, opened a new log
I20260709 13:04:15.564183 10524 raft_consensus.cc:385] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.564693 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.564915 10524 raft_consensus.cc:740] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.565280 10367 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.565909 10524 consensus_queue.cc:260] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.566869 10418 raft_consensus.cc:493] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.567041 10522 ts_tablet_manager.cc:1403] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: Time spent bootstrapping tablet: real 0.072s	user 0.026s	sys 0.006s
I20260709 13:04:15.567408 10418 raft_consensus.cc:515] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.570591 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.571415 10293 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.572389 10523 ts_tablet_manager.cc:1434] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:04:15.573688 10523 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: Bootstrap starting.
I20260709 13:04:15.573503 10186 leader_election.cc:304] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.563959 10526 raft_consensus.cc:493] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.575500 10526 raft_consensus.cc:515] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.578086 10526 leader_election.cc:290] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.579828 10526 raft_consensus.cc:2804] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.580216 10526 raft_consensus.cc:493] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.580665 10526 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.579576 10522 raft_consensus.cc:359] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.583042 10523 tablet_bootstrap.cc:654] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.583200 10522 raft_consensus.cc:385] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.584858 10522 raft_consensus.cc:740] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.587088 10522 consensus_queue.cc:260] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.584084 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.590977 10369 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.591718 10509 raft_consensus.cc:493] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.592341 10509 raft_consensus.cc:515] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.592665 10184 leader_election.cc:304] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:15.593676 10522 ts_tablet_manager.cc:1434] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:04:15.599401 10509 leader_election.cc:290] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:15.599856 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.600781 10218 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 0.
I20260709 13:04:15.602339 10334 leader_election.cc:304] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:15.603842 10509 raft_consensus.cc:2804] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.604300 10509 raft_consensus.cc:493] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.604710 10509 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.607131 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.608034 10293 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 0.
I20260709 13:04:15.610877 10418 leader_election.cc:290] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.611920 10418 raft_consensus.cc:2804] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.612373 10418 raft_consensus.cc:493] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.612787 10418 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.616194 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.617084 10369 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.654902 10367 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.656643 10259 leader_election.cc:304] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.657984 10545 raft_consensus.cc:2804] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.658685 10545 raft_consensus.cc:697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:15.659832 10545 consensus_queue.cc:237] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.666857 10217 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.669057 10558 raft_consensus.cc:493] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.669667 10558 raft_consensus.cc:515] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
W20260709 13:04:15.671066 10186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:38797, user_credentials={real_user=slave}} blocked reactor thread for 97678us
I20260709 13:04:15.673194 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.673972 10293 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.688231 10545 raft_consensus.cc:493] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.689081 10545 raft_consensus.cc:515] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.693344 10562 raft_consensus.cc:493] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.694499 10545 leader_election.cc:290] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.694782 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.702272 10524 ts_tablet_manager.cc:1434] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.154s	user 0.036s	sys 0.030s
I20260709 13:04:15.695750 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
W20260709 13:04:15.696493 10259 leader_election.cc:343] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.709335 10524 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.710130 10217 raft_consensus.cc:2468] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.712483 10558 leader_election.cc:290] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.714601 10260 leader_election.cc:304] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:15.715950 10545 raft_consensus.cc:2804] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.716316 10545 raft_consensus.cc:493] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.716701 10545 raft_consensus.cc:3060] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.718847 10524 tablet_bootstrap.cc:654] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.694078 10562 raft_consensus.cc:515] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.708874 10509 raft_consensus.cc:515] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.728605 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.726589 10545 raft_consensus.cc:515] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.730965 10524 tablet_bootstrap.cc:492] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.743466 10524 ts_tablet_manager.cc:1403] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 13:04:15.730983 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
W20260709 13:04:15.744867 10184 leader_election.cc:343] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.731330 10559 raft_consensus.cc:493] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.743543 10293 raft_consensus.cc:2393] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:15.747131 10524 raft_consensus.cc:359] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.747965 10524 raft_consensus.cc:385] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.747686 10559 raft_consensus.cc:515] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.748358 10524 raft_consensus.cc:740] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.749287 10524 consensus_queue.cc:260] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.751251 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.751943 10367 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.753027 10184 leader_election.cc:304] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:15.753257 10186 leader_election.cc:304] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:15.754057 10564 raft_consensus.cc:2804] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.757637 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.757778 10564 raft_consensus.cc:493] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.758461 10564 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.739923 10418 raft_consensus.cc:515] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.751480 10524 ts_tablet_manager.cc:1434] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:15.754976 10557 raft_consensus.cc:3060] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.734583 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.735044 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.760517 10295 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 0.
I20260709 13:04:15.760689 10524 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: Bootstrap starting.
I20260709 13:04:15.762015 10335 leader_election.cc:304] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.736809 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.735725 10509 leader_election.cc:290] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:15.736878 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.767726 10294 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.754189 10293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.759346 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.735817 10526 raft_consensus.cc:515] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.733644 10562 leader_election.cc:290] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:15.756628 10545 leader_election.cc:290] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.775656 10509 raft_consensus.cc:2804] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.778760 10509 raft_consensus.cc:493] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.779122 10509 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.781549 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.782189 10295 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.783042 10218 raft_consensus.cc:2393] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate 42d00e433fe04ce580a148a86dcf281b in this term.
I20260709 13:04:15.776258 10293 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 0.
I20260709 13:04:15.783857 10418 leader_election.cc:290] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.774008 10559 leader_election.cc:290] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.790007 10295 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:15.798935 10186 leader_election.cc:304] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.798003 10115 catalog_manager.cc:5697] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.802836 10558 raft_consensus.cc:2804] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.803319 10526 leader_election.cc:290] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.803341 10558 raft_consensus.cc:697] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:15.804850 10558 consensus_queue.cc:237] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.805668 10524 tablet_bootstrap.cc:654] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.807889 10557 raft_consensus.cc:2749] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.810580 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.811713 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.812479 10367 raft_consensus.cc:2393] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:15.810576 10523 tablet_bootstrap.cc:492] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: No bootstrap required, opened a new log
I20260709 13:04:15.814724 10523 ts_tablet_manager.cc:1403] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent bootstrapping tablet: real 0.241s	user 0.031s	sys 0.076s
W20260709 13:04:15.814839 10335 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:38797, user_credentials={real_user=slave}} blocked reactor thread for 53022.8us
W20260709 13:04:15.815892 10259 leader_election.cc:343] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.818184 10523 raft_consensus.cc:359] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.819121 10523 raft_consensus.cc:385] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.819500 10523 raft_consensus.cc:740] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.820384 10523 consensus_queue.cc:260] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.821808 10219 raft_consensus.cc:2468] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.809448 10294 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 1.
I20260709 13:04:15.826843 10562 raft_consensus.cc:493] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.829011 10562 raft_consensus.cc:515] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.832644 10562 leader_election.cc:290] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:15.834296 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.835728 10295 raft_consensus.cc:2393] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:15.836009 10509 raft_consensus.cc:515] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.837980 10335 leader_election.cc:304] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.838428 10523 ts_tablet_manager.cc:1434] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:04:15.839942 10562 raft_consensus.cc:2804] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.840546 10562 raft_consensus.cc:697] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:15.841519 10115 catalog_manager.cc:5697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.843150 10564 raft_consensus.cc:515] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.843607 10550 raft_consensus.cc:493] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.844439 10217 raft_consensus.cc:2393] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate 42d00e433fe04ce580a148a86dcf281b in this term.
I20260709 13:04:15.845431 10564 leader_election.cc:290] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.844136 10550 raft_consensus.cc:515] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.847205 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.847920 10367 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.848351 10550 leader_election.cc:290] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.850929 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.851650 10369 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.852706 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.853367 10295 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.858088 10295 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:15.858960 10259 leader_election.cc:304] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.859247 10186 leader_election.cc:304] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.860095 10550 raft_consensus.cc:2804] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.860477 10550 raft_consensus.cc:493] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.860805 10550 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.861827 10558 raft_consensus.cc:2804] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.863245 10260 leader_election.cc:304] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:15.864001 10558 raft_consensus.cc:697] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:15.864683 10545 raft_consensus.cc:2804] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.865409 10545 raft_consensus.cc:697] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:15.866437 10545 consensus_queue.cc:237] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.864871 10558 consensus_queue.cc:237] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.869187 10550 raft_consensus.cc:515] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.874694 10550 leader_election.cc:290] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.875227 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.875918 10369 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.841619 10562 consensus_queue.cc:237] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.877446 10524 tablet_bootstrap.cc:492] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: No bootstrap required, opened a new log
I20260709 13:04:15.878036 10524 ts_tablet_manager.cc:1403] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.000s
I20260709 13:04:15.879801 10509 leader_election.cc:290] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:15.878160 10550 raft_consensus.cc:493] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.881243 10524 raft_consensus.cc:359] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.882376 10219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05b9530f6976439ea8ccfbfd2efa5842" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.883263 10219 raft_consensus.cc:2393] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate f098e27608234644a1b6db69669b56aa in this term.
I20260709 13:04:15.883044 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.858244 10367 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 1.
I20260709 13:04:15.884121 10184 leader_election.cc:304] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:15.885126 10567 raft_consensus.cc:2749] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.885378 10369 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.886487 10259 leader_election.cc:304] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.886807 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.887346 10510 raft_consensus.cc:2804] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.887923 10368 raft_consensus.cc:2393] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42d00e433fe04ce580a148a86dcf281b in current term 1: Already voted for candidate 9ee15fcabc434c99b5b217b8e42532ee in this term.
I20260709 13:04:15.888641 10524 raft_consensus.cc:385] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.888979 10524 raft_consensus.cc:740] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.881081 10550 raft_consensus.cc:515] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.892177 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:15.892251 10334 leader_election.cc:304] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:15.892995 10295 raft_consensus.cc:2393] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9ee15fcabc434c99b5b217b8e42532ee in current term 1: Already voted for candidate 42d00e433fe04ce580a148a86dcf281b in this term.
I20260709 13:04:15.893144 10564 raft_consensus.cc:493] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.899302 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.901273 10524 consensus_queue.cc:260] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.902707 10218 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.903051 10335 leader_election.cc:304] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee; no voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa
I20260709 13:04:15.903409 10118 catalog_manager.cc:5697] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.897961 10510 raft_consensus.cc:697] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:15.905929 10566 raft_consensus.cc:2749] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.896893 10509 raft_consensus.cc:3060] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.907588 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.905998 10510 consensus_queue.cc:237] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.908241 10368 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.909579 10259 leader_election.cc:304] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.910825 10545 raft_consensus.cc:2804] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.911166 10545 raft_consensus.cc:493] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.911628 10545 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.917264 10550 leader_election.cc:290] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.919180 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.919936 10218 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.921504 10550 consensus_queue.cc:1048] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:15.893630 10564 raft_consensus.cc:515] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.928755 10564 leader_election.cc:290] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.929124 10524 ts_tablet_manager.cc:1434] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 13:04:15.928946 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f098e27608234644a1b6db69669b56aa" is_pre_election: true
I20260709 13:04:15.923700 10509 raft_consensus.cc:2749] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.938367 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b" is_pre_election: true
I20260709 13:04:15.938983 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee" is_pre_election: true
I20260709 13:04:15.939296 10217 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 0.
I20260709 13:04:15.939888 10218 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.941407 10184 leader_election.cc:304] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b; no voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa
I20260709 13:04:15.947225 10564 raft_consensus.cc:2749] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.948628 10115 catalog_manager.cc:5697] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 1 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.951014 10116 catalog_manager.cc:5697] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.952303 10118 catalog_manager.cc:5697] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.954090 10118 catalog_manager.cc:5697] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 0 to 1, leader changed from <none> to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.943186 10545 raft_consensus.cc:515] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.958559 10545 leader_election.cc:290] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:15.959174 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:15.959846 10369 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.968675 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:15.969439 10218 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.974386 10369 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:15.979229 10259 leader_election.cc:304] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:15.980173 10545 raft_consensus.cc:2804] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.980685 10545 raft_consensus.cc:697] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:15.981509 10545 consensus_queue.cc:237] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:15.997907 10218 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 1.
I20260709 13:04:16.000178 10118 catalog_manager.cc:5697] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 0 to 1, leader changed from <none> to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 1 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.001044 10217 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.009749 10545 consensus_queue.cc:1048] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.031236 10558 consensus_queue.cc:1048] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.043067 10564 consensus_queue.cc:1048] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.077822 10545 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.090574 10545 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.199292 10368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "166d3bd751364091b22d95b017795885"
dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:55130
I20260709 13:04:16.199896 10368 raft_consensus.cc:606] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:16.204906 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "383670c920be4d5fa86cea3298d31445"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:16.205395 10295 raft_consensus.cc:606] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:16.210494 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:16.211119 10295 raft_consensus.cc:606] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 42d00e433fe04ce580a148a86dcf281b
I20260709 13:04:16.215668 10217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:44374
I20260709 13:04:16.216190 10217 raft_consensus.cc:606] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Received request to transfer leadership to TS f098e27608234644a1b6db69669b56aa
I20260709 13:04:16.220927 10217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:44374
I20260709 13:04:16.221482 10217 raft_consensus.cc:606] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Received request to transfer leadership to TS f098e27608234644a1b6db69669b56aa
I20260709 13:04:16.232811 10295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:36424
I20260709 13:04:16.233297 10295 raft_consensus.cc:606] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:16.316358 10564 consensus_queue.cc:1048] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.326478 10558 consensus_queue.cc:1048] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.335052 10567 raft_consensus.cc:993] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:16.335498 10558 raft_consensus.cc:1081] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Signalling peer f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:16.336906 10295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:36420
I20260709 13:04:16.337411 10295 raft_consensus.cc:493] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.337685 10295 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.342319 10295 raft_consensus.cc:515] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.343829 10295 leader_election.cc:290] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:16.344727 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:16.344930 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cdb683f78d64958a59794e1a79589a7" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:16.345453 10217 raft_consensus.cc:3055] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.345587 10368 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.345875 10217 raft_consensus.cc:740] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:16.346777 10217 consensus_queue.cc:260] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.347721 10217 raft_consensus.cc:3060] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.352038 10368 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:16.353096 10217 raft_consensus.cc:2468] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:16.353175 10259 leader_election.cc:304] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:16.354127 10545 raft_consensus.cc:2804] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.354705 10545 raft_consensus.cc:697] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:16.355350 10545 consensus_queue.cc:237] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.361925 10118 catalog_manager.cc:5697] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 1 to 2, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.365365 10558 consensus_queue.cc:1048] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.367606 10562 consensus_queue.cc:1048] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.380659 10566 consensus_queue.cc:1048] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.386198 10567 consensus_queue.cc:1048] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.403664 10558 raft_consensus.cc:993] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:16.404179 10557 raft_consensus.cc:1081] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Signalling peer f098e27608234644a1b6db69669b56aa to start an election
I20260709 13:04:16.405751 10562 raft_consensus.cc:993] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.406339 10566 raft_consensus.cc:1081] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.406433 10295 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
 from {username='slave'} at 127.0.0.1:36420
I20260709 13:04:16.407075 10295 raft_consensus.cc:493] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.407457 10295 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.408456 10217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "166d3bd751364091b22d95b017795885"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44370
I20260709 13:04:16.409365 10217 raft_consensus.cc:493] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.409792 10217 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.414573 10295 raft_consensus.cc:515] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.416769 10295 leader_election.cc:290] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:16.417585 10218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:16.417846 10369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0ddddb2f9f04bf2b9f223301953d221" candidate_uuid: "f098e27608234644a1b6db69669b56aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:16.418267 10218 raft_consensus.cc:3055] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.418659 10218 raft_consensus.cc:740] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:16.418358 10369 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.418833 10217 raft_consensus.cc:515] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.419469 10218 consensus_queue.cc:260] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.421295 10217 leader_election.cc:290] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:16.420975 10218 raft_consensus.cc:3060] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.422806 10368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:16.423461 10368 raft_consensus.cc:3055] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.423782 10368 raft_consensus.cc:740] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:16.424656 10368 consensus_queue.cc:260] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.426033 10368 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.427692 10545 consensus_queue.cc:1048] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.430577 10218 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:16.431952 10260 leader_election.cc:304] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:16.432855 10545 raft_consensus.cc:2804] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.433339 10545 raft_consensus.cc:697] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Becoming Leader. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:16.434121 10545 consensus_queue.cc:237] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.439975 10369 raft_consensus.cc:2468] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f098e27608234644a1b6db69669b56aa in term 2.
I20260709 13:04:16.441218 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "166d3bd751364091b22d95b017795885" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:16.441928 10295 raft_consensus.cc:3060] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.444015 10545 consensus_queue.cc:1048] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.438495 10368 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.448187 10184 leader_election.cc:304] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:16.448982 10295 raft_consensus.cc:2468] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.448999 10567 raft_consensus.cc:2804] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.449752 10567 raft_consensus.cc:697] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:16.450551 10567 consensus_queue.cc:237] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.454015 10545 consensus_queue.cc:1048] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.461601 10116 catalog_manager.cc:5697] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa reported cstate change: term changed from 1 to 2, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to f098e27608234644a1b6db69669b56aa (127.0.107.194). New cstate: current_term: 2 leader_uuid: "f098e27608234644a1b6db69669b56aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.466536 10510 consensus_queue.cc:1048] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.462827 10118 catalog_manager.cc:5697] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:16.509346 10260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46429, user_credentials={real_user=slave}} blocked reactor thread for 46313.8us
I20260709 13:04:16.517665 10550 raft_consensus.cc:993] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: : Instructing follower 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:16.518164 10550 raft_consensus.cc:1081] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:16.519927 10368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333"
dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:04:16.520594 10368 raft_consensus.cc:493] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.521039 10368 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.527335 10600 consensus_queue.cc:1048] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.529410 10368 raft_consensus.cc:515] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.532426 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:16.533033 10217 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.533249 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d561f53cd4342b4a80acad350b5c333" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:16.533097 10368 leader_election.cc:290] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:16.533916 10295 raft_consensus.cc:3055] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.534243 10295 raft_consensus.cc:740] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:16.534983 10295 consensus_queue.cc:260] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.536020 10295 raft_consensus.cc:3060] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.538408 10368 raft_consensus.cc:1240] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Rejecting Update request from peer f098e27608234644a1b6db69669b56aa for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:16.538575 10600 consensus_queue.cc:1048] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.542840 10217 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 2.
I20260709 13:04:16.542840 10295 raft_consensus.cc:2468] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 2.
I20260709 13:04:16.544339 10334 leader_election.cc:304] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:16.545223 10566 raft_consensus.cc:2804] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.545748 10566 raft_consensus.cc:697] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:16.546733 10566 consensus_queue.cc:237] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.562673 10545 raft_consensus.cc:993] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.563623 10545 raft_consensus.cc:1081] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.566738 10217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "383670c920be4d5fa86cea3298d31445"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44364
I20260709 13:04:16.567405 10217 raft_consensus.cc:493] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.567752 10217 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.573570 10217 raft_consensus.cc:515] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.575606 10217 leader_election.cc:290] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:16.576160 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:16.576097 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "383670c920be4d5fa86cea3298d31445" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:16.576942 10367 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.577319 10295 raft_consensus.cc:3055] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.577630 10295 raft_consensus.cc:740] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:16.578370 10295 consensus_queue.cc:260] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.579593 10295 raft_consensus.cc:3060] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.581018 10115 catalog_manager.cc:5697] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.583735 10367 raft_consensus.cc:2468] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.585090 10184 leader_election.cc:304] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:16.585903 10557 raft_consensus.cc:2804] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.586155 10295 raft_consensus.cc:2468] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.586417 10557 raft_consensus.cc:697] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:16.587678 10557 consensus_queue.cc:237] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.594781 10115 catalog_manager.cc:5697] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.692420 10600 raft_consensus.cc:993] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: : Instructing follower 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.692888 10600 raft_consensus.cc:1081] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 42d00e433fe04ce580a148a86dcf281b to start an election
I20260709 13:04:16.694408 10217 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
 from {username='slave'} at 127.0.0.1:44364
I20260709 13:04:16.694918 10217 raft_consensus.cc:493] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:16.695212 10217 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.700073 10217 raft_consensus.cc:515] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.701655 10217 leader_election.cc:290] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Requested vote from peers f098e27608234644a1b6db69669b56aa (127.0.107.194:38797), 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195:39243)
I20260709 13:04:16.702512 10295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:16.702690 10367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "42d00e433fe04ce580a148a86dcf281b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
I20260709 13:04:16.703293 10295 raft_consensus.cc:3055] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:16.703303 10367 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.703739 10295 raft_consensus.cc:740] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:16.704548 10295 consensus_queue.cc:260] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.705737 10295 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:16.710521 10367 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.711892 10184 leader_election.cc:304] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:16.712459 10295 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42d00e433fe04ce580a148a86dcf281b in term 2.
I20260709 13:04:16.712953 10557 raft_consensus.cc:2804] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:16.713593 10557 raft_consensus.cc:697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Leader. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:16.714424 10557 consensus_queue.cc:237] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:16.721261 10115 catalog_manager.cc:5697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 42d00e433fe04ce580a148a86dcf281b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "42d00e433fe04ce580a148a86dcf281b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.736819 10217 raft_consensus.cc:1275] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.738251 10600 consensus_queue.cc:1048] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.744706 10367 raft_consensus.cc:1275] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.747128 10545 consensus_queue.cc:1048] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.835840 10367 raft_consensus.cc:1275] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.837046 10545 consensus_queue.cc:1048] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.845992 10217 raft_consensus.cc:1275] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer f098e27608234644a1b6db69669b56aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.847937 10599 consensus_queue.cc:1048] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.916435 10367 raft_consensus.cc:1275] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.917528 10557 consensus_queue.cc:1048] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.920089 10295 raft_consensus.cc:1275] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:16.921322 10564 consensus_queue.cc:1048] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:16.999802 10295 raft_consensus.cc:1275] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.001015 10566 consensus_queue.cc:1048] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.012513 10217 raft_consensus.cc:1275] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.014310 10562 consensus_queue.cc:1048] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.023924 10294 raft_consensus.cc:1275] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.025123 10557 consensus_queue.cc:1048] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.033809 10367 raft_consensus.cc:1275] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.038846 10567 consensus_queue.cc:1048] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.231374 10294 raft_consensus.cc:1275] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.232743 10567 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:17.242964 10367 raft_consensus.cc:1275] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Refusing update from remote peer 42d00e433fe04ce580a148a86dcf281b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:17.244221 10606 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:19.236593 10118 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53616:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:19.260016 10118 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53616:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:04:19.304445   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:19.524356 10662 tablet.cc:1724] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:19.589679 10655 log.cc:927] Time spent T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:04:19.600627 10650 log.cc:927] Time spent T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:19.588459 10668 tablet.cc:1724] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:19.672945 10260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46429, user_credentials={real_user=slave}} blocked reactor thread for 83753.7us
I20260709 13:04:19.672402 10682 tablet.cc:1724] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.612702 10669 tablet.cc:1724] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.613511 10670 tablet.cc:1724] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.705163 10680 tablet.cc:1724] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.674726 10672 tablet.cc:1724] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.692271 10679 tablet.cc:1724] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:19.723850 10260 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:46429, user_credentials={real_user=slave}} blocked reactor thread for 43931.1us
I20260709 13:04:19.724319 10677 tablet.cc:1724] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.715656 10662 tablet.cc:1724] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.741056 10294 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77"
dest_uuid: "f098e27608234644a1b6db69669b56aa"
mode: GRACEFUL
new_leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:36430
I20260709 13:04:19.741732 10294 raft_consensus.cc:606] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Received request to transfer leadership to TS 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:19.757771 10676 tablet.cc:1724] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.791395 10678 tablet.cc:1724] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.784957 10681 tablet.cc:1724] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.794652 10679 tablet.cc:1724] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.790310 10682 tablet.cc:1724] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.824311 10676 tablet.cc:1724] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.838759 10670 tablet.cc:1724] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.842263 10662 tablet.cc:1724] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.844709 10672 tablet.cc:1724] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.851540 10677 tablet.cc:1724] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.855063 10682 tablet.cc:1724] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.858222 10669 tablet.cc:1724] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.836609 10678 tablet.cc:1724] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.861055 10668 tablet.cc:1724] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.871414 10217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:44386
I20260709 13:04:19.872193 10217 raft_consensus.cc:606] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Received request to transfer leadership to TS 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:19.874450   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:04:19.862479 10680 tablet.cc:1724] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.878265   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:19.887387 10676 tablet.cc:1724] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.890767 10217 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828"
dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
mode: GRACEFUL
new_leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:44386
I20260709 13:04:19.891443 10217 raft_consensus.cc:606] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Received request to transfer leadership to TS 9ee15fcabc434c99b5b217b8e42532ee
I20260709 13:04:19.892891   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:04:19.893491   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:19.898737 10678 tablet.cc:1724] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:19.930464 10654 raft_consensus.cc:993] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:19.931191 10671 raft_consensus.cc:1081] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Signalling peer 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:19.932978 10366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828"
dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:55120
I20260709 13:04:19.933568 10366 raft_consensus.cc:493] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:19.933945 10366 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.930575 10118 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: soft_deleted_table [id=4935ba8a23a747abb55b379f06d1c519] alter complete (version 1)
I20260709 13:04:19.943334 10366 raft_consensus.cc:515] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:19.945282 10366 leader_election.cc:290] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:19.945878 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:19.946285 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ffc156c6b0498d9220972a5133e828" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:19.946576 10217 raft_consensus.cc:3055] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:19.946903 10294 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.946923 10217 raft_consensus.cc:740] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:19.947870 10217 consensus_queue.cc:260] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:19.949064 10217 raft_consensus.cc:3060] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:19.954218 10294 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 3.
I20260709 13:04:19.955561 10335 leader_election.cc:304] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:19.955925 10217 raft_consensus.cc:2468] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 3.
I20260709 13:04:19.956558 10684 raft_consensus.cc:2804] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:19.957064 10684 raft_consensus.cc:697] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:19.957783 10684 consensus_queue.cc:237] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:19.966806 10117 catalog_manager.cc:5697] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 2 to 3, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.069353 10564 raft_consensus.cc:993] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: : Instructing follower 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:20.069819 10671 raft_consensus.cc:1081] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Signalling peer 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:20.071159 10366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98"
dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:55120
I20260709 13:04:20.071584 10366 raft_consensus.cc:493] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.071820 10366 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.076795 10366 raft_consensus.cc:515] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.078445 10366 leader_election.cc:290] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:20.079144 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:20.079399 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8470d0cb03d045d6a0e4c6e153f7ee98" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:20.079784 10217 raft_consensus.cc:3055] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:20.079962 10294 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.080170 10217 raft_consensus.cc:740] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42d00e433fe04ce580a148a86dcf281b, State: Running, Role: LEADER
I20260709 13:04:20.080957 10217 consensus_queue.cc:260] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.081883 10217 raft_consensus.cc:3060] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:20.085047 10294 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 3.
I20260709 13:04:20.086041 10335 leader_election.cc:304] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9ee15fcabc434c99b5b217b8e42532ee, f098e27608234644a1b6db69669b56aa; no voters: 
I20260709 13:04:20.086455 10217 raft_consensus.cc:2468] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 3.
I20260709 13:04:20.086725 10684 raft_consensus.cc:2804] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:20.087276 10684 raft_consensus.cc:697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:20.088037 10684 consensus_queue.cc:237] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.093140 10683 raft_consensus.cc:993] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: : Instructing follower 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:20.093706 10674 raft_consensus.cc:1081] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Signalling peer 9ee15fcabc434c99b5b217b8e42532ee to start an election
I20260709 13:04:20.095115 10366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77"
dest_uuid: "9ee15fcabc434c99b5b217b8e42532ee"
 from {username='slave'} at 127.0.0.1:55108
I20260709 13:04:20.095033 10117 catalog_manager.cc:5697] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 2 to 3, leader changed from 42d00e433fe04ce580a148a86dcf281b (127.0.107.193) to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 3 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.095716 10366 raft_consensus.cc:493] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.096136 10366 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.102416 10366 raft_consensus.cc:515] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.104236 10366 leader_election.cc:290] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Requested vote from peers 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429), f098e27608234644a1b6db69669b56aa (127.0.107.194:38797)
I20260709 13:04:20.104964 10217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "42d00e433fe04ce580a148a86dcf281b"
I20260709 13:04:20.105105 10294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c291a253e8452fb6a9ec89542f0f77" candidate_uuid: "9ee15fcabc434c99b5b217b8e42532ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f098e27608234644a1b6db69669b56aa"
I20260709 13:04:20.105518 10217 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.105752 10294 raft_consensus.cc:3055] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.106182 10294 raft_consensus.cc:740] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f098e27608234644a1b6db69669b56aa, State: Running, Role: LEADER
I20260709 13:04:20.106971 10294 consensus_queue.cc:260] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.107951 10294 raft_consensus.cc:3060] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.110532 10217 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 2.
I20260709 13:04:20.111673 10334 leader_election.cc:304] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42d00e433fe04ce580a148a86dcf281b, 9ee15fcabc434c99b5b217b8e42532ee; no voters: 
I20260709 13:04:20.112373 10684 raft_consensus.cc:2804] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.112802 10684 raft_consensus.cc:697] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 LEADER]: Becoming Leader. State: Replica: 9ee15fcabc434c99b5b217b8e42532ee, State: Running, Role: LEADER
I20260709 13:04:20.113664 10294 raft_consensus.cc:2468] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ee15fcabc434c99b5b217b8e42532ee in term 2.
I20260709 13:04:20.113572 10684 consensus_queue.cc:237] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } }
I20260709 13:04:20.121860 10117 catalog_manager.cc:5697] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee reported cstate change: term changed from 1 to 2, leader changed from f098e27608234644a1b6db69669b56aa (127.0.107.194) to 9ee15fcabc434c99b5b217b8e42532ee (127.0.107.195). New cstate: current_term: 2 leader_uuid: "9ee15fcabc434c99b5b217b8e42532ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9ee15fcabc434c99b5b217b8e42532ee" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 39243 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.439512 10217 raft_consensus.cc:1275] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:20.440851 10684 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:20.451352 10294 raft_consensus.cc:1275] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:20.453579 10694 consensus_queue.cc:1048] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:20.502954 10294 raft_consensus.cc:1275] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:20.506022 10694 consensus_queue.cc:1048] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:20.522425 10217 raft_consensus.cc:1275] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:04:20.526690 10684 consensus_queue.cc:1048] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:20.530181 10294 raft_consensus.cc:1275] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:20.535404 10684 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "f098e27608234644a1b6db69669b56aa" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:20.547950 10217 raft_consensus.cc:1275] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Refusing update from remote peer 9ee15fcabc434c99b5b217b8e42532ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:20.549705 10684 consensus_queue.cc:1048] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "42d00e433fe04ce580a148a86dcf281b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:20.955693   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:04:20.961433   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:04:20.961833   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.966528   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:04:20.966935   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:21.996496   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:22.012707 10334 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:04:22.016067 10334 consensus_peers.cc:597] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.024507   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:22.025322   431 tablet_replica.cc:333] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.025933   431 raft_consensus.cc:2243] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.026443   431 raft_consensus.cc:2272] T 75c291a253e8452fb6a9ec89542f0f77 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.028672   431 tablet_replica.cc:333] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.029419   431 raft_consensus.cc:2243] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.029858   431 raft_consensus.cc:2272] T 6d561f53cd4342b4a80acad350b5c333 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.031903   431 tablet_replica.cc:333] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
W20260709 13:04:22.031948 10260 consensus_peers.cc:597] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.032543   431 raft_consensus.cc:2243] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.033075   431 raft_consensus.cc:2272] T 05b9530f6976439ea8ccfbfd2efa5842 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.035027   431 tablet_replica.cc:333] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.035593   431 raft_consensus.cc:2243] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.036021   431 raft_consensus.cc:2272] T e0ddddb2f9f04bf2b9f223301953d221 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.037796   431 tablet_replica.cc:333] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.038339   431 raft_consensus.cc:2243] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.038817   431 raft_consensus.cc:2272] T 7420363ee2eb409ab03d230170f75f6a P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.040786   431 tablet_replica.cc:333] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.041330   431 raft_consensus.cc:2243] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.041742   431 raft_consensus.cc:2272] T 0cdb683f78d64958a59794e1a79589a7 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.043597   431 tablet_replica.cc:333] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.044189   431 raft_consensus.cc:2243] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.044636   431 raft_consensus.cc:2272] T f22af50d2b3b4b819f11f59036321bd5 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.047035   431 tablet_replica.cc:333] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.047607   431 raft_consensus.cc:2243] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.048357   431 raft_consensus.cc:2272] T ba54f163134a4a16be45e65928c15958 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.050414   431 tablet_replica.cc:333] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.051010   431 raft_consensus.cc:2243] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.051755   431 raft_consensus.cc:2272] T 166d3bd751364091b22d95b017795885 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:22.052579 10334 consensus_peers.cc:597] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.053781   431 tablet_replica.cc:333] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.054415   431 raft_consensus.cc:2243] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.054924   431 raft_consensus.cc:2272] T b9bce3c0627744739bc72425c6f14c6f P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.056926   431 tablet_replica.cc:333] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.057484   431 raft_consensus.cc:2243] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.058269   431 raft_consensus.cc:2272] T bf8e615842634124997ca8211901f400 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.060829   431 tablet_replica.cc:333] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.061388   431 raft_consensus.cc:2243] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.062390   431 raft_consensus.cc:2272] T 383670c920be4d5fa86cea3298d31445 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.064165   431 tablet_replica.cc:333] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.064656   431 raft_consensus.cc:2243] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.065043   431 raft_consensus.cc:2272] T ee9963e3378a40fc84c508b8bf5ebbc6 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.067277   431 tablet_replica.cc:333] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.067878   431 raft_consensus.cc:2243] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.068295   431 raft_consensus.cc:2272] T e3ffc156c6b0498d9220972a5133e828 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:22.070191 10260 consensus_peers.cc:597] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.070823   431 tablet_replica.cc:333] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.071481   431 raft_consensus.cc:2243] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.072324   431 raft_consensus.cc:2272] T 031fee577f9a46b9aa14554d568b46dd P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.074522   431 tablet_replica.cc:333] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.075109   431 raft_consensus.cc:2243] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.075877   431 raft_consensus.cc:2272] T 3da1181467ed4c8b99957cd060be2268 P 42d00e433fe04ce580a148a86dcf281b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.078090   431 tablet_replica.cc:333] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.078594   431 raft_consensus.cc:2243] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.079115   431 raft_consensus.cc:2272] T 54dfba76264541fdbf057a630b483873 P 42d00e433fe04ce580a148a86dcf281b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.081045   431 tablet_replica.cc:333] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b: stopping tablet replica
I20260709 13:04:22.081502   431 raft_consensus.cc:2243] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.081902   431 raft_consensus.cc:2272] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 42d00e433fe04ce580a148a86dcf281b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:22.093174 10334 consensus_peers.cc:597] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.119764   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:22.151553   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:22.168376 10260 consensus_peers.cc:597] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.182363   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:22.183140   431 tablet_replica.cc:333] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.183774   431 raft_consensus.cc:2243] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.184238   431 raft_consensus.cc:2272] T 75c291a253e8452fb6a9ec89542f0f77 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.186090   431 tablet_replica.cc:333] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.186771   431 raft_consensus.cc:2243] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.187227   431 raft_consensus.cc:2272] T 6d561f53cd4342b4a80acad350b5c333 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.189184   431 tablet_replica.cc:333] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.189760   431 raft_consensus.cc:2243] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.190209   431 raft_consensus.cc:2272] T 8470d0cb03d045d6a0e4c6e153f7ee98 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:22.192219 10335 consensus_peers.cc:597] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee -> Peer f098e27608234644a1b6db69669b56aa (127.0.107.194:38797): Couldn't send request to peer f098e27608234644a1b6db69669b56aa. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.192263   431 tablet_replica.cc:333] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.193027   431 raft_consensus.cc:2243] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.193818   431 raft_consensus.cc:2272] T 0cdb683f78d64958a59794e1a79589a7 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.195808   431 tablet_replica.cc:333] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.196393   431 raft_consensus.cc:2243] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.197162   431 raft_consensus.cc:2272] T f22af50d2b3b4b819f11f59036321bd5 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.199208   431 tablet_replica.cc:333] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.199759   431 raft_consensus.cc:2243] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.200171   431 raft_consensus.cc:2272] T ba54f163134a4a16be45e65928c15958 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.201913   431 tablet_replica.cc:333] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.202486   431 raft_consensus.cc:2243] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.202989   431 raft_consensus.cc:2272] T 166d3bd751364091b22d95b017795885 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.204705   431 tablet_replica.cc:333] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.205312   431 raft_consensus.cc:2243] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.205726   431 raft_consensus.cc:2272] T b9bce3c0627744739bc72425c6f14c6f P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.207792   431 tablet_replica.cc:333] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.208308   431 raft_consensus.cc:2243] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.209048   431 raft_consensus.cc:2272] T 05b9530f6976439ea8ccfbfd2efa5842 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.211066   431 tablet_replica.cc:333] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.211598   431 raft_consensus.cc:2243] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.212352   431 raft_consensus.cc:2272] T e0ddddb2f9f04bf2b9f223301953d221 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.214087   431 tablet_replica.cc:333] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.214708   431 raft_consensus.cc:2243] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.215183   431 raft_consensus.cc:2272] T 031fee577f9a46b9aa14554d568b46dd P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.217200   431 tablet_replica.cc:333] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.217759   431 raft_consensus.cc:2243] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.218216   431 raft_consensus.cc:2272] T e3ffc156c6b0498d9220972a5133e828 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.220115   431 tablet_replica.cc:333] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.220840   431 raft_consensus.cc:2243] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.221638   431 raft_consensus.cc:2272] T 54dfba76264541fdbf057a630b483873 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.223599   431 tablet_replica.cc:333] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.224112   431 raft_consensus.cc:2243] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.224557   431 raft_consensus.cc:2272] T 383670c920be4d5fa86cea3298d31445 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.226321   431 tablet_replica.cc:333] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.226879   431 raft_consensus.cc:2243] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.227360   431 raft_consensus.cc:2272] T ee9963e3378a40fc84c508b8bf5ebbc6 P f098e27608234644a1b6db69669b56aa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.229360   431 tablet_replica.cc:333] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.229873   431 raft_consensus.cc:2243] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.230710   431 raft_consensus.cc:2272] T 7420363ee2eb409ab03d230170f75f6a P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.232749   431 tablet_replica.cc:333] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.233289   431 raft_consensus.cc:2243] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.233752   431 raft_consensus.cc:2272] T 3da1181467ed4c8b99957cd060be2268 P f098e27608234644a1b6db69669b56aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.235785   431 tablet_replica.cc:333] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa: stopping tablet replica
I20260709 13:04:22.236272   431 raft_consensus.cc:2243] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.236717   431 raft_consensus.cc:2272] T bf8e615842634124997ca8211901f400 P f098e27608234644a1b6db69669b56aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.276777   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:22.283231 10334 consensus_peers.cc:597] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.308841   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:22.339133   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:22.340082   431 tablet_replica.cc:333] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.340679   431 raft_consensus.cc:2243] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.341559   431 raft_consensus.cc:2272] T 75c291a253e8452fb6a9ec89542f0f77 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.343645   431 tablet_replica.cc:333] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.344192   431 raft_consensus.cc:2243] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.344959   431 raft_consensus.cc:2272] T 6d561f53cd4342b4a80acad350b5c333 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.346882   431 tablet_replica.cc:333] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.347447   431 raft_consensus.cc:2243] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.347875   431 raft_consensus.cc:2272] T 05b9530f6976439ea8ccfbfd2efa5842 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.349552   431 tablet_replica.cc:333] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.350109   431 raft_consensus.cc:2243] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.350553   431 raft_consensus.cc:2272] T e0ddddb2f9f04bf2b9f223301953d221 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.352293   431 tablet_replica.cc:333] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.352823   431 raft_consensus.cc:2243] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.353241   431 raft_consensus.cc:2272] T ba54f163134a4a16be45e65928c15958 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.355037   431 tablet_replica.cc:333] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.355571   431 raft_consensus.cc:2243] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.355988   431 raft_consensus.cc:2272] T f22af50d2b3b4b819f11f59036321bd5 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.358227   431 tablet_replica.cc:333] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.359251   431 raft_consensus.cc:2243] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.360121   431 raft_consensus.cc:2272] T 0cdb683f78d64958a59794e1a79589a7 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.362145   431 tablet_replica.cc:333] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.363035   431 raft_consensus.cc:2243] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.363641   431 raft_consensus.cc:2272] T 383670c920be4d5fa86cea3298d31445 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.366549   431 tablet_replica.cc:333] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.367511   431 raft_consensus.cc:2243] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.368696   431 raft_consensus.cc:2272] T ee9963e3378a40fc84c508b8bf5ebbc6 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.371877   431 tablet_replica.cc:333] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.372668   431 raft_consensus.cc:2243] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.373556   431 raft_consensus.cc:2272] T 8470d0cb03d045d6a0e4c6e153f7ee98 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.376084   431 tablet_replica.cc:333] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
W20260709 13:04:22.376113 10334 consensus_peers.cc:597] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:22.376686 10334 consensus_peers.cc:597] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee -> Peer 42d00e433fe04ce580a148a86dcf281b (127.0.107.193:46429): Couldn't send request to peer 42d00e433fe04ce580a148a86dcf281b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:46429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:22.376909   431 raft_consensus.cc:2243] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.377646   431 raft_consensus.cc:2272] T 031fee577f9a46b9aa14554d568b46dd P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.380046   431 tablet_replica.cc:333] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.380898   431 raft_consensus.cc:2243] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.382012   431 raft_consensus.cc:2272] T e3ffc156c6b0498d9220972a5133e828 P 9ee15fcabc434c99b5b217b8e42532ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.384783   431 tablet_replica.cc:333] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.385669   431 raft_consensus.cc:2243] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.386286   431 raft_consensus.cc:2272] T 54dfba76264541fdbf057a630b483873 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.389081   431 tablet_replica.cc:333] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.389684   431 raft_consensus.cc:2243] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.390188   431 raft_consensus.cc:2272] T 7420363ee2eb409ab03d230170f75f6a P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.392308   431 tablet_replica.cc:333] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.393028   431 raft_consensus.cc:2243] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.393554   431 raft_consensus.cc:2272] T 3da1181467ed4c8b99957cd060be2268 P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.395659   431 tablet_replica.cc:333] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.396430   431 raft_consensus.cc:2243] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.397035   431 raft_consensus.cc:2272] T 166d3bd751364091b22d95b017795885 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.399919   431 tablet_replica.cc:333] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.400513   431 raft_consensus.cc:2243] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.401364   431 raft_consensus.cc:2272] T b9bce3c0627744739bc72425c6f14c6f P 9ee15fcabc434c99b5b217b8e42532ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.403683   431 tablet_replica.cc:333] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee: stopping tablet replica
I20260709 13:04:22.404161   431 raft_consensus.cc:2243] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:22.404605   431 raft_consensus.cc:2272] T bf8e615842634124997ca8211901f400 P 9ee15fcabc434c99b5b217b8e42532ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.443375   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:22.476740   431 master.cc:562] Master@127.0.107.254:42665 shutting down...
I20260709 13:04:22.500051   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:22.500648   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:22.500999   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 536d8b6de2c240ad9c68ae58f306bdc2: stopping tablet replica
I20260709 13:04:22.521531   431 master.cc:584] Master@127.0.107.254:42665 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12459 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:04:22.572903   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34751
I20260709 13:04:22.574007   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:22.579834 10706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.579949 10705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.580431 10708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:22.582582   431 server_base.cc:1061] running on GCE node
I20260709 13:04:22.583554   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:22.583989   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:22.584169   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602262584136 us; error 0 us; skew 500 ppm
I20260709 13:04:22.584715   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:22.587126   431 webserver.cc:533] Webserver started at http://127.0.107.254:40589/ using document root <none> and password file <none>
I20260709 13:04:22.587607   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:22.587800   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:22.588074   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:22.589118   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/master-0-root/instance:
uuid: "fbd653147df74eb282640aade3580275"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.593401   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:22.596622 10713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.597312   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:22.597646   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/master-0-root
uuid: "fbd653147df74eb282640aade3580275"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.597913   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:22.607568   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:22.608770   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:22.650367   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34751
I20260709 13:04:22.650460 10764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34751 every 8 connection(s)
I20260709 13:04:22.654311 10765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:22.664794 10765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: Bootstrap starting.
I20260709 13:04:22.669538 10765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.673873 10765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: No bootstrap required, opened a new log
I20260709 13:04:22.676038 10765 raft_consensus.cc:359] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER }
I20260709 13:04:22.676429 10765 raft_consensus.cc:385] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.676620 10765 raft_consensus.cc:740] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbd653147df74eb282640aade3580275, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.677196 10765 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER }
I20260709 13:04:22.677618 10765 raft_consensus.cc:399] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:22.677803 10765 raft_consensus.cc:493] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:22.678007 10765 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.683421 10765 raft_consensus.cc:515] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER }
I20260709 13:04:22.683897 10765 leader_election.cc:304] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbd653147df74eb282640aade3580275; no voters: 
I20260709 13:04:22.684966 10765 leader_election.cc:290] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:22.685312 10768 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:22.686681 10768 raft_consensus.cc:697] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 1 LEADER]: Becoming Leader. State: Replica: fbd653147df74eb282640aade3580275, State: Running, Role: LEADER
I20260709 13:04:22.687335 10768 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER }
I20260709 13:04:22.687891 10765 sys_catalog.cc:565] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:22.691660 10770 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbd653147df74eb282640aade3580275. Latest consensus state: current_term: 1 leader_uuid: "fbd653147df74eb282640aade3580275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER } }
I20260709 13:04:22.692850 10769 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbd653147df74eb282640aade3580275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbd653147df74eb282640aade3580275" member_type: VOTER } }
I20260709 13:04:22.693284 10770 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:22.693575 10769 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:22.695241 10776 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:22.700047 10776 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:22.703452   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:22.708501 10776 catalog_manager.cc:1383] Generated new cluster ID: 6ab974c3938b4c67ba426c2ab415562c
I20260709 13:04:22.708851 10776 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:22.726786 10776 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:22.728063 10776 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:22.744028 10776 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: Generated new TSK 0
I20260709 13:04:22.744691 10776 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:22.770197   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:22.776532 10786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.777613 10787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.779920 10789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:22.780153   431 server_base.cc:1061] running on GCE node
I20260709 13:04:22.781132   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:22.781333   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:22.781507   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602262781473 us; error 0 us; skew 500 ppm
I20260709 13:04:22.782050   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:22.784293   431 webserver.cc:533] Webserver started at http://127.0.107.193:36451/ using document root <none> and password file <none>
I20260709 13:04:22.784767   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:22.784951   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:22.785230   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:22.786260   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-0-root/instance:
uuid: "c36caa3aefdd42469d83005641bb9cf7"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.790854   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:04:22.794188 10794 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.794989   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:22.795275   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-0-root
uuid: "c36caa3aefdd42469d83005641bb9cf7"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.795549   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:22.814000   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:22.815251   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:22.816694   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:22.818890   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:22.819119   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.819355   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:22.819545   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.858273   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35559
I20260709 13:04:22.858384 10856 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35559 every 8 connection(s)
I20260709 13:04:22.863272   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:22.870642 10861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.871690 10862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.874995 10864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:22.876389 10857 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34751
I20260709 13:04:22.876479   431 server_base.cc:1061] running on GCE node
I20260709 13:04:22.877044 10857 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:22.878051 10857 heartbeater.cc:507] Master 127.0.107.254:34751 requested a full tablet report, sending...
I20260709 13:04:22.878325   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:22.878679   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:22.878878   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602262878861 us; error 0 us; skew 500 ppm
I20260709 13:04:22.879662   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:22.880685 10730 ts_manager.cc:194] Registered new tserver with Master: c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559)
I20260709 13:04:22.882351   431 webserver.cc:533] Webserver started at http://127.0.107.194:33259/ using document root <none> and password file <none>
I20260709 13:04:22.882954   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:22.883183   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:22.883006 10730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56500
I20260709 13:04:22.883584   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:22.884735   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-1-root/instance:
uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.889992   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:22.898098 10869 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.898923   431 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:04:22.899289   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-1-root
uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.899588   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:22.914438   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:22.915663   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:22.917102   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:22.919313   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:22.919533   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.919776   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:22.919945   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.958184   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36687
I20260709 13:04:22.958314 10931 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36687 every 8 connection(s)
I20260709 13:04:22.963060   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:22.969727 10935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:22.972113 10936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:22.974066   431 server_base.cc:1061] running on GCE node
W20260709 13:04:22.973512 10938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:22.975455 10932 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34751
I20260709 13:04:22.975565   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:22.975872 10932 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:22.975937   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:22.976305   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602262976285 us; error 0 us; skew 500 ppm
I20260709 13:04:22.976781 10932 heartbeater.cc:507] Master 127.0.107.254:34751 requested a full tablet report, sending...
I20260709 13:04:22.976907   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:22.979141 10730 ts_manager.cc:194] Registered new tserver with Master: 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:22.979857   431 webserver.cc:533] Webserver started at http://127.0.107.195:44397/ using document root <none> and password file <none>
I20260709 13:04:22.980412   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:22.980628   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:22.980686 10730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56516
I20260709 13:04:22.980918   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:22.982319   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-2-root/instance:
uuid: "cd0fca555828416eacf5179cc3129db0"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.986869   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:22.990264 10943 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:22.991027   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:22.991353   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-2-root
uuid: "cd0fca555828416eacf5179cc3129db0"
format_stamp: "Formatted at 2026-07-09 13:04:22 on dist-test-slave-n5kz"
I20260709 13:04:22.991648   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskFc6jKN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601954787209-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:23.011590   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:23.012710   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:23.014067   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:23.016268   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:23.016463   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:23.016762   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:23.016919   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:23.055586   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43575
I20260709 13:04:23.055706 11005 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43575 every 8 connection(s)
I20260709 13:04:23.069248 11006 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34751
I20260709 13:04:23.069715 11006 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:23.070432 11006 heartbeater.cc:507] Master 127.0.107.254:34751 requested a full tablet report, sending...
I20260709 13:04:23.072430 10730 ts_manager.cc:194] Registered new tserver with Master: cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.073378   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014599844s
I20260709 13:04:23.074052 10730 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56520
I20260709 13:04:23.098062 10730 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56530:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:23.100572 10730 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:23.176342 10822 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc984127dfe41429a126b65ef5298e4 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:23.177742 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc984127dfe41429a126b65ef5298e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.178216 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc984127dfe41429a126b65ef5298e4 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:23.179611 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc984127dfe41429a126b65ef5298e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.180998 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 24a6c0e60264410fb2cfc13a1ee1c401 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:23.181437 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 24a6c0e60264410fb2cfc13a1ee1c401 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:23.182493 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a6c0e60264410fb2cfc13a1ee1c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.182756 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a6c0e60264410fb2cfc13a1ee1c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.184533 10969 tablet_service.cc:1511] Processing CreateTablet for tablet dd24fce6502a4018a09ad3386b1a9cac (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:23.184459 10820 tablet_service.cc:1511] Processing CreateTablet for tablet dd24fce6502a4018a09ad3386b1a9cac (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:23.185917 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd24fce6502a4018a09ad3386b1a9cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.186113 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd24fce6502a4018a09ad3386b1a9cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.197279 10968 tablet_service.cc:1511] Processing CreateTablet for tablet d92e95e9412d45bcae577ea20e5a1b91 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:23.199043 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92e95e9412d45bcae577ea20e5a1b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.198956 10819 tablet_service.cc:1511] Processing CreateTablet for tablet d92e95e9412d45bcae577ea20e5a1b91 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:23.200557 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92e95e9412d45bcae577ea20e5a1b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.200265 10894 tablet_service.cc:1511] Processing CreateTablet for tablet d92e95e9412d45bcae577ea20e5a1b91 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:23.200659 10896 tablet_service.cc:1511] Processing CreateTablet for tablet 24a6c0e60264410fb2cfc13a1ee1c401 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:23.201763 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d92e95e9412d45bcae577ea20e5a1b91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.198783 10897 tablet_service.cc:1511] Processing CreateTablet for tablet 3dc984127dfe41429a126b65ef5298e4 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:23.202967 10895 tablet_service.cc:1511] Processing CreateTablet for tablet dd24fce6502a4018a09ad3386b1a9cac (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:23.203416 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc984127dfe41429a126b65ef5298e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.204563 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd24fce6502a4018a09ad3386b1a9cac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.207096 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a6c0e60264410fb2cfc13a1ee1c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.219791 10818 tablet_service.cc:1511] Processing CreateTablet for tablet ec1e336e5a334d659431d6c6fe1687c8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:23.221266 10818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1e336e5a334d659431d6c6fe1687c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.234938 10893 tablet_service.cc:1511] Processing CreateTablet for tablet ec1e336e5a334d659431d6c6fe1687c8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:23.236472 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1e336e5a334d659431d6c6fe1687c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.236166 10967 tablet_service.cc:1511] Processing CreateTablet for tablet ec1e336e5a334d659431d6c6fe1687c8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:23.237609 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1e336e5a334d659431d6c6fe1687c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.245980 10817 tablet_service.cc:1511] Processing CreateTablet for tablet 52e4a0ae09074c4ab0342b842878204c (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:23.247440 10817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e4a0ae09074c4ab0342b842878204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.249831 10966 tablet_service.cc:1511] Processing CreateTablet for tablet 52e4a0ae09074c4ab0342b842878204c (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:23.251273 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e4a0ae09074c4ab0342b842878204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.251690 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 52e4a0ae09074c4ab0342b842878204c (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:23.253018 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e4a0ae09074c4ab0342b842878204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.266315 10816 tablet_service.cc:1511] Processing CreateTablet for tablet 6c709d4217d7435884fbb0828779d9e8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:23.267825 10816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c709d4217d7435884fbb0828779d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.271747 10892 tablet_service.cc:1511] Processing CreateTablet for tablet 6c709d4217d7435884fbb0828779d9e8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:23.273200 10892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c709d4217d7435884fbb0828779d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.278264 10965 tablet_service.cc:1511] Processing CreateTablet for tablet 6c709d4217d7435884fbb0828779d9e8 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:23.279742 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c709d4217d7435884fbb0828779d9e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.291075 11021 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.313309 11022 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.322456 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 402d1c7b427346dcb3c93c4d73853ab2 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:23.323590 11021 tablet_bootstrap.cc:654] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.323937 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402d1c7b427346dcb3c93c4d73853ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.325996 11022 tablet_bootstrap.cc:654] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.338002 10895 tablet_service.cc:1511] Processing CreateTablet for tablet 402d1c7b427346dcb3c93c4d73853ab2 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:23.341207 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402d1c7b427346dcb3c93c4d73853ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.341281 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 402d1c7b427346dcb3c93c4d73853ab2 (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:23.344148 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402d1c7b427346dcb3c93c4d73853ab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.350176 11021 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.349572 10819 tablet_service.cc:1511] Processing CreateTablet for tablet ca68812caa7e4232a719d957b0c1938e (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:23.351269 11021 ts_tablet_manager.cc:1403] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.000s
I20260709 13:04:23.351537 11023 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.352242 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca68812caa7e4232a719d957b0c1938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.357420 10893 tablet_service.cc:1511] Processing CreateTablet for tablet ca68812caa7e4232a719d957b0c1938e (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:23.360491 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca68812caa7e4232a719d957b0c1938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.361884 10969 tablet_service.cc:1511] Processing CreateTablet for tablet ca68812caa7e4232a719d957b0c1938e (DEFAULT_TABLE table=test-workload [id=b96b752f2d914177826824f034f759db]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:23.365756 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca68812caa7e4232a719d957b0c1938e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:23.366580 11022 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.367312 11022 ts_tablet_manager.cc:1403] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.000s
I20260709 13:04:23.371035 11022 raft_consensus.cc:359] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.371675 11023 tablet_bootstrap.cc:654] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.381789 11022 raft_consensus.cc:385] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.382277 11022 raft_consensus.cc:740] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.383333 11022 consensus_queue.cc:260] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.376080 11021 raft_consensus.cc:359] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.389707 11021 raft_consensus.cc:385] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.390035 11021 raft_consensus.cc:740] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.390836 11021 consensus_queue.cc:260] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.393682 11006 heartbeater.cc:499] Master 127.0.107.254:34751 was elected leader, sending a full tablet report...
I20260709 13:04:23.394093 10932 heartbeater.cc:499] Master 127.0.107.254:34751 was elected leader, sending a full tablet report...
I20260709 13:04:23.395582 11022 ts_tablet_manager.cc:1434] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:04:23.397535 11022 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.398579 11021 ts_tablet_manager.cc:1434] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:04:23.400616 11021 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.402226 11028 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.402809 11028 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.405680 11022 tablet_bootstrap.cc:654] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.408831 11023 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.416081 11021 tablet_bootstrap.cc:654] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.416481 11023 ts_tablet_manager.cc:1403] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.007s
I20260709 13:04:23.420642 11023 raft_consensus.cc:359] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.410331 11028 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.427446 11023 raft_consensus.cc:385] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.427969 11023 raft_consensus.cc:740] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.432545 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.433986 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.429021 11023 consensus_queue.cc:260] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.434533 11021 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.435144 11021 ts_tablet_manager.cc:1403] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 13:04:23.436874 11022 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
W20260709 13:04:23.436939 10873 leader_election.cc:343] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:23.438042 10873 leader_election.cc:343] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.438109 11022 ts_tablet_manager.cc:1403] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 13:04:23.438133 11021 raft_consensus.cc:359] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.438527 10873 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3; no voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0
I20260709 13:04:23.439566 11028 raft_consensus.cc:2749] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.439222 11021 raft_consensus.cc:385] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.440379 11021 raft_consensus.cc:740] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.441097 11021 consensus_queue.cc:260] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.443074 11021 ts_tablet_manager.cc:1434] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:23.443039 11022 raft_consensus.cc:359] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.443812 11023 ts_tablet_manager.cc:1434] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:04:23.444124 11022 raft_consensus.cc:385] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.444303 11021 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.444501 11022 raft_consensus.cc:740] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.444648 10857 heartbeater.cc:499] Master 127.0.107.254:34751 was elected leader, sending a full tablet report...
I20260709 13:04:23.449185 11023 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.449581 11021 tablet_bootstrap.cc:654] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.454855 11021 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.455343 11021 ts_tablet_manager.cc:1403] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:04:23.455276 11022 consensus_queue.cc:260] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.457129 11023 tablet_bootstrap.cc:654] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.458544 11021 raft_consensus.cc:359] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.459335 11021 raft_consensus.cc:385] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.459669 11021 raft_consensus.cc:740] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.460758 11021 consensus_queue.cc:260] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.462576 11022 ts_tablet_manager.cc:1434] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:04:23.463819 11022 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.465473 11021 ts_tablet_manager.cc:1434] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:23.466931 11021 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.470942 11022 tablet_bootstrap.cc:654] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.474839 11021 tablet_bootstrap.cc:654] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.490486 11022 tablet_bootstrap.cc:492] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.491096 11022 ts_tablet_manager.cc:1403] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.015s
I20260709 13:04:23.495877 11022 raft_consensus.cc:359] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.496832 11022 raft_consensus.cc:385] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.497108 11022 raft_consensus.cc:740] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.497277 11023 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.498023 11023 ts_tablet_manager.cc:1403] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.022s
I20260709 13:04:23.497939 11022 consensus_queue.cc:260] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.499171 11021 tablet_bootstrap.cc:492] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.499694 11021 ts_tablet_manager.cc:1403] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.012s
I20260709 13:04:23.500562 11022 ts_tablet_manager.cc:1434] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:23.501703 11022 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.501446 11023 raft_consensus.cc:359] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.502413 11023 raft_consensus.cc:385] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.502800 11023 raft_consensus.cc:740] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.502640 11021 raft_consensus.cc:359] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.503626 11021 raft_consensus.cc:385] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.503983 11021 raft_consensus.cc:740] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.503780 11023 consensus_queue.cc:260] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.504963 11021 consensus_queue.cc:260] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.506373 11023 ts_tablet_manager.cc:1434] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:23.507525 11023 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.508800 11022 tablet_bootstrap.cc:654] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.511396 11021 ts_tablet_manager.cc:1434] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:23.512815 11021 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.514405 11023 tablet_bootstrap.cc:654] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.522830 11021 tablet_bootstrap.cc:654] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.532250 11022 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.532325 11021 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.533141 11022 ts_tablet_manager.cc:1403] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.016s
I20260709 13:04:23.533182 11021 ts_tablet_manager.cc:1403] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:04:23.536792 11021 raft_consensus.cc:359] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.536783 11022 raft_consensus.cc:359] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.537477 11023 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.537539 11021 raft_consensus.cc:385] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.537750 11022 raft_consensus.cc:385] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.538363 11021 raft_consensus.cc:740] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.538535 11023 ts_tablet_manager.cc:1403] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.008s
I20260709 13:04:23.538467 11022 raft_consensus.cc:740] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.539438 11021 consensus_queue.cc:260] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.539621 11022 consensus_queue.cc:260] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.541857 11021 ts_tablet_manager.cc:1434] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:23.541682 11023 raft_consensus.cc:359] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.542485 11023 raft_consensus.cc:385] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.542873 11023 raft_consensus.cc:740] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.543087 11021 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.543816 11023 consensus_queue.cc:260] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.546463 11022 ts_tablet_manager.cc:1434] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:04:23.546464 11023 ts_tablet_manager.cc:1434] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:23.547637 11023 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.547637 11022 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.554289 11021 tablet_bootstrap.cc:654] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.559585 11023 tablet_bootstrap.cc:654] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.554600 11022 tablet_bootstrap.cc:654] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.571511 11023 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.572029 11023 ts_tablet_manager.cc:1403] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:04:23.572104 11021 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.572729 11021 ts_tablet_manager.cc:1403] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.006s
I20260709 13:04:23.575528 11023 raft_consensus.cc:359] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.576288 11023 raft_consensus.cc:385] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.575904 11021 raft_consensus.cc:359] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.576643 11023 raft_consensus.cc:740] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.576782 11021 raft_consensus.cc:385] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.577195 11021 raft_consensus.cc:740] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.577636 11022 tablet_bootstrap.cc:492] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.577538 11023 consensus_queue.cc:260] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.578269 11022 ts_tablet_manager.cc:1403] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.008s
I20260709 13:04:23.578055 11021 consensus_queue.cc:260] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.579941 11023 ts_tablet_manager.cc:1434] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:04:23.580693 11021 ts_tablet_manager.cc:1434] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:04:23.580979 11023 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.581815 11021 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.581506 11022 raft_consensus.cc:359] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.582280 11022 raft_consensus.cc:385] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.582571 11022 raft_consensus.cc:740] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.584699 11022 consensus_queue.cc:260] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.588294 11023 tablet_bootstrap.cc:654] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.589201 11021 tablet_bootstrap.cc:654] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.599519 11022 ts_tablet_manager.cc:1434] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:04:23.601478 11022 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.601800 11021 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.602433 11021 ts_tablet_manager.cc:1403] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:04:23.603353 11032 raft_consensus.cc:493] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.603878 11032 raft_consensus.cc:515] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.606107 11023 tablet_bootstrap.cc:492] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.606771 11023 ts_tablet_manager.cc:1403] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:04:23.609897 11032 leader_election.cc:290] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.609907 11022 tablet_bootstrap.cc:654] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.613826 11023 raft_consensus.cc:359] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.618988 11023 raft_consensus.cc:385] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.619321 11023 raft_consensus.cc:740] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.620527 11028 raft_consensus.cc:493] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.620278 11023 consensus_queue.cc:260] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.621112 11028 raft_consensus.cc:515] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.622807 11023 ts_tablet_manager.cc:1434] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:23.623445 11028 leader_election.cc:290] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.623955 11023 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.625773 11027 raft_consensus.cc:493] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.625656 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.626380 11027 raft_consensus.cc:515] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.627533 10981 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:23.627805 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.624009 11028 raft_consensus.cc:493] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.628535 10832 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:23.629004 11028 raft_consensus.cc:515] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.630005 10873 leader_election.cc:304] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:23.632804 11023 tablet_bootstrap.cc:654] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.634276 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e4a0ae09074c4ab0342b842878204c" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.634852 11028 leader_election.cc:290] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.635051 10832 raft_consensus.cc:2468] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:23.635427 11028 raft_consensus.cc:2804] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.635911 11028 raft_consensus.cc:493] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.636319 11028 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.636358 10873 leader_election.cc:304] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:23.644166 11049 raft_consensus.cc:493] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.644753 11049 raft_consensus.cc:515] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.645581 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e4a0ae09074c4ab0342b842878204c" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.646286 10981 raft_consensus.cc:2468] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:23.650933 11023 tablet_bootstrap.cc:492] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.651517 11023 ts_tablet_manager.cc:1403] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.014s
I20260709 13:04:23.654565 11023 raft_consensus.cc:359] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.655249 11023 raft_consensus.cc:385] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.655543 11023 raft_consensus.cc:740] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.656478 11023 consensus_queue.cc:260] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.658030 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92e95e9412d45bcae577ea20e5a1b91" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.658766 10981 raft_consensus.cc:2468] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:23.659082 11023 ts_tablet_manager.cc:1434] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:04:23.660156 11023 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.659950 10798 leader_election.cc:304] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.660267 11027 leader_election.cc:290] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.660969 11032 raft_consensus.cc:2804] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.661345 11032 raft_consensus.cc:493] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.661684 11032 raft_consensus.cc:3060] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.667088 11023 tablet_bootstrap.cc:654] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.669448 11032 raft_consensus.cc:515] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.624826 11021 raft_consensus.cc:359] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.674360 11021 raft_consensus.cc:385] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.674837 11021 raft_consensus.cc:740] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.674604 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92e95e9412d45bcae577ea20e5a1b91" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:23.675769 10981 raft_consensus.cc:3060] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.675896 11021 consensus_queue.cc:260] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.678812 11023 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.679347 11023 ts_tablet_manager.cc:1403] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:04:23.682243 11023 raft_consensus.cc:359] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.682718 11032 leader_election.cc:290] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.682963 11023 raft_consensus.cc:385] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.683288 11023 raft_consensus.cc:740] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.684090 11023 consensus_queue.cc:260] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.686184 11022 tablet_bootstrap.cc:492] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.686717 11023 ts_tablet_manager.cc:1434] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:23.686743 11022 ts_tablet_manager.cc:1403] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.001s
I20260709 13:04:23.687928 11023 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.693795 10981 raft_consensus.cc:2468] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:23.694530 11023 tablet_bootstrap.cc:654] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.695127 10798 leader_election.cc:304] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.696091 11032 raft_consensus.cc:2804] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:23.698952 10778 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:23.703734 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92e95e9412d45bcae577ea20e5a1b91" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.704434 10907 raft_consensus.cc:2468] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:23.704962 11022 raft_consensus.cc:359] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.705904 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d92e95e9412d45bcae577ea20e5a1b91" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:23.706602 10907 raft_consensus.cc:3060] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.706005 11022 raft_consensus.cc:385] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.708345 11055 raft_consensus.cc:2804] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.709009 11055 raft_consensus.cc:493] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.709412 11055 raft_consensus.cc:3060] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.712208 11021 ts_tablet_manager.cc:1434] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.109s	user 0.003s	sys 0.003s
I20260709 13:04:23.719067 11028 raft_consensus.cc:515] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.721396 11049 leader_election.cc:290] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.723031 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.728739 10832 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.729852 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:23.730775 10981 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.723995 11027 raft_consensus.cc:493] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.734998 11027 raft_consensus.cc:515] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.737243 11027 leader_election.cc:290] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.738750 11028 leader_election.cc:290] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.740043 10832 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:23.741389 10873 leader_election.cc:304] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:23.724208 11021 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.708307 11022 raft_consensus.cc:740] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.726851 11032 raft_consensus.cc:697] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:23.744405 11032 consensus_queue.cc:237] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.746979 11022 consensus_queue.cc:260] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.750155 11022 ts_tablet_manager.cc:1434] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.002s
I20260709 13:04:23.751945 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.718286 10907 raft_consensus.cc:2468] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:23.752588 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.752718 10831 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.753561 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.754287 10830 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.755388 10947 leader_election.cc:304] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.756778 11027 raft_consensus.cc:2804] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.757129 11022 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.757149 11027 raft_consensus.cc:493] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.757987 11027 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.742772 11028 raft_consensus.cc:2804] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.759166 11028 raft_consensus.cc:697] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:23.760316 11028 consensus_queue.cc:237] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:23.766269 11027 raft_consensus.cc:515] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.770179 10947 leader_election.cc:304] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.754388 10832 raft_consensus.cc:2393] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd0fca555828416eacf5179cc3129db0 in current term 1: Already voted for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in this term.
I20260709 13:04:23.777763 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.777922 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.778542 10832 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.783885 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.784586 10907 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.785545 11023 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.786043 11023 ts_tablet_manager.cc:1403] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.070s
I20260709 13:04:23.786263 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:23.781024 11049 raft_consensus.cc:2804] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.786765 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.787138 11049 raft_consensus.cc:493] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.786949 10906 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.787549 10907 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.787694 11049 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.788597 10945 leader_election.cc:304] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd0fca555828416eacf5179cc3129db0; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:23.789168 11023 raft_consensus.cc:359] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.789867 11023 raft_consensus.cc:385] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.790189 11023 raft_consensus.cc:740] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.790935 11023 consensus_queue.cc:260] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.782730 11027 leader_election.cc:290] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.794885 11023 ts_tablet_manager.cc:1434] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:04:23.795719 11023 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:23.800482 10728 catalog_manager.cc:5697] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.804111 10981 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:23.811167 11022 tablet_bootstrap.cc:654] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.826263 11021 tablet_bootstrap.cc:654] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.814539 11027 raft_consensus.cc:2749] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.831126 11048 raft_consensus.cc:493] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.832758 10906 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:23.837651 11049 raft_consensus.cc:515] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.855140 11023 tablet_bootstrap.cc:654] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.859135 11032 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.859781 11032 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.862157 11027 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.862705 11027 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.863399 11032 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.863754 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.864540 10907 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:23.864593 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.865444 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.865239 10981 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:23.867703 10830 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.870719 10947 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
W20260709 13:04:23.871766 10945 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:36687, user_credentials={real_user=slave}} blocked reactor thread for 83205.2us
I20260709 13:04:23.876103 11049 leader_election.cc:290] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.847955 11048 raft_consensus.cc:515] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.876559 10945 leader_election.cc:304] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.873371 10832 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:23.878408 11049 raft_consensus.cc:2804] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.878849 11049 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.878007 10726 catalog_manager.cc:5697] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.879209 11049 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.881440 10796 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:23.865566 11055 raft_consensus.cc:515] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.883829 11032 raft_consensus.cc:2804] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.884804 11032 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.887048 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:23.887955 10906 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.885135 11032 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.885335 11059 raft_consensus.cc:2804] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.900626 11059 raft_consensus.cc:697] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:23.902024 11059 consensus_queue.cc:237] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.911005 11027 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.912371 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:23.912606 11048 leader_election.cc:290] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.913093 10907 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:23.913533 11049 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.915721 11049 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:23.915769 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c709d4217d7435884fbb0828779d9e8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.916445 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.916558 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.916857 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c709d4217d7435884fbb0828779d9e8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.916492 10830 raft_consensus.cc:2468] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:23.918314 10832 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:23.920938 10873 leader_election.cc:343] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.920599 10729 catalog_manager.cc:5697] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.921777 10873 leader_election.cc:304] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: cd0fca555828416eacf5179cc3129db0
I20260709 13:04:23.922802 11022 tablet_bootstrap.cc:492] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.923312 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:23.923398 11022 ts_tablet_manager.cc:1403] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.026s
I20260709 13:04:23.923970 10907 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.925472 11023 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:23.925967 11023 ts_tablet_manager.cc:1403] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.130s	user 0.014s	sys 0.015s
I20260709 13:04:23.926797 11048 raft_consensus.cc:2804] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.927202 11048 raft_consensus.cc:493] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.927558 11048 raft_consensus.cc:3060] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.927644 10832 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:23.928465 11023 raft_consensus.cc:359] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.929215 11023 raft_consensus.cc:385] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.929054 10947 leader_election.cc:304] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.929554 11023 raft_consensus.cc:740] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.929984 11049 raft_consensus.cc:2804] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.930383 11023 consensus_queue.cc:260] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.932967 11021 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:23.933490 11021 ts_tablet_manager.cc:1403] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.210s	user 0.010s	sys 0.005s
I20260709 13:04:23.930526 11049 raft_consensus.cc:697] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:23.935048 11023 ts_tablet_manager.cc:1434] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:23.935712 11022 raft_consensus.cc:359] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.937779 11022 raft_consensus.cc:385] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.938268 11022 raft_consensus.cc:740] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.937587 11049 consensus_queue.cc:237] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.939141 11022 consensus_queue.cc:260] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.940250 11021 raft_consensus.cc:359] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.941018 11021 raft_consensus.cc:385] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.941336 11021 raft_consensus.cc:740] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.941742 11022 ts_tablet_manager.cc:1434] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:23.942134 11021 consensus_queue.cc:260] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.942847 11022 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:23.944591 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e4a0ae09074c4ab0342b842878204c" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:23.945447 10981 raft_consensus.cc:3060] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.943375 11055 leader_election.cc:290] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.949316 10907 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:23.946200 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52e4a0ae09074c4ab0342b842878204c" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.950949 11022 tablet_bootstrap.cc:654] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.954963 11048 raft_consensus.cc:515] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.954955 11032 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.961082 10831 raft_consensus.cc:2393] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd0fca555828416eacf5179cc3129db0 in current term 1: Already voted for candidate c36caa3aefdd42469d83005641bb9cf7 in this term.
I20260709 13:04:23.956143 10981 raft_consensus.cc:2468] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:23.957265 10906 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:23.962682 11061 raft_consensus.cc:493] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.963142 11061 raft_consensus.cc:515] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.963868 10873 leader_election.cc:304] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.965098 11055 raft_consensus.cc:2804] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.965551 11055 raft_consensus.cc:697] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:23.965622 11061 leader_election.cc:290] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.958843 11021 ts_tablet_manager.cc:1434] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:04:23.967182 11021 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:23.960035 10945 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:23.970242 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:23.970782 11027 raft_consensus.cc:2804] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.970242 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:23.971529 11027 raft_consensus.cc:697] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:23.972242 10907 raft_consensus.cc:2393] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c36caa3aefdd42469d83005641bb9cf7 in current term 1: Already voted for candidate cd0fca555828416eacf5179cc3129db0 in this term.
I20260709 13:04:23.968441 11032 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.966496 11055 consensus_queue.cc:237] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.972813 11027 consensus_queue.cc:237] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:23.974088 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:23.959412 10832 raft_consensus.cc:3060] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.976475 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c709d4217d7435884fbb0828779d9e8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:23.977449 11021 tablet_bootstrap.cc:654] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.977497 11048 leader_election.cc:290] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:23.977824 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:23.983927 11022 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:23.993463 11022 ts_tablet_manager.cc:1403] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.003s
I20260709 13:04:23.987504 10830 raft_consensus.cc:3060] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.978928 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c709d4217d7435884fbb0828779d9e8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:23.999747 10979 raft_consensus.cc:3060] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.002318 10832 raft_consensus.cc:2468] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:23.986140 10831 raft_consensus.cc:2468] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
W20260709 13:04:23.993503 10873 leader_election.cc:343] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:24.007315 10873 leader_election.cc:304] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: cd0fca555828416eacf5179cc3129db0
I20260709 13:04:24.009095 11048 raft_consensus.cc:2804] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:24.009599 11048 raft_consensus.cc:493] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.009994 11048 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.017879 10979 raft_consensus.cc:2468] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:24.027565 10830 raft_consensus.cc:2468] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:24.028414 10798 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0
I20260709 13:04:24.029192 11032 raft_consensus.cc:2749] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:24.022982 11048 raft_consensus.cc:515] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.025640 11022 raft_consensus.cc:359] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.030066 11022 raft_consensus.cc:385] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.030912 11022 raft_consensus.cc:740] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.031392 11048 leader_election.cc:290] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.031828 11022 consensus_queue.cc:260] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.029953 10873 leader_election.cc:304] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:24.034592 11021 tablet_bootstrap.cc:492] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:24.034559 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:24.035342 11021 ts_tablet_manager.cc:1403] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 13:04:24.035471 10830 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.036660 11048 raft_consensus.cc:2804] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:24.036540 10729 catalog_manager.cc:5697] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.037981 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.038224 11021 raft_consensus.cc:359] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.038939 11021 raft_consensus.cc:385] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.039274 11021 raft_consensus.cc:740] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
W20260709 13:04:24.039497 10873 leader_election.cc:343] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:24.040198 11021 consensus_queue.cc:260] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.041781 11021 ts_tablet_manager.cc:1434] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:24.036005 11022 ts_tablet_manager.cc:1434] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 13:04:24.042583 10728 catalog_manager.cc:5697] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.043569 11022 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:24.043769 10830 raft_consensus.cc:2468] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:24.046221 10873 leader_election.cc:304] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: cd0fca555828416eacf5179cc3129db0
I20260709 13:04:24.044586 10728 catalog_manager.cc:5697] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.047080 11055 raft_consensus.cc:2804] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:24.048007 11055 raft_consensus.cc:697] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:24.037187 11048 raft_consensus.cc:697] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:24.048936 11055 consensus_queue.cc:237] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.050128 11048 consensus_queue.cc:237] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.050720 11022 tablet_bootstrap.cc:654] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:24.059945 11022 tablet_bootstrap.cc:492] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:24.060521 11022 ts_tablet_manager.cc:1403] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:04:24.062377 11022 raft_consensus.cc:359] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.062948 11022 raft_consensus.cc:385] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.063230 11022 raft_consensus.cc:740] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.063952 11022 consensus_queue.cc:260] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.066188 11022 ts_tablet_manager.cc:1434] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:24.069100 10728 catalog_manager.cc:5697] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.083154 10728 catalog_manager.cc:5697] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:24.124837 10858 tablet.cc:2406] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:24.137583 11027 raft_consensus.cc:493] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.138206 11027 raft_consensus.cc:515] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.140101 11027 leader_election.cc:290] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:24.140846 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:24.141086 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:24.141644 10830 raft_consensus.cc:2393] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd0fca555828416eacf5179cc3129db0 in current term 1: Already voted for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in this term.
I20260709 13:04:24.142602 10947 leader_election.cc:304] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd0fca555828416eacf5179cc3129db0; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:24.143309 11027 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.148221 11027 raft_consensus.cc:2749] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:24.174779 11048 consensus_queue.cc:1048] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.186643 11056 raft_consensus.cc:493] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.187184 11056 raft_consensus.cc:515] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.189344 11056 leader_election.cc:290] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.189620 11055 consensus_queue.cc:1048] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.190436 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:24.191123 10907 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:24.192423 10796 leader_election.cc:304] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:24.193126 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:24.193303 11056 raft_consensus.cc:2804] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:24.193857 10980 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:24.194394 11056 raft_consensus.cc:493] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.194907 11056 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.202859 11056 raft_consensus.cc:515] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.205613 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:24.206131 10907 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.206554 11056 leader_election.cc:290] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.205958 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.207543 10979 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.212796 10979 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:24.213183 10907 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:24.213816 10798 leader_election.cc:304] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:24.214677 11056 raft_consensus.cc:2804] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:24.215176 11056 raft_consensus.cc:697] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:24.215942 11056 consensus_queue.cc:237] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.222905 10729 catalog_manager.cc:5697] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.303256 11056 consensus_queue.cc:1048] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.312515 11056 consensus_queue.cc:1048] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:24.327854 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4"
dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
mode: GRACEFUL
new_leader_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:35990
I20260709 13:04:24.328536 10907 raft_consensus.cc:606] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Received request to transfer leadership to TS c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:24.336207 11027 consensus_queue.cc:1048] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.345307 10979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
mode: GRACEFUL
new_leader_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:24.345924 10979 raft_consensus.cc:606] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Received request to transfer leadership to TS c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:24.347703 11049 consensus_queue.cc:1048] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.356066 11027 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:24.359644 10979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
mode: GRACEFUL
new_leader_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:24.360186 10979 raft_consensus.cc:606] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Received request to transfer leadership to TS c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:24.369645 11059 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.370185 10979 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
mode: GRACEFUL
new_leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:24.370905 10979 raft_consensus.cc:606] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Received request to transfer leadership to TS 1d186d6cf7074148a7bb7ed9fd95f3a3
I20260709 13:04:24.382684 11049 raft_consensus.cc:993] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: : Instructing follower c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.383205 11062 raft_consensus.cc:1081] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Signalling peer c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.384928 10830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:24.385519 10830 raft_consensus.cc:493] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.385913 10830 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.392935 10830 raft_consensus.cc:515] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.394937 10830 leader_election.cc:290] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.396024 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:24.395998 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.396869 10906 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.396926 10979 raft_consensus.cc:3055] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.397559 10979 raft_consensus.cc:740] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:24.398484 10979 consensus_queue.cc:260] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.399796 10979 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.405058 10906 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.406504 10796 leader_election.cc:304] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:24.406994 10979 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.407310 11056 raft_consensus.cc:2804] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.407892 11056 raft_consensus.cc:697] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:24.408640 11056 consensus_queue.cc:237] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.411712 10830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
mode: GRACEFUL
new_leader_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45144
I20260709 13:04:24.412334 10830 raft_consensus.cc:606] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Received request to transfer leadership to TS cd0fca555828416eacf5179cc3129db0
I20260709 13:04:24.416266 10728 catalog_manager.cc:5697] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 1 to 2, leader changed from cd0fca555828416eacf5179cc3129db0 (127.0.107.195) to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.425707 11062 consensus_queue.cc:1048] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.436473 11028 consensus_queue.cc:1048] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.441836 11059 consensus_queue.cc:1048] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.453186 11055 consensus_queue.cc:1048] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.460753 11049 raft_consensus.cc:993] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: : Instructing follower c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.461237 11049 raft_consensus.cc:1081] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Signalling peer c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.463071 10830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:24.463642 10830 raft_consensus.cc:493] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.463903 10830 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.469952 10830 raft_consensus.cc:515] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.472280 10830 leader_election.cc:290] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.473217 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:24.473982 10906 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.474020 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd24fce6502a4018a09ad3386b1a9cac" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.474769 10979 raft_consensus.cc:3055] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.475088 10979 raft_consensus.cc:740] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:24.475909 10979 consensus_queue.cc:260] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.476857 10979 raft_consensus.cc:3060] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.482132 10906 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.483206 10979 raft_consensus.cc:2468] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.483480 11028 consensus_queue.cc:1048] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:24.483877 10796 leader_election.cc:304] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:24.484778 11056 raft_consensus.cc:2804] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.485191 11056 raft_consensus.cc:697] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:24.485986 11056 consensus_queue.cc:237] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.492795 10728 catalog_manager.cc:5697] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 1 to 2, leader changed from cd0fca555828416eacf5179cc3129db0 (127.0.107.195) to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.501215 11055 consensus_queue.cc:1048] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:24.501609 11048 consensus_queue.cc:1048] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.527616 11055 consensus_queue.cc:1048] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.667517 11056 consensus_queue.cc:1048] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.678673 11089 consensus_queue.cc:1048] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:24.685673 11032 raft_consensus.cc:993] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: : Instructing follower cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:24.686153 11032 raft_consensus.cc:1081] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Signalling peer cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:24.687646 10979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:04:24.688143 10979 raft_consensus.cc:493] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.688446 10979 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.693977 10979 raft_consensus.cc:515] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.695905 10979 leader_election.cc:290] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:24.696643 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:24.697511 10830 raft_consensus.cc:3055] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.697855 10830 raft_consensus.cc:740] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:24.698036 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca68812caa7e4232a719d957b0c1938e" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:24.698747 10906 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.698729 10830 consensus_queue.cc:260] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.700232 10830 raft_consensus.cc:3060] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.707058 10906 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:24.707278 10830 raft_consensus.cc:2468] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:24.708321 10945 leader_election.cc:304] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:24.709074 11059 raft_consensus.cc:2804] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.709573 11059 raft_consensus.cc:697] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:24.710693 11059 consensus_queue.cc:237] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.716701 10726 catalog_manager.cc:5697] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 1 to 2, leader changed from c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193) to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.725277 11104 raft_consensus.cc:993] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: : Instructing follower c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.725752 11055 raft_consensus.cc:1081] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Signalling peer c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:24.727252 10830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45130
I20260709 13:04:24.727737 10830 raft_consensus.cc:493] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.728040 10830 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.735693 10830 raft_consensus.cc:515] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:24.738001 10830 leader_election.cc:290] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Requested vote from peers cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:24.738835 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.739058 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dc984127dfe41429a126b65ef5298e4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:24.739514 10979 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.739596 10906 raft_consensus.cc:3055] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.740010 10906 raft_consensus.cc:740] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:24.740816 10906 consensus_queue.cc:260] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:24.742089 10906 raft_consensus.cc:3060] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.746958 10979 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.748370 10798 leader_election.cc:304] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:24.749198 11089 raft_consensus.cc:2804] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.749428 10906 raft_consensus.cc:2468] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:24.749667 11089 raft_consensus.cc:697] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:24.750751 11089 consensus_queue.cc:237] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } }
I20260709 13:04:24.757129 10726 catalog_manager.cc:5697] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 1 to 2, leader changed from 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194) to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.853291 10979 raft_consensus.cc:1275] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.855993 11089 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.872933 10906 raft_consensus.cc:1275] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.874766 11089 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.909312 11049 raft_consensus.cc:993] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: : Instructing follower 1d186d6cf7074148a7bb7ed9fd95f3a3 to start an election
I20260709 13:04:24.910370 11059 raft_consensus.cc:1081] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Signalling peer 1d186d6cf7074148a7bb7ed9fd95f3a3 to start an election
I20260709 13:04:24.915272 10906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8"
dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
 from {username='slave'} at 127.0.0.1:35980
I20260709 13:04:24.916127 10906 raft_consensus.cc:493] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.916460 10906 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.924499 10906 raft_consensus.cc:515] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.926281 10906 leader_election.cc:290] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 2 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:24.927410 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:24.927881 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1e336e5a334d659431d6c6fe1687c8" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:24.928352 10830 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.928579 10979 raft_consensus.cc:3055] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.928951 10979 raft_consensus.cc:740] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:24.930087 10979 consensus_queue.cc:260] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.932183 10979 raft_consensus.cc:3060] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.939347 10830 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 2.
I20260709 13:04:24.941114 10873 leader_election.cc:304] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:24.942203 11055 raft_consensus.cc:2804] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.942373 10979 raft_consensus.cc:2468] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 2.
I20260709 13:04:24.942780 11055 raft_consensus.cc:697] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:24.944131 11055 consensus_queue.cc:237] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:24.950489 10906 raft_consensus.cc:1275] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.951861 11089 consensus_queue.cc:1048] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:24.951606 10726 catalog_manager.cc:5697] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 1 to 2, leader changed from cd0fca555828416eacf5179cc3129db0 (127.0.107.195) to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.962494 10979 raft_consensus.cc:1275] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:24.964540 11032 consensus_queue.cc:1048] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.093287 10830 raft_consensus.cc:1275] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.094780 11059 consensus_queue.cc:1048] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.104574 10906 raft_consensus.cc:1275] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.106110 11027 consensus_queue.cc:1048] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.268599 10980 raft_consensus.cc:1275] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.270203 11032 consensus_queue.cc:1048] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.280856 10906 raft_consensus.cc:1275] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.282675 11056 consensus_queue.cc:1048] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:25.330763 10830 raft_consensus.cc:1275] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Refusing update from remote peer 1d186d6cf7074148a7bb7ed9fd95f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.332016 11055 consensus_queue.cc:1048] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.340968 10980 raft_consensus.cc:1275] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer 1d186d6cf7074148a7bb7ed9fd95f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.342361 11055 consensus_queue.cc:1048] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:27.450800 10726 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56538:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:27.453152 10726 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:27.503688 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 35400d1199c54bda8caaaa4e3dd56da4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.504483 10893 tablet_service.cc:1511] Processing CreateTablet for tablet 35400d1199c54bda8caaaa4e3dd56da4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.505474 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35400d1199c54bda8caaaa4e3dd56da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.506141 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35400d1199c54bda8caaaa4e3dd56da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.506356 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 35400d1199c54bda8caaaa4e3dd56da4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:27.507843 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35400d1199c54bda8caaaa4e3dd56da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.512382 10895 tablet_service.cc:1511] Processing CreateTablet for tablet 1032620b427c4a7890d28cf95b7b5ee6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.513936 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1032620b427c4a7890d28cf95b7b5ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.523840 10819 tablet_service.cc:1511] Processing CreateTablet for tablet 1032620b427c4a7890d28cf95b7b5ee6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.525297 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1032620b427c4a7890d28cf95b7b5ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.527832 10816 tablet_service.cc:1511] Processing CreateTablet for tablet 4091b1a32ad74f37aea3250944f3d299 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.529204 10816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4091b1a32ad74f37aea3250944f3d299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.532040 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.533517 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.535854 10818 tablet_service.cc:1511] Processing CreateTablet for tablet c232a7cf5a4a4f46abadd4724bf40aad (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.537225 10818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c232a7cf5a4a4f46abadd4724bf40aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.541512 10892 tablet_service.cc:1511] Processing CreateTablet for tablet 4091b1a32ad74f37aea3250944f3d299 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.541805 10897 tablet_service.cc:1511] Processing CreateTablet for tablet c232a7cf5a4a4f46abadd4724bf40aad (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.542520 10896 tablet_service.cc:1511] Processing CreateTablet for tablet ff8cc87787c440d981513d0d747e10e6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.543006 10892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4091b1a32ad74f37aea3250944f3d299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.543962 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8cc87787c440d981513d0d747e10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.544369 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.545694 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.548386 10891 tablet_service.cc:1511] Processing CreateTablet for tablet b0e57d33780c423abcfd84231c71ae53 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.549288 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c232a7cf5a4a4f46abadd4724bf40aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.550192 10891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e57d33780c423abcfd84231c71ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.551895 10966 tablet_service.cc:1511] Processing CreateTablet for tablet c232a7cf5a4a4f46abadd4724bf40aad (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:27.553298 10966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c232a7cf5a4a4f46abadd4724bf40aad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.553177 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:27.555588 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 1032620b427c4a7890d28cf95b7b5ee6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:27.554572 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ac412bbdc74b0a8f21c9b6e6fef5c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.558079 10965 tablet_service.cc:1511] Processing CreateTablet for tablet 4091b1a32ad74f37aea3250944f3d299 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:27.559914 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1032620b427c4a7890d28cf95b7b5ee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.560810 10890 tablet_service.cc:1511] Processing CreateTablet for tablet b2309124e32f4b289ded8e77a1a417bf (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.562296 10890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2309124e32f4b289ded8e77a1a417bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.562816 10817 tablet_service.cc:1511] Processing CreateTablet for tablet b0e57d33780c423abcfd84231c71ae53 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.563633 10965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4091b1a32ad74f37aea3250944f3d299. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.564213 10817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e57d33780c423abcfd84231c71ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.563849 10822 tablet_service.cc:1511] Processing CreateTablet for tablet ff8cc87787c440d981513d0d747e10e6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.567468 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8cc87787c440d981513d0d747e10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.571964 10968 tablet_service.cc:1511] Processing CreateTablet for tablet ff8cc87787c440d981513d0d747e10e6 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:27.573473 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8cc87787c440d981513d0d747e10e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.574980 10815 tablet_service.cc:1511] Processing CreateTablet for tablet b2309124e32f4b289ded8e77a1a417bf (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.576440 10815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2309124e32f4b289ded8e77a1a417bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.576534 10964 tablet_service.cc:1511] Processing CreateTablet for tablet b2309124e32f4b289ded8e77a1a417bf (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:27.577890 10964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2309124e32f4b289ded8e77a1a417bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.579941 10889 tablet_service.cc:1511] Processing CreateTablet for tablet 346f595f3da14bcebfd5d57a1e296b0e (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.580129 10971 tablet_service.cc:1511] Processing CreateTablet for tablet b0e57d33780c423abcfd84231c71ae53 (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:27.581420 10889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346f595f3da14bcebfd5d57a1e296b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.581604 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e57d33780c423abcfd84231c71ae53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.583964 10963 tablet_service.cc:1511] Processing CreateTablet for tablet 346f595f3da14bcebfd5d57a1e296b0e (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.584431 10814 tablet_service.cc:1511] Processing CreateTablet for tablet 346f595f3da14bcebfd5d57a1e296b0e (DEFAULT_TABLE table=soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:27.585819 10814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346f595f3da14bcebfd5d57a1e296b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.589660 10963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346f595f3da14bcebfd5d57a1e296b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.590377 11127 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.648978 11127 tablet_bootstrap.cc:654] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.724191 11128 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
W20260709 13:04:27.739457 10778 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:27.749014 11130 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:27.751449 11127 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.752074 11127 ts_tablet_manager.cc:1403] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.000s
I20260709 13:04:27.756870 11130 tablet_bootstrap.cc:654] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:27.756939 10798 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43575, user_credentials={real_user=slave}} blocked reactor thread for 63153.9us
I20260709 13:04:27.756870 11128 tablet_bootstrap.cc:654] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.761650 11127 raft_consensus.cc:359] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.768231 11127 raft_consensus.cc:385] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.768771 11127 raft_consensus.cc:740] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.769742 11127 consensus_queue.cc:260] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.772362 11127 ts_tablet_manager.cc:1434] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:04:27.773759 11127 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.780692 11127 tablet_bootstrap.cc:654] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.792780 11127 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.793408 11127 ts_tablet_manager.cc:1403] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:04:27.794263 11128 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:27.794909 11128 ts_tablet_manager.cc:1403] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.024s
I20260709 13:04:27.795183 11130 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:27.795718 11130 ts_tablet_manager.cc:1403] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.016s
I20260709 13:04:27.796191 11127 raft_consensus.cc:359] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.796940 11127 raft_consensus.cc:385] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.797243 11127 raft_consensus.cc:740] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.798062 11127 consensus_queue.cc:260] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.798126 11128 raft_consensus.cc:359] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.799013 11128 raft_consensus.cc:385] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.798734 11130 raft_consensus.cc:359] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.799378 11128 raft_consensus.cc:740] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.799556 11130 raft_consensus.cc:385] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.800053 11130 raft_consensus.cc:740] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.800369 11127 ts_tablet_manager.cc:1434] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:27.800372 11128 consensus_queue.cc:260] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.800951 11130 consensus_queue.cc:260] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.801599 11127 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.803566 11128 ts_tablet_manager.cc:1434] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:27.805908 11130 ts_tablet_manager.cc:1434] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:27.810262 11130 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:27.813045 11127 tablet_bootstrap.cc:654] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.813946 11128 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:27.820735 11130 tablet_bootstrap.cc:654] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.820860 11127 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.821463 11127 ts_tablet_manager.cc:1403] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:04:27.824322 11127 raft_consensus.cc:359] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.825044 11127 raft_consensus.cc:385] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.825343 11127 raft_consensus.cc:740] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.826200 11127 consensus_queue.cc:260] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.828439 11127 ts_tablet_manager.cc:1434] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:27.829408 11127 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.829828 11128 tablet_bootstrap.cc:654] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.832389 11130 tablet_bootstrap.cc:492] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:27.832999 11130 ts_tablet_manager.cc:1403] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.009s
I20260709 13:04:27.835611 11127 tablet_bootstrap.cc:654] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.836047 11130 raft_consensus.cc:359] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.836890 11130 raft_consensus.cc:385] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.837224 11130 raft_consensus.cc:740] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.837687 11112 raft_consensus.cc:493] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.838027 11130 consensus_queue.cc:260] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.838189 11112 raft_consensus.cc:515] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.843089 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:27.845391 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
W20260709 13:04:27.845813 10945 leader_election.cc:343] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.846717 11112 leader_election.cc:290] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
W20260709 13:04:27.847790 10947 leader_election.cc:343] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.848464 10947 leader_election.cc:304] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd0fca555828416eacf5179cc3129db0; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:27.850129 11129 raft_consensus.cc:493] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.850817 11129 raft_consensus.cc:515] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.853760 11129 leader_election.cc:290] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:27.856616 11056 raft_consensus.cc:493] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.857234 11056 raft_consensus.cc:515] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.857584 11112 raft_consensus.cc:2749] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.861431 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35400d1199c54bda8caaaa4e3dd56da4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:27.862386 10979 raft_consensus.cc:2468] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:27.863878 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35400d1199c54bda8caaaa4e3dd56da4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:27.864766 10906 raft_consensus.cc:2468] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:27.866182 10798 leader_election.cc:304] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:27.868870 11056 leader_election.cc:290] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:27.869865 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:27.871349 11129 raft_consensus.cc:2804] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.873054 11129 raft_consensus.cc:493] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.873572 11129 raft_consensus.cc:3060] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:27.883651 10796 leader_election.cc:343] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.889323 11130 ts_tablet_manager.cc:1434] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.056s	user 0.019s	sys 0.036s
I20260709 13:04:27.890439 11130 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:27.891426 11128 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:27.892019 11128 ts_tablet_manager.cc:1403] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.035s
I20260709 13:04:27.894585 11127 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.895153 11127 ts_tablet_manager.cc:1403] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.005s
I20260709 13:04:27.895277 11128 raft_consensus.cc:359] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.896152 11128 raft_consensus.cc:385] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.896507 11128 raft_consensus.cc:740] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.897243 11130 tablet_bootstrap.cc:654] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.898447 11127 raft_consensus.cc:359] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.899801 11127 raft_consensus.cc:385] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.897550 11128 consensus_queue.cc:260] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.900205 11127 raft_consensus.cc:740] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.900951 11127 consensus_queue.cc:260] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.892488 11129 raft_consensus.cc:515] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.903373 11129 leader_election.cc:290] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:27.908496 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35400d1199c54bda8caaaa4e3dd56da4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:27.909111 10906 raft_consensus.cc:3060] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.909155 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:27.911640 11127 ts_tablet_manager.cc:1434] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:27.912729 11127 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.915750 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35400d1199c54bda8caaaa4e3dd56da4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:27.916679 10980 raft_consensus.cc:3060] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.919019 10906 raft_consensus.cc:2468] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:27.920312 11127 tablet_bootstrap.cc:654] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.920466 10796 leader_election.cc:304] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:27.922303 11129 raft_consensus.cc:2804] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.922771 11129 raft_consensus.cc:697] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:27.923629 11129 consensus_queue.cc:237] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.924245 11128 ts_tablet_manager.cc:1434] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:04:27.932242 11128 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
W20260709 13:04:27.940979 10798 leader_election.cc:343] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.941973 10798 leader_election.cc:304] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0
I20260709 13:04:27.947994 11129 raft_consensus.cc:2749] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.951439 10980 raft_consensus.cc:2468] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:27.954562 11128 tablet_bootstrap.cc:654] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.954753 11130 tablet_bootstrap.cc:492] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:27.955380 11130 ts_tablet_manager.cc:1403] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.065s	user 0.035s	sys 0.017s
I20260709 13:04:27.958770 11127 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.959323 11127 ts_tablet_manager.cc:1403] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.004s
I20260709 13:04:27.959810 11130 raft_consensus.cc:359] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.960669 11130 raft_consensus.cc:385] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.960985 11130 raft_consensus.cc:740] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.961285 10729 catalog_manager.cc:5697] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.961748 11130 consensus_queue.cc:260] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.962591 11127 raft_consensus.cc:359] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.963442 11127 raft_consensus.cc:385] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.963742 11127 raft_consensus.cc:740] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.964404 11130 ts_tablet_manager.cc:1434] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:27.964570 11127 consensus_queue.cc:260] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.965436 11130 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:27.966807 11127 ts_tablet_manager.cc:1434] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:27.967895 11127 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:27.971621 11130 tablet_bootstrap.cc:654] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.974607 11128 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:27.975713 11128 ts_tablet_manager.cc:1403] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.002s
I20260709 13:04:27.977449 11127 tablet_bootstrap.cc:654] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.978974 11128 raft_consensus.cc:359] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.979821 11128 raft_consensus.cc:385] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.980229 11128 raft_consensus.cc:740] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.981215 11128 consensus_queue.cc:260] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:27.984108 11128 ts_tablet_manager.cc:1434] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:04:27.985584 11128 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:27.996335 11128 tablet_bootstrap.cc:654] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.997162 11130 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:27.997344 11127 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:27.997829 11130 ts_tablet_manager.cc:1403] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.017s
I20260709 13:04:27.998036 11127 ts_tablet_manager.cc:1403] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.013s
I20260709 13:04:28.001094 11130 raft_consensus.cc:359] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.001711 11130 raft_consensus.cc:385] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.001968 11130 raft_consensus.cc:740] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.002869 11128 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.002718 11130 consensus_queue.cc:260] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.003494 11128 ts_tablet_manager.cc:1403] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:04:28.005527 11130 ts_tablet_manager.cc:1434] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:28.006762 11130 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:28.006856 11128 raft_consensus.cc:359] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.008013 11128 raft_consensus.cc:385] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.008287 11128 raft_consensus.cc:740] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.008988 11128 consensus_queue.cc:260] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.011175 11128 ts_tablet_manager.cc:1434] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:28.012022 11128 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:28.014057 11130 tablet_bootstrap.cc:654] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.018585 11128 tablet_bootstrap.cc:654] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.019268 11127 raft_consensus.cc:359] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.024113 11127 raft_consensus.cc:385] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.024536 11127 raft_consensus.cc:740] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.025473 11127 consensus_queue.cc:260] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.028604 11128 tablet_bootstrap.cc:492] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.029158 11128 ts_tablet_manager.cc:1403] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:04:28.029369 11130 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:28.029927 11130 ts_tablet_manager.cc:1403] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:04:28.032133 11127 ts_tablet_manager.cc:1434] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:04:28.031997 11128 raft_consensus.cc:359] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.032896 11128 raft_consensus.cc:385] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.033253 11128 raft_consensus.cc:740] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.033459 11127 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:28.034238 11128 consensus_queue.cc:260] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.036437 11128 ts_tablet_manager.cc:1434] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:28.037590 11128 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:28.038890 11130 raft_consensus.cc:359] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.039723 11130 raft_consensus.cc:385] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.040059 11130 raft_consensus.cc:740] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.040880 11130 consensus_queue.cc:260] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.043488 11130 ts_tablet_manager.cc:1434] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:04:28.044190 11127 tablet_bootstrap.cc:654] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.044626 11130 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:28.047498 11128 tablet_bootstrap.cc:654] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.052649 11130 tablet_bootstrap.cc:654] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.058684 11127 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:28.059453 11127 ts_tablet_manager.cc:1403] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:04:28.061494 11128 tablet_bootstrap.cc:492] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.061980 11128 ts_tablet_manager.cc:1403] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 13:04:28.062348 11130 tablet_bootstrap.cc:492] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:28.062909 11130 ts_tablet_manager.cc:1403] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:04:28.062601 11127 raft_consensus.cc:359] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.063386 11127 raft_consensus.cc:385] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.063719 11127 raft_consensus.cc:740] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.064638 11128 raft_consensus.cc:359] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.064545 11127 consensus_queue.cc:260] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.065263 11128 raft_consensus.cc:385] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.065593 11128 raft_consensus.cc:740] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.066020 11130 raft_consensus.cc:359] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.066354 11128 consensus_queue.cc:260] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.066888 11130 raft_consensus.cc:385] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.067296 11130 raft_consensus.cc:740] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.067351 11127 ts_tablet_manager.cc:1434] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:28.068181 11130 consensus_queue.cc:260] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.068708 11127 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:28.068768 11128 ts_tablet_manager.cc:1434] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:28.070858 11130 ts_tablet_manager.cc:1434] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:28.071882 11130 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:28.074393 11128 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:28.076061 11127 tablet_bootstrap.cc:654] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.078563 11130 tablet_bootstrap.cc:654] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.079001 11116 raft_consensus.cc:493] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.079541 11116 raft_consensus.cc:515] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.081753 11116 leader_election.cc:290] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.083165 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2309124e32f4b289ded8e77a1a417bf" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.083501 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2309124e32f4b289ded8e77a1a417bf" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.083864 10980 raft_consensus.cc:2468] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.084121 10830 raft_consensus.cc:2468] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.085141 10873 leader_election.cc:304] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:28.081769 11128 tablet_bootstrap.cc:654] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.091972 11127 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:28.092645 11127 ts_tablet_manager.cc:1403] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.006s
I20260709 13:04:28.092844 11116 raft_consensus.cc:2804] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.093412 11116 raft_consensus.cc:493] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.093825 11116 raft_consensus.cc:3060] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.099895 11130 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:28.100658 11130 ts_tablet_manager.cc:1403] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.006s
I20260709 13:04:28.104826 11130 raft_consensus.cc:359] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.105854 11130 raft_consensus.cc:385] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.106248 11130 raft_consensus.cc:740] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.106879 11116 raft_consensus.cc:515] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.107223 11130 consensus_queue.cc:260] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.108780 11116 leader_election.cc:290] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.110030 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2309124e32f4b289ded8e77a1a417bf" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.110466 11140 raft_consensus.cc:493] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.096534 11127 raft_consensus.cc:359] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.111063 11140 raft_consensus.cc:515] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.110030 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2309124e32f4b289ded8e77a1a417bf" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.111948 10830 raft_consensus.cc:3060] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.113384 11140 leader_election.cc:290] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.114387 11128 tablet_bootstrap.cc:492] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.114223 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.114914 11128 ts_tablet_manager.cc:1403] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.020s
W20260709 13:04:28.115738 10796 leader_election.cc:343] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.110742 10980 raft_consensus.cc:3060] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.111174 11127 raft_consensus.cc:385] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.110519 11130 ts_tablet_manager.cc:1434] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:28.116464 11127 raft_consensus.cc:740] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.117679 11130 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:28.117728 11127 consensus_queue.cc:260] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.118896 11129 raft_consensus.cc:493] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.119113 11128 raft_consensus.cc:359] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.119374 11129 raft_consensus.cc:515] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.119964 11128 raft_consensus.cc:385] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.120267 11127 ts_tablet_manager.cc:1434] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:04:28.120334 11128 raft_consensus.cc:740] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.121282 11127 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: Bootstrap starting.
I20260709 13:04:28.121657 11129 leader_election.cc:290] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.121230 11128 consensus_queue.cc:260] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.123740 11128 ts_tablet_manager.cc:1434] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:28.123601 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.125118 11128 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:28.126525 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.127537 11127 tablet_bootstrap.cc:654] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:28.129164 10796 leader_election.cc:343] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:28.130005 10798 leader_election.cc:343] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.130331 11130 tablet_bootstrap.cc:654] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.130478 10798 leader_election.cc:304] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0
I20260709 13:04:28.132226 11128 tablet_bootstrap.cc:654] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.132794 11056 raft_consensus.cc:2749] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.133508 11056 raft_consensus.cc:493] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.133950 11056 raft_consensus.cc:515] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.135453 11138 raft_consensus.cc:493] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.136363 11056 leader_election.cc:290] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.136148 11138 raft_consensus.cc:515] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.139868 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c232a7cf5a4a4f46abadd4724bf40aad" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.140861 10906 raft_consensus.cc:2468] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:28.143352 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.144351 11128 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.144306 10832 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:28.145044 11128 ts_tablet_manager.cc:1403] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:04:28.145736 11127 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: No bootstrap required, opened a new log
I20260709 13:04:28.146234 11127 ts_tablet_manager.cc:1403] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:04:28.146322 10796 leader_election.cc:304] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:28.147377 11056 raft_consensus.cc:2804] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.147852 11128 raft_consensus.cc:359] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.148586 11128 raft_consensus.cc:385] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.148900 11128 raft_consensus.cc:740] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.148818 10947 leader_election.cc:304] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.150027 11128 consensus_queue.cc:260] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.147861 11056 raft_consensus.cc:493] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.151721 11056 raft_consensus.cc:3060] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.152307 11128 ts_tablet_manager.cc:1434] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:28.153446 11128 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Bootstrap starting.
I20260709 13:04:28.156304 11127 raft_consensus.cc:359] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.156986 11127 raft_consensus.cc:385] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.157265 11127 raft_consensus.cc:740] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.157992 11127 consensus_queue.cc:260] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.159224 11112 raft_consensus.cc:2804] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.159677 11112 raft_consensus.cc:493] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.159987 11127 ts_tablet_manager.cc:1434] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:04:28.160964 11116 raft_consensus.cc:493] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.164124 11116 raft_consensus.cc:515] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.164709 11128 tablet_bootstrap.cc:654] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.164911 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c232a7cf5a4a4f46abadd4724bf40aad" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.165608 10978 raft_consensus.cc:2468] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:28.166229 11116 leader_election.cc:290] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.115999 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.166977 10979 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:28.162293 11112 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.167687 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.167723 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.163112 11130 tablet_bootstrap.cc:492] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:28.168555 10831 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.168649 10978 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.168958 11130 ts_tablet_manager.cc:1403] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.052s	user 0.023s	sys 0.014s
I20260709 13:04:28.171103 10798 leader_election.cc:304] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 1d186d6cf7074148a7bb7ed9fd95f3a3
I20260709 13:04:28.171134 10873 leader_election.cc:304] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.172230 11130 raft_consensus.cc:359] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.173229 11130 raft_consensus.cc:385] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.173243 11115 raft_consensus.cc:2804] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.173591 11130 raft_consensus.cc:740] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.174747 11115 raft_consensus.cc:493] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.175145 11115 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.175491 11130 consensus_queue.cc:260] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.187047 11138 leader_election.cc:290] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:28.188225 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.188742 11129 raft_consensus.cc:2804] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.188987 10906 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:28.200631 11129 raft_consensus.cc:493] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.201298 11129 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.186120 11115 raft_consensus.cc:515] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.216550 11115 leader_election.cc:290] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.220937 11164 raft_consensus.cc:493] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.221733 11164 raft_consensus.cc:515] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.224009 11164 leader_election.cc:290] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.225139 10830 raft_consensus.cc:2468] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.225600 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.235088 10978 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:28.237334 10798 leader_election.cc:304] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.231478 11128 tablet_bootstrap.cc:492] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: No bootstrap required, opened a new log
I20260709 13:04:28.238451 11164 raft_consensus.cc:2804] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.238934 11164 raft_consensus.cc:493] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.239066 11128 ts_tablet_manager.cc:1403] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.034s
I20260709 13:04:28.239341 11056 raft_consensus.cc:515] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.239305 11164 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.248416 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c232a7cf5a4a4f46abadd4724bf40aad" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.249253 10978 raft_consensus.cc:3060] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.252373 11164 raft_consensus.cc:515] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.255064 11164 leader_election.cc:290] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.256134 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
W20260709 13:04:28.243072 10796 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36687, user_credentials={real_user=slave}} blocked reactor thread for 44177.6us
I20260709 13:04:28.233265 11112 raft_consensus.cc:515] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.257838 10981 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.265057 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.266832 10906 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 0.
I20260709 13:04:28.273223 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c232a7cf5a4a4f46abadd4724bf40aad" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.231448 10980 raft_consensus.cc:2468] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.243757 11128 raft_consensus.cc:359] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.281450 11128 raft_consensus.cc:385] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.282249 11128 raft_consensus.cc:740] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.283304 11128 consensus_queue.cc:260] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.286231 11128 ts_tablet_manager.cc:1434] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:04:28.280186 11056 leader_election.cc:290] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.292670 10981 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:28.294445 10798 leader_election.cc:304] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.295482 11056 raft_consensus.cc:2804] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.296212 11056 raft_consensus.cc:697] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:28.296833 10906 raft_consensus.cc:3060] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.297245 11056 consensus_queue.cc:237] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.299165 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.299872 10907 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.300873 11129 raft_consensus.cc:515] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.302691 11130 ts_tablet_manager.cc:1434] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.133s	user 0.067s	sys 0.056s
I20260709 13:04:28.303735 11130 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: Bootstrap starting.
I20260709 13:04:28.304890 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.305434 10981 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.309676 11130 tablet_bootstrap.cc:654] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.312254 10978 raft_consensus.cc:2468] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:28.313915 10798 leader_election.cc:304] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.315022 11164 raft_consensus.cc:2804] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.315070 11129 leader_election.cc:290] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.315534 11164 raft_consensus.cc:697] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:28.315917 11160 raft_consensus.cc:493] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.316396 11160 raft_consensus.cc:515] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.316512 11164 consensus_queue.cc:237] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.318524 11160 leader_election.cc:290] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.321606 10981 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:28.275439 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
W20260709 13:04:28.279623 10873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43575, user_credentials={real_user=slave}} blocked reactor thread for 108458us
I20260709 13:04:28.322930 10830 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.323685 10873 leader_election.cc:304] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:28.328176 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8cc87787c440d981513d0d747e10e6" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.328363 10798 leader_election.cc:304] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.328878 10980 raft_consensus.cc:2468] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.329479 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.330304 10832 raft_consensus.cc:2393] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in current term 1: Already voted for candidate c36caa3aefdd42469d83005641bb9cf7 in this term.
I20260709 13:04:28.330425 11115 raft_consensus.cc:2804] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.330953 11115 raft_consensus.cc:697] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:28.331797 11115 consensus_queue.cc:237] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.335585 11116 raft_consensus.cc:493] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.336119 10907 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:28.337353 10873 leader_election.cc:304] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.338414 11112 leader_election.cc:290] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:28.338847 11116 raft_consensus.cc:515] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.338961 11160 raft_consensus.cc:2804] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.340468 11160 raft_consensus.cc:493] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.340812 11160 raft_consensus.cc:3060] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.341398 11116 leader_election.cc:290] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.342072 11140 raft_consensus.cc:2804] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.342599 11140 raft_consensus.cc:697] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:28.343252 10906 raft_consensus.cc:2468] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 1.
I20260709 13:04:28.343632 11140 consensus_queue.cc:237] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.347112 11130 tablet_bootstrap.cc:492] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: No bootstrap required, opened a new log
I20260709 13:04:28.347791 11130 ts_tablet_manager.cc:1403] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.027s
I20260709 13:04:28.334216 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8cc87787c440d981513d0d747e10e6" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.349581 10828 raft_consensus.cc:2468] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.351105 11130 raft_consensus.cc:359] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.351886 11130 raft_consensus.cc:385] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.352147 11130 raft_consensus.cc:740] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.352885 11130 consensus_queue.cc:260] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.354686 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.355180 11130 ts_tablet_manager.cc:1434] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:28.355482 10981 raft_consensus.cc:2393] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in current term 1: Already voted for candidate c36caa3aefdd42469d83005641bb9cf7 in this term.
I20260709 13:04:28.359704 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.360929 10907 raft_consensus.cc:2393] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c36caa3aefdd42469d83005641bb9cf7 in current term 1: Already voted for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in this term.
I20260709 13:04:28.366498 11160 raft_consensus.cc:515] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.368400 11160 leader_election.cc:290] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.369876 11112 raft_consensus.cc:493] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.370569 11112 raft_consensus.cc:515] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.374861 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.374428 11112 leader_election.cc:290] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:28.375602 10828 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:28.376820 10947 leader_election.cc:304] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.377964 11112 raft_consensus.cc:2804] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.379309 11112 raft_consensus.cc:493] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.379941 11112 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.385176 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.386078 10906 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.394438 11112 raft_consensus.cc:515] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.397015 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" is_pre_election: true
I20260709 13:04:28.398180 10907 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 0.
I20260709 13:04:28.400424 11112 leader_election.cc:290] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:28.403112 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.404057 10905 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.407122 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.408022 10828 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.418601 10830 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:28.420025 10947 leader_election.cc:304] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
W20260709 13:04:28.420178 10873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:43575, user_credentials={real_user=slave}} blocked reactor thread for 82845us
I20260709 13:04:28.421118 11112 raft_consensus.cc:2804] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.421763 11112 raft_consensus.cc:697] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:28.422866 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0" is_pre_election: true
I20260709 13:04:28.422731 11112 consensus_queue.cc:237] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.423556 10981 raft_consensus.cc:2468] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.426870 10828 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:28.427640 10905 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:28.427989 11163 consensus_queue.cc:1048] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.427682 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7" is_pre_election: true
I20260709 13:04:28.428141 10947 leader_election.cc:304] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.429086 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8cc87787c440d981513d0d747e10e6" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.429411 11161 raft_consensus.cc:2804] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.429759 10981 raft_consensus.cc:3060] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.430011 11161 raft_consensus.cc:697] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:28.431193 11161 consensus_queue.cc:237] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.429082 10830 raft_consensus.cc:2468] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 0.
I20260709 13:04:28.437604 10981 raft_consensus.cc:2468] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.438939 10830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8cc87787c440d981513d0d747e10e6" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.439509 10873 leader_election.cc:304] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3; no voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0
I20260709 13:04:28.439531 10830 raft_consensus.cc:3060] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.440761 11115 raft_consensus.cc:2749] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.442265 10906 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 1.
I20260709 13:04:28.444123 10873 leader_election.cc:304] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:28.444799 11115 raft_consensus.cc:2804] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.444460 10726 catalog_manager.cc:5697] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.445202 11115 raft_consensus.cc:493] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.445585 11115 raft_consensus.cc:3060] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.447652 10873 leader_election.cc:304] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.448653 11168 raft_consensus.cc:2804] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.449119 11168 raft_consensus.cc:697] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:28.449543 10729 catalog_manager.cc:5697] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.449887 11168 consensus_queue.cc:237] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.452845 11115 raft_consensus.cc:515] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.455542 11115 leader_election.cc:290] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.456924 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.457525 10978 raft_consensus.cc:3060] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.437503 10728 catalog_manager.cc:5697] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.461063 10728 catalog_manager.cc:5697] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.464834 10978 raft_consensus.cc:2468] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.466704 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e57d33780c423abcfd84231c71ae53" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.467870 10828 raft_consensus.cc:3060] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.468016 10873 leader_election.cc:304] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.471753 11170 consensus_queue.cc:1048] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.472086 10830 raft_consensus.cc:2468] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.475169 11160 raft_consensus.cc:2804] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.475696 11160 raft_consensus.cc:697] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:28.476555 11160 consensus_queue.cc:237] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.484869 10828 raft_consensus.cc:2468] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 1.
I20260709 13:04:28.499240 10728 catalog_manager.cc:5697] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.500928 10729 catalog_manager.cc:5697] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 0 to 1, leader changed from <none> to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.511339 10726 catalog_manager.cc:5697] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.512863 10726 catalog_manager.cc:5697] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.562716 10981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
mode: GRACEFUL
new_leader_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:28.563213 10981 raft_consensus.cc:606] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Received request to transfer leadership to TS c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:28.567574 10981 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
mode: GRACEFUL
new_leader_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:28.567996 10981 raft_consensus.cc:606] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Received request to transfer leadership to TS c36caa3aefdd42469d83005641bb9cf7
I20260709 13:04:28.574955 10828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
mode: GRACEFUL
new_leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
 from {username='slave'} at 127.0.0.1:45144
I20260709 13:04:28.575469 10828 raft_consensus.cc:606] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Received request to transfer leadership to TS 1d186d6cf7074148a7bb7ed9fd95f3a3
I20260709 13:04:28.587457 10828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
mode: GRACEFUL
new_leader_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45144
I20260709 13:04:28.587950 10828 raft_consensus.cc:606] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Received request to transfer leadership to TS cd0fca555828416eacf5179cc3129db0
I20260709 13:04:28.715129 11170 consensus_queue.cc:1048] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.727797 11140 consensus_queue.cc:1048] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.769604 11140 consensus_queue.cc:1048] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.776620 11164 raft_consensus.cc:993] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: : Instructing follower cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:28.777100 11163 raft_consensus.cc:1081] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Signalling peer cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:28.778898 10978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:04:28.780740 10978 raft_consensus.cc:493] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.781138 10978 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.783747 11140 consensus_queue.cc:1048] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.789001 10978 raft_consensus.cc:515] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.794519 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.795200 10828 raft_consensus.cc:3055] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.795511 10828 raft_consensus.cc:740] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:28.796283 10828 consensus_queue.cc:260] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.797413 10828 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.794519 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "346f595f3da14bcebfd5d57a1e296b0e" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.799414 10906 raft_consensus.cc:3060] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.804641 10828 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:28.805789 10947 leader_election.cc:304] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.805896 10906 raft_consensus.cc:2468] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:28.806550 11161 raft_consensus.cc:2804] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.806778 10978 leader_election.cc:290] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:28.807111 11161 raft_consensus.cc:697] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:28.807961 11161 consensus_queue.cc:237] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.814764 10729 catalog_manager.cc:5697] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 1 to 2, leader changed from c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193) to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.817883 11160 consensus_queue.cc:1048] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.831153 11116 consensus_queue.cc:1048] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.842754 11140 consensus_queue.cc:1048] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.853832 11056 consensus_queue.cc:1048] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.861390 11056 raft_consensus.cc:993] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: : Instructing follower 1d186d6cf7074148a7bb7ed9fd95f3a3 to start an election
I20260709 13:04:28.861881 11163 raft_consensus.cc:1081] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Signalling peer 1d186d6cf7074148a7bb7ed9fd95f3a3 to start an election
I20260709 13:04:28.864122 10906 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4"
dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
 from {username='slave'} at 127.0.0.1:35978
I20260709 13:04:28.864583 10906 raft_consensus.cc:493] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.864877 10906 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.870038 10906 raft_consensus.cc:515] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.871928 10906 leader_election.cc:290] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 2 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:28.872371 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:28.873042 10828 raft_consensus.cc:3055] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:28.872915 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ac412bbdc74b0a8f21c9b6e6fef5c4" candidate_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:28.873963 10828 raft_consensus.cc:740] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:28.874142 10978 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.874845 10828 consensus_queue.cc:260] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.876163 10828 raft_consensus.cc:3060] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.881635 10978 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 2.
I20260709 13:04:28.883021 10873 leader_election.cc:304] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:28.883183 10828 raft_consensus.cc:2468] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d186d6cf7074148a7bb7ed9fd95f3a3 in term 2.
I20260709 13:04:28.883857 11116 raft_consensus.cc:2804] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:28.884380 11116 raft_consensus.cc:697] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:28.885093 11116 consensus_queue.cc:237] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.892089 10729 catalog_manager.cc:5697] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 reported cstate change: term changed from 1 to 2, leader changed from c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193) to 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.893013 11116 consensus_queue.cc:1048] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.893505 11112 consensus_queue.cc:1048] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.898109 11112 consensus_queue.cc:1048] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.910723 11138 consensus_queue.cc:1048] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.925740 11168 consensus_queue.cc:1048] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.933655 11115 consensus_queue.cc:1048] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.939673 11112 raft_consensus.cc:993] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: : Instructing follower c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:28.940538 11112 raft_consensus.cc:1081] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Signalling peer c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:28.967738 11115 consensus_queue.cc:1048] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:28.973376 10947 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35559, user_credentials={real_user=slave}} blocked reactor thread for 43667.1us
I20260709 13:04:28.976326 10828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:28.976922 10828 raft_consensus.cc:493] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:28.977306 10828 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.979234 11138 consensus_queue.cc:1048] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.993443 10828 raft_consensus.cc:515] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:28.996881 11138 raft_consensus.cc:993] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: : Instructing follower c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:28.996940 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:28.997396 11138 raft_consensus.cc:1081] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Signalling peer c36caa3aefdd42469d83005641bb9cf7 to start an election
I20260709 13:04:28.997682 10905 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:28.999462 10830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
 from {username='slave'} at 127.0.0.1:45136
I20260709 13:04:28.999917 10830 raft_consensus.cc:493] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:29.000272 10830 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.001983 10828 leader_election.cc:290] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:29.003234 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1032620b427c4a7890d28cf95b7b5ee6" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:29.003906 10981 raft_consensus.cc:3055] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:29.004246 10981 raft_consensus.cc:740] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:29.005136 10981 consensus_queue.cc:260] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:29.006742 10981 raft_consensus.cc:3060] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.006556 10830 raft_consensus.cc:515] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:29.010954 10830 leader_election.cc:290] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Requested vote from peers 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687), cd0fca555828416eacf5179cc3129db0 (127.0.107.195:43575)
I20260709 13:04:29.012058 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd0fca555828416eacf5179cc3129db0"
I20260709 13:04:29.012048 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4091b1a32ad74f37aea3250944f3d299" candidate_uuid: "c36caa3aefdd42469d83005641bb9cf7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:29.012893 10980 raft_consensus.cc:3055] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:29.013082 10907 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.013247 10980 raft_consensus.cc:740] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:29.014096 10980 consensus_queue.cc:260] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:29.015054 10980 raft_consensus.cc:3060] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:29.021199 10981 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:29.021535 10980 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:29.022378 10907 raft_consensus.cc:2468] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:29.021930 10905 raft_consensus.cc:2468] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c36caa3aefdd42469d83005641bb9cf7 in term 2.
I20260709 13:04:29.022995 10798 leader_election.cc:304] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c36caa3aefdd42469d83005641bb9cf7, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:29.023617 10796 leader_election.cc:304] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, c36caa3aefdd42469d83005641bb9cf7; no voters: 
I20260709 13:04:29.023926 11170 raft_consensus.cc:2804] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:29.024479 11170 raft_consensus.cc:697] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:29.024624 11056 raft_consensus.cc:2804] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:29.025177 11056 raft_consensus.cc:697] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Leader. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:29.025296 11170 consensus_queue.cc:237] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:29.026026 11056 consensus_queue.cc:237] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:29.033761 10728 catalog_manager.cc:5697] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 1 to 2, leader changed from cd0fca555828416eacf5179cc3129db0 (127.0.107.195) to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.034876 10728 catalog_manager.cc:5697] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 reported cstate change: term changed from 1 to 2, leader changed from cd0fca555828416eacf5179cc3129db0 (127.0.107.195) to c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c36caa3aefdd42469d83005641bb9cf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.314174 10907 raft_consensus.cc:1275] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.315698 11138 consensus_queue.cc:1048] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.323583 10830 raft_consensus.cc:1275] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.324913 11138 consensus_queue.cc:1048] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.343842 10830 raft_consensus.cc:1275] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Refusing update from remote peer 1d186d6cf7074148a7bb7ed9fd95f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.344937 11116 consensus_queue.cc:1048] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.355500 10981 raft_consensus.cc:1275] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer 1d186d6cf7074148a7bb7ed9fd95f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.358033 11116 consensus_queue.cc:1048] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.411531 10907 raft_consensus.cc:1275] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.412825 11164 consensus_queue.cc:1048] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.416293 10981 raft_consensus.cc:1275] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.417765 11164 consensus_queue.cc:1048] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:29.421499 10980 raft_consensus.cc:1275] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.424443 11056 consensus_queue.cc:1048] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:04:29.436486 10907 raft_consensus.cc:1275] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer c36caa3aefdd42469d83005641bb9cf7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:29.438354 11056 consensus_queue.cc:1048] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:31.590965 10728 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56538:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:04:31.610455 10728 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56538:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
W20260709 13:04:31.731338 10873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35559, user_credentials={real_user=slave}} blocked reactor thread for 59946.4us
I20260709 13:04:31.741266   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:31.822130 11236 tablet.cc:1724] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:31.829872 11219 log.cc:927] Time spent T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:31.871973 11245 tablet.cc:1724] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:31.885967 11244 tablet.cc:1724] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:31.919135 11243 tablet.cc:1724] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:31.926465 11246 tablet.cc:1724] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:31.964242 10873 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43575, user_credentials={real_user=slave}} blocked reactor thread for 116973us
I20260709 13:04:32.004007 11258 tablet.cc:1724] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.013618 11259 tablet.cc:1724] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.002243 11253 tablet.cc:1724] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.052441 10827 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401"
dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
mode: GRACEFUL
new_leader_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:44676
I20260709 13:04:32.053184 10827 raft_consensus.cc:606] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Received request to transfer leadership to TS cd0fca555828416eacf5179cc3129db0
I20260709 13:04:32.034042 11244 tablet.cc:1724] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:32.075699 11252 log.cc:927] Time spent T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:32.105629 11243 tablet.cc:1724] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.109917 11260 tablet.cc:1724] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:04:32.112699 11257 log.cc:927] Time spent T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:04:32.124836 11236 tablet.cc:1724] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.094431 11245 tablet.cc:1724] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.118366 11261 tablet.cc:1724] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.126544 11244 tablet.cc:1724] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.148056 11243 tablet.cc:1724] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.157461 11246 tablet.cc:1724] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.158730 11245 tablet.cc:1724] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.164201 11253 tablet.cc:1724] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.166683 11267 tablet.cc:1724] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.171839 11270 tablet.cc:1724] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.159966 11259 tablet.cc:1724] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.176004 11258 tablet.cc:1724] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.191129 11244 tablet.cc:1724] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.204882 11236 tablet.cc:1724] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.210188 10903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2"
dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
mode: GRACEFUL
new_leader_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:49162
I20260709 13:04:32.210906 10903 raft_consensus.cc:606] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Received request to transfer leadership to TS cd0fca555828416eacf5179cc3129db0
I20260709 13:04:32.210662 11259 tablet.cc:1724] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.212520   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:32.217787   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:32.211959 11260 tablet.cc:1724] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:04:32.217058 11237 raft_consensus.cc:993] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: : Instructing follower cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:32.226657 11237 raft_consensus.cc:1081] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Signalling peer cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:32.228470 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45132
I20260709 13:04:32.229027 10977 raft_consensus.cc:493] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.229388 10977 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.249058 10977 raft_consensus.cc:515] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.252113 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:32.252521 10903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24a6c0e60264410fb2cfc13a1ee1c401" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:32.252772 10828 raft_consensus.cc:3055] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:32.253185 10828 raft_consensus.cc:740] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c36caa3aefdd42469d83005641bb9cf7, State: Running, Role: LEADER
I20260709 13:04:32.252594 10977 leader_election.cc:290] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 3 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:32.254081 10828 consensus_queue.cc:260] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.253206 10903 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.255263 10828 raft_consensus.cc:3060] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:32.257254 10726 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: soft_deleted_table [id=5931c3f198a54d11b15cd974f7e4d916] alter complete (version 1)
I20260709 13:04:32.262269 10903 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 3.
I20260709 13:04:32.263643 10945 leader_election.cc:304] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:32.264645 11228 raft_consensus.cc:2804] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:32.265018 10828 raft_consensus.cc:2468] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 3.
I20260709 13:04:32.265117 11228 raft_consensus.cc:697] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 3 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:32.266129 11228 consensus_queue.cc:237] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.275153 10726 catalog_manager.cc:5697] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 2 to 3, leader changed from c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193) to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.546408 11255 raft_consensus.cc:993] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: : Instructing follower cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:32.547221 11242 raft_consensus.cc:1081] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Signalling peer cd0fca555828416eacf5179cc3129db0 to start an election
I20260709 13:04:32.548785 10977 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2"
dest_uuid: "cd0fca555828416eacf5179cc3129db0"
 from {username='slave'} at 127.0.0.1:45126
I20260709 13:04:32.549333 10977 raft_consensus.cc:493] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:32.549590 10977 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.555475 10977 raft_consensus.cc:515] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.557094 10977 leader_election.cc:290] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Requested vote from peers c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559), 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687)
I20260709 13:04:32.558174 10903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3"
I20260709 13:04:32.558753 10903 raft_consensus.cc:3055] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.557982 10828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402d1c7b427346dcb3c93c4d73853ab2" candidate_uuid: "cd0fca555828416eacf5179cc3129db0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c36caa3aefdd42469d83005641bb9cf7"
I20260709 13:04:32.559073 10903 raft_consensus.cc:740] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d186d6cf7074148a7bb7ed9fd95f3a3, State: Running, Role: LEADER
I20260709 13:04:32.559407 10828 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.559892 10903 consensus_queue.cc:260] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.561290 10903 raft_consensus.cc:3060] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.567628 10903 raft_consensus.cc:2468] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:32.567628 10828 raft_consensus.cc:2468] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd0fca555828416eacf5179cc3129db0 in term 2.
I20260709 13:04:32.568923 10945 leader_election.cc:304] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d186d6cf7074148a7bb7ed9fd95f3a3, cd0fca555828416eacf5179cc3129db0; no voters: 
I20260709 13:04:32.569733 11228 raft_consensus.cc:2804] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:32.571009 11228 raft_consensus.cc:697] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Becoming Leader. State: Replica: cd0fca555828416eacf5179cc3129db0, State: Running, Role: LEADER
I20260709 13:04:32.571996 11228 consensus_queue.cc:237] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } }
I20260709 13:04:32.579844 10726 catalog_manager.cc:5697] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 reported cstate change: term changed from 1 to 2, leader changed from 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194) to cd0fca555828416eacf5179cc3129db0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cd0fca555828416eacf5179cc3129db0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd0fca555828416eacf5179cc3129db0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43575 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.733897 10903 raft_consensus.cc:1275] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 3 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:32.735280 11228 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:32.747620 10828 raft_consensus.cc:1275] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 3 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:32.749101 11275 consensus_queue.cc:1048] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:33.050114 10828 raft_consensus.cc:1275] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.051414 11275 consensus_queue.cc:1048] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c36caa3aefdd42469d83005641bb9cf7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.060142 10903 raft_consensus.cc:1275] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Refusing update from remote peer cd0fca555828416eacf5179cc3129db0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:33.062880 11195 consensus_queue.cc:1048] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d186d6cf7074148a7bb7ed9fd95f3a3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:33.302100   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:33.328943   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.329847   431 tablet_replica.cc:333] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.330469   431 raft_consensus.cc:2243] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.331036   431 raft_consensus.cc:2272] T ff8cc87787c440d981513d0d747e10e6 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.332975   431 tablet_replica.cc:333] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.333571   431 raft_consensus.cc:2243] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.334021   431 raft_consensus.cc:2272] T 346f595f3da14bcebfd5d57a1e296b0e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.335943   431 tablet_replica.cc:333] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.336526   431 raft_consensus.cc:2243] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.336954   431 raft_consensus.cc:2272] T b2309124e32f4b289ded8e77a1a417bf P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.338766   431 tablet_replica.cc:333] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.339303   431 raft_consensus.cc:2243] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.339727   431 raft_consensus.cc:2272] T b0e57d33780c423abcfd84231c71ae53 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.341454   431 tablet_replica.cc:333] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.341969   431 raft_consensus.cc:2243] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.342803   431 raft_consensus.cc:2272] T c232a7cf5a4a4f46abadd4724bf40aad P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.344660   431 tablet_replica.cc:333] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.345221   431 raft_consensus.cc:2243] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.345636   431 raft_consensus.cc:2272] T 402d1c7b427346dcb3c93c4d73853ab2 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.348126   431 tablet_replica.cc:333] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.348691   431 raft_consensus.cc:2243] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.349115   431 raft_consensus.cc:2272] T 24a6c0e60264410fb2cfc13a1ee1c401 P c36caa3aefdd42469d83005641bb9cf7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.351773   431 tablet_replica.cc:333] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.352344   431 raft_consensus.cc:2243] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.353166   431 raft_consensus.cc:2272] T 35400d1199c54bda8caaaa4e3dd56da4 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.355306   431 tablet_replica.cc:333] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.355798   431 raft_consensus.cc:2243] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.356468   431 raft_consensus.cc:2272] T 4091b1a32ad74f37aea3250944f3d299 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.358178   431 tablet_replica.cc:333] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.358717   431 raft_consensus.cc:2243] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.359191   431 raft_consensus.cc:2272] T 52e4a0ae09074c4ab0342b842878204c P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.361186   431 tablet_replica.cc:333] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.361707   431 raft_consensus.cc:2243] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.362142   431 raft_consensus.cc:2272] T 6c709d4217d7435884fbb0828779d9e8 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.364359   431 tablet_replica.cc:333] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.365103   431 raft_consensus.cc:2243] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.365561   431 raft_consensus.cc:2272] T ec1e336e5a334d659431d6c6fe1687c8 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.368220   431 tablet_replica.cc:333] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.369002   431 raft_consensus.cc:2243] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.369846   431 raft_consensus.cc:2272] T dd24fce6502a4018a09ad3386b1a9cac P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.371800   431 tablet_replica.cc:333] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.372411   431 raft_consensus.cc:2243] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.373111   431 raft_consensus.cc:2272] T 3dc984127dfe41429a126b65ef5298e4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.374962   431 tablet_replica.cc:333] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.375415   431 raft_consensus.cc:2243] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.375818   431 raft_consensus.cc:2272] T ca68812caa7e4232a719d957b0c1938e P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.377902   431 tablet_replica.cc:333] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.378334   431 raft_consensus.cc:2243] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.379084   431 raft_consensus.cc:2272] T 1032620b427c4a7890d28cf95b7b5ee6 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.380877   431 tablet_replica.cc:333] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.381376   431 raft_consensus.cc:2243] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.381801   431 raft_consensus.cc:2272] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P c36caa3aefdd42469d83005641bb9cf7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.383540   431 tablet_replica.cc:333] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7: stopping tablet replica
I20260709 13:04:33.384032   431 raft_consensus.cc:2243] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.384817   431 raft_consensus.cc:2272] T d92e95e9412d45bcae577ea20e5a1b91 P c36caa3aefdd42469d83005641bb9cf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.423890   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:33.455153   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:33.479117 10945 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 13:04:33.488270   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.489231   431 tablet_replica.cc:333] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.490121   431 raft_consensus.cc:2243] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.490980   431 raft_consensus.cc:2272] T b0e57d33780c423abcfd84231c71ae53 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.492916 10945 consensus_peers.cc:597] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 -> Peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Couldn't send request to peer 1d186d6cf7074148a7bb7ed9fd95f3a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.493250   431 tablet_replica.cc:333] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.493949   431 raft_consensus.cc:2243] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.494400   431 raft_consensus.cc:2272] T 346f595f3da14bcebfd5d57a1e296b0e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.496268   431 tablet_replica.cc:333] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.496812   431 raft_consensus.cc:2243] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.497640   431 raft_consensus.cc:2272] T b2309124e32f4b289ded8e77a1a417bf P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.499595   431 tablet_replica.cc:333] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.500140   431 raft_consensus.cc:2243] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.500557   431 raft_consensus.cc:2272] T c232a7cf5a4a4f46abadd4724bf40aad P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.502385   431 tablet_replica.cc:333] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.503034   431 raft_consensus.cc:2243] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.503790   431 raft_consensus.cc:2272] T ff8cc87787c440d981513d0d747e10e6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.505657   431 tablet_replica.cc:333] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.506199   431 raft_consensus.cc:2243] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.506605   431 raft_consensus.cc:2272] T 402d1c7b427346dcb3c93c4d73853ab2 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.509205   431 tablet_replica.cc:333] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.509956   431 raft_consensus.cc:2243] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.510915   431 raft_consensus.cc:2272] T ec1e336e5a334d659431d6c6fe1687c8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.513120   431 tablet_replica.cc:333] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.513711   431 raft_consensus.cc:2243] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.514468   431 raft_consensus.cc:2272] T 6c709d4217d7435884fbb0828779d9e8 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:33.515767 10873 consensus_peers.cc:597] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 -> Peer c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559): Couldn't send request to peer c36caa3aefdd42469d83005641bb9cf7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.516682   431 tablet_replica.cc:333] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.517339   431 raft_consensus.cc:2243] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.517802   431 raft_consensus.cc:2272] T 35400d1199c54bda8caaaa4e3dd56da4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.519826   431 tablet_replica.cc:333] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.520361   431 raft_consensus.cc:2243] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.520797   431 raft_consensus.cc:2272] T 4091b1a32ad74f37aea3250944f3d299 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.522564   431 tablet_replica.cc:333] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.523154   431 raft_consensus.cc:2243] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.523912   431 raft_consensus.cc:2272] T 52e4a0ae09074c4ab0342b842878204c P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.525838   431 tablet_replica.cc:333] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.526391   431 raft_consensus.cc:2243] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.526890   431 raft_consensus.cc:2272] T 24a6c0e60264410fb2cfc13a1ee1c401 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.529786   431 tablet_replica.cc:333] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.530346   431 raft_consensus.cc:2243] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.530833   431 raft_consensus.cc:2272] T 3dc984127dfe41429a126b65ef5298e4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.532757   431 tablet_replica.cc:333] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.533257   431 raft_consensus.cc:2243] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.533676   431 raft_consensus.cc:2272] T ca68812caa7e4232a719d957b0c1938e P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.535622   431 tablet_replica.cc:333] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.536301   431 raft_consensus.cc:2243] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.536768   431 raft_consensus.cc:2272] T 1032620b427c4a7890d28cf95b7b5ee6 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.538545   431 tablet_replica.cc:333] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.539121   431 raft_consensus.cc:2243] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.539901   431 raft_consensus.cc:2272] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.541771   431 tablet_replica.cc:333] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.542325   431 raft_consensus.cc:2243] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.542831   431 raft_consensus.cc:2272] T d92e95e9412d45bcae577ea20e5a1b91 P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.544909   431 tablet_replica.cc:333] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3: stopping tablet replica
I20260709 13:04:33.545437   431 raft_consensus.cc:2243] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.545882   431 raft_consensus.cc:2272] T dd24fce6502a4018a09ad3386b1a9cac P 1d186d6cf7074148a7bb7ed9fd95f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.585311   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:33.590193 10947 consensus_peers.cc:597] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 -> Peer c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559): Couldn't send request to peer c36caa3aefdd42469d83005641bb9cf7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.617399   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:04:33.618770 10945 consensus_peers.cc:597] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 -> Peer 1d186d6cf7074148a7bb7ed9fd95f3a3 (127.0.107.194:36687): Couldn't send request to peer 1d186d6cf7074148a7bb7ed9fd95f3a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:36687: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.643682   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:33.644510   431 tablet_replica.cc:333] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.645130   431 raft_consensus.cc:2243] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.645627   431 raft_consensus.cc:2272] T b0e57d33780c423abcfd84231c71ae53 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.647619   431 tablet_replica.cc:333] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.648196   431 raft_consensus.cc:2243] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.648633   431 raft_consensus.cc:2272] T ff8cc87787c440d981513d0d747e10e6 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.650349   431 tablet_replica.cc:333] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.650928   431 raft_consensus.cc:2243] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.651350   431 raft_consensus.cc:2272] T c232a7cf5a4a4f46abadd4724bf40aad P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.653015   431 tablet_replica.cc:333] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.653561   431 raft_consensus.cc:2243] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.654306   431 raft_consensus.cc:2272] T 346f595f3da14bcebfd5d57a1e296b0e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.656203   431 tablet_replica.cc:333] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.656940   431 raft_consensus.cc:2243] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.657473   431 raft_consensus.cc:2272] T b2309124e32f4b289ded8e77a1a417bf P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.659317   431 tablet_replica.cc:333] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.659860   431 raft_consensus.cc:2243] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:33.660449 10947 consensus_peers.cc:597] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 -> Peer c36caa3aefdd42469d83005641bb9cf7 (127.0.107.193:35559): Couldn't send request to peer c36caa3aefdd42469d83005641bb9cf7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.660604   431 raft_consensus.cc:2272] T 402d1c7b427346dcb3c93c4d73853ab2 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.662958   431 tablet_replica.cc:333] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.663512   431 raft_consensus.cc:2243] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.663941   431 raft_consensus.cc:2272] T dd24fce6502a4018a09ad3386b1a9cac P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.665853   431 tablet_replica.cc:333] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.666379   431 raft_consensus.cc:2243] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.666851   431 raft_consensus.cc:2272] T 35400d1199c54bda8caaaa4e3dd56da4 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.668624   431 tablet_replica.cc:333] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.669150   431 raft_consensus.cc:2243] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.669596   431 raft_consensus.cc:2272] T 4091b1a32ad74f37aea3250944f3d299 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.671646   431 tablet_replica.cc:333] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.672216   431 raft_consensus.cc:2243] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.672667   431 raft_consensus.cc:2272] T 52e4a0ae09074c4ab0342b842878204c P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.674719   431 tablet_replica.cc:333] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.675271   431 raft_consensus.cc:2243] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.676077   431 raft_consensus.cc:2272] T 24a6c0e60264410fb2cfc13a1ee1c401 P cd0fca555828416eacf5179cc3129db0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.678562   431 tablet_replica.cc:333] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.679191   431 raft_consensus.cc:2243] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.679659   431 raft_consensus.cc:2272] T 3dc984127dfe41429a126b65ef5298e4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.681623   431 tablet_replica.cc:333] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.682137   431 raft_consensus.cc:2243] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.682987   431 raft_consensus.cc:2272] T ca68812caa7e4232a719d957b0c1938e P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.684851   431 tablet_replica.cc:333] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.685357   431 raft_consensus.cc:2243] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.685791   431 raft_consensus.cc:2272] T 1032620b427c4a7890d28cf95b7b5ee6 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.687613   431 tablet_replica.cc:333] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.688130   431 raft_consensus.cc:2243] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.688545   431 raft_consensus.cc:2272] T d92e95e9412d45bcae577ea20e5a1b91 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.690584   431 tablet_replica.cc:333] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.691131   431 raft_consensus.cc:2243] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.691578   431 raft_consensus.cc:2272] T 69ac412bbdc74b0a8f21c9b6e6fef5c4 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.693297   431 tablet_replica.cc:333] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.693861   431 raft_consensus.cc:2243] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.694312   431 raft_consensus.cc:2272] T 6c709d4217d7435884fbb0828779d9e8 P cd0fca555828416eacf5179cc3129db0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.696256   431 tablet_replica.cc:333] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0: stopping tablet replica
I20260709 13:04:33.696707   431 raft_consensus.cc:2243] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:33.697165   431 raft_consensus.cc:2272] T ec1e336e5a334d659431d6c6fe1687c8 P cd0fca555828416eacf5179cc3129db0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.735810   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:33.764891   431 master.cc:562] Master@127.0.107.254:34751 shutting down...
I20260709 13:04:33.785970   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:33.786525   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:33.786907   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P fbd653147df74eb282640aade3580275: stopping tablet replica
I20260709 13:04:33.805841   431 master.cc:584] Master@127.0.107.254:34751 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11293 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23753 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (318912 ms total)
[  PASSED  ] 8 tests.
I20260709 13:04:33.871833   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 396 messages since previous log ~514 seconds ago
I20260709 13:04:33.872133   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 396 messages since previous log ~514 seconds ago
I20260709 13:04:33.872340   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 393 messages since previous log ~514 seconds ago
I20260709 13:04:33.872558   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:04:33.872768   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:04:33.873018   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~148 seconds ago
I20260709 13:04:33.873282   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:04:33.873600   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 28 messages since previous log ~9 seconds ago
